Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2763

Unit test test_intpack failing on OSX

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.9.0, 3.3.11, 3.2.10
    • Labels:
      None
    • # Replies:
      11
    • Last comment by Customer:
      true

      Description

      Starting recently, the test_intpack series of unit tests are failing on OSX.

      I have managed to reproduce this on OSX, the failure appears to have been going on for quite some time.

      Failure itself looks to be some form of timing error around deleting of files within the test environment. The test is also only triggered when run with concurrency (-j >1) and passes when run in serial.

      Command to repro:

      DYLD_LIBRARY_PATH=.libs python ../test/suite/run.py -v 2 test_intpack -j 4
      

        Activity

        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'name': u'Ramon Fernandez', u'email': u'ramon@mongodb.com'}

        Message: Import wiredtiger-wiredtiger-2.8.0-592-g848e5f5.tar.gz from wiredtiger branch mongodb-3.2

        ref: 8b7110b..848e5f5
        for: 3.2.9

        This commit replaces a number of previous backports with the original
        change, so some of the tickets listed below may have been resolved in
        previous versions already as a backport to the v3.2 branch. For example,
        SERVER-24580 includes change a63e21b8 as a cherry-pick of 1f4aaa44, but
        this commit replaces that change with 1f4aaa44 itself.

        SERVER-23659 Provide useful message when wiredTigerJournalCompressor is changed
        SERVER-23661 $sample takes disproportionately long time on newly created collection
        SERVER-24306 40-second journaling stall from "log files prepared" to checkpoint
        SERVER-24580 Improve performance when WiredTiger cache is full
        WT-2103 Add incremental backup testing to format
        WT-2223 Add stress testing for in-memory
        WT-2268 JSON load incorrect with UNICODE input
        WT-2319 Add statistics around fsync calls
        WT-2325 Fix an incomplete comment
        WT-2343 Assert we don't remove or rename when backup cursor is open
        WT-2349 Add ability to open databases read-only
        WT-2359 WiredTiger with Python will hang if a calloc failure occurs during __wt_connection_close
        WT-2360 Allow disjunctions and combinations of operations in join cursors
        WT-2408 Windows error translation layer
        WT-2446 Estimate WT cache hit ratio
        WT-2450 Salvage releases pages, then explicitly evicts them.
        WT-2453 Throughput drop in wtperf evict Jenkins tests
        WT-2479 Dump utility discards table config (JSON)
        WT-2491 The dhandle close_lock isn't valuable at the moment
        WT-2504 Should READONLY always read basecfg file?
        WT-2505 Review clang analyzer warnings
        WT-2508 Test programs should remove test directories on the "clean" target
        WT-2514 Log path name is an empty string.
        WT-2518 LSM checkpoint handle acquisition optimization
        WT-2520 WT_SESSION::verify should not alter tables
        WT-2526 Mixing and matching readonly and read/write handles
        WT-2535 Extend test/format to test for transactions reading their writes
        WT-2537 Cannot open DB written by WT2.6.1 with WT2.8.0 due to WT_NOTFOUND on recovery
        WT-2539 Implement file streaming above pluggable filesystems
        WT-2540 Separate stream and file handle methods
        WT-2541 Add statistics for number of threads currently in read/write
        WT-2542 Fixed-length column store reconciliation overwrites original values
        WT-2544 Fix eviction statistics when clear is configured
        WT-2546 Eviction server not help evict pages sometimes
        WT-2547 Add 1-eviction-worker jobs to Jenkins
        WT-2548 Cap the amount of data handed to raw compression.
        WT-2549 joins using recno keys return no values
        WT-2550 java ex_schema example fails
        WT-2552 Public API for pluggable filesystems
        WT-2553 Document in-memory configuration and WT_CACHE_FULL error return
        WT-2554 Implement a framework for adding C test cases
        WT-2556 Typo in the Java example code
        WT-2557 format test program should discard log files after incremental backup
        WT-2558 WT_PAGE structure reorganization
        WT-2559 Windows segfault in logging code
        WT-2560 Stuck trying to update oldest transaction ID
        WT-2562 Reconfig02 test failing sometimes on PPC
        WT-2565 Item 3573 on page at [write-check] is a corrupted cell
        WT-2566 All lock operations should be barriers
        WT-2567 Segfault in test/format log truncate
        WT-2568 Java PackTest.java compilation error
        WT-2569 Win_handle_read should always call GetLastError on error
        WT-2570 Minor lint cleanups.
        WT-2571 Join code cleanup
        WT-2572 Don't select an in-memory format run if incompatible options configured
        WT-2573 Free of stack-allocated WT_REF
        WT-2574 Format doesn't free all allocated configure memory
        WT-2576 Variable-length column-store out-of-order return
        WT-2577 Core dump discarding non-existent addresses
        WT-2579 In-memory configurations break debugging support
        WT-2580 Potential SWIG naming conflict in Java
        WT-2581 Assert multi->disk_image == NULL
        WT-2582 Cache eviction server error: WT_RESTART
        WT-2583 Incremental backup can prevent future recovery
        WT-2584 Don't use periods in error messages
        WT-2586 Remove ex_config.c until config cursors are supported
        WT-2589 Check stats using WT_STAT_SET and 'clear' usage
        WT-2592 Joins using non-recno key types not working
        WT-2593 Disk full with pre-allocated log files
        WT-2595 Fix compiler warning in packing tests
        WT-2597 JSON dump needs LSM tests
        WT-2598 In-memory FS needs fast lookup on file names
        WT-2599 Split out the checksum code from the support directory
        WT-2600 Clean up test program #includes
        WT-2602 LSM stress hangs with very large uncompressed pages
        WT-2605 C tests focused on different schema types needed for join and other APIs
        WT-2609 Incorrect "skips API_END call" error.
        WT-2610 Investigate eviction hazard pointer check
        WT-2611 wtperf and/or WT_CONFIG_PARSER do not allow escaped double quotes
        WT-2612 The dist/s_prototypes script is creating a debugging file xxx.
        WT-2613 Windows build failing with a C4100 error
        WT-2615 Enabling checkpoints in test/format leads to reduced concurrency
        WT-2616 In-memory deadlock getting size
        WT-2617 Bug in pluggable file system example
        WT-2621 WiredTiger fails to compile on MSVC 2013
        WT-2622 Unit test failed in test_cursor_random.test_cursor_random.test_cursor_random_multiple_page_records
        WT-2624 snprintf unsupported on MSVC 2013
        WT-2626 snprintf errors with macro redefinition on MSVC2015
        WT-2627 Coverity complaints
        WT-2628 Reconciliation can return without unlocking the page lock
        WT-2629 Introduction of ppc64le crc32c assembly file has made the stack executable
        WT-2630 Rename WT_FSTREAM methods to avoid using C99 reserved names
        WT-2632 Test format failures due to "checkpoints cannot be dropped when in-use"
        WT-2637 The file-extension documentation doesn't cover not-supported cases
        WT-2644 'wt load -r' (rename) fails with LSM
        WT-2646 Split the lock_wait flag into two, adding a checkpoint_wait flag
        WT-2651 Coverity 1355591 resource leak
        WT-2652 Logging code improvements
        WT-2653 The custom file-system example should show device configuration
        WT-2656 Builds failing on GCC 4.7 builder
        WT-2658 Only include PPC-specific files in PPC builds
        WT-2659 csuite tests, assorted lint and cleanup.
        WT-2660 Hang between eviction and connection close
        WT-2661 Coverity failures: 1356050-1356053
        WT-2662 For internal spell checking, strip out double quote literals, they confuse aspell
        WT-2664 Change eviction so any eviction thread can find candidates
        WT-2667 Enhance WiredTiger Evergreen testing
        WT-2668 Create join statistics that are useful and are easy to understand
        WT-2671 Dump more information about the file layout in verify debug mode
        WT-2672 Handle system calls that don't set errno
        WT-2673 Stop automatically increasing memory page max
        WT-2674 Simplify metadata file check
        WT-2676 Don't use key size in column store in-memory splits.
        WT-2677 Fix JSON output so only printable ASCII is produced (seen on Solaris)
        WT-2682 Add option to configure WiredTiger with strict compiler flags
        WT-2683 WiredTiger no longer needs to return non-zero disk sizes
        WT-2685 Hazard pointer failure from clear walk
        WT-2686 Logging subsystem core dump
        WT-2687 Test suite should verify the exit status of the wt utility
        WT-2689 Use after free in WT_SESSION::open_cursor
        WT-2691 Use wrappers for ctype functions to avoid sign extension errors
        WT-2692 Fix race in file system example
        WT-2696 Race condition on unclean shutdown may miss log records with large updates
        WT-2698 Test/recovery hung
        WT-2702 Under high thread load, WiredTiger exceeds cache size
        WT-2704 Test/format hung on bengal
        WT-2706 Race condition on log file switch can cause missing log records
        WT-2707 dist/s_label enhancements, and error jump cleanups
        WT-2709 Connection reconfigure segfault in __wt_conn_cache_pool_destroy
        WT-2710 WT_FILE_HANDLE_INMEM no longer needs an off field
        WT-2712 Coverity 1356928 and 1356929: ASSERT_SIDE_EFFECT
        WT-2713 Document WT_PANIC so pluggable filesystems can panic.
        WT-2714 Lint
        WT-2715 random-abort test may write partial record at the end
        WT-2720 Pull request tester not running Python suite
        WT-2722 s_label or s_label_loop false positive
        WT-2724 Eviction workers created on open exit immediately
        WT-2763 Unit test test_intpack failing on OSX
        Branch: v3.2
        https://github.com/mongodb/mongo/commit/385faa6ca72ad599d92d3948f1a2033d908e0226

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'name': u'Ramon Fernandez', u'email': u'ramon@mongodb.com'} Message: Import wiredtiger-wiredtiger-2.8.0-592-g848e5f5.tar.gz from wiredtiger branch mongodb-3.2 ref: 8b7110b..848e5f5 for: 3.2.9 This commit replaces a number of previous backports with the original change, so some of the tickets listed below may have been resolved in previous versions already as a backport to the v3.2 branch. For example, SERVER-24580 includes change a63e21b8 as a cherry-pick of 1f4aaa44, but this commit replaces that change with 1f4aaa44 itself. SERVER-23659 Provide useful message when wiredTigerJournalCompressor is changed SERVER-23661 $sample takes disproportionately long time on newly created collection SERVER-24306 40-second journaling stall from "log files prepared" to checkpoint SERVER-24580 Improve performance when WiredTiger cache is full WT-2103 Add incremental backup testing to format WT-2223 Add stress testing for in-memory WT-2268 JSON load incorrect with UNICODE input WT-2319 Add statistics around fsync calls WT-2325 Fix an incomplete comment WT-2343 Assert we don't remove or rename when backup cursor is open WT-2349 Add ability to open databases read-only WT-2359 WiredTiger with Python will hang if a calloc failure occurs during __wt_connection_close WT-2360 Allow disjunctions and combinations of operations in join cursors WT-2408 Windows error translation layer WT-2446 Estimate WT cache hit ratio WT-2450 Salvage releases pages, then explicitly evicts them. WT-2453 Throughput drop in wtperf evict Jenkins tests WT-2479 Dump utility discards table config (JSON) WT-2491 The dhandle close_lock isn't valuable at the moment WT-2504 Should READONLY always read basecfg file? WT-2505 Review clang analyzer warnings WT-2508 Test programs should remove test directories on the "clean" target WT-2514 Log path name is an empty string. WT-2518 LSM checkpoint handle acquisition optimization WT-2520 WT_SESSION::verify should not alter tables WT-2526 Mixing and matching readonly and read/write handles WT-2535 Extend test/format to test for transactions reading their writes WT-2537 Cannot open DB written by WT2.6.1 with WT2.8.0 due to WT_NOTFOUND on recovery WT-2539 Implement file streaming above pluggable filesystems WT-2540 Separate stream and file handle methods WT-2541 Add statistics for number of threads currently in read/write WT-2542 Fixed-length column store reconciliation overwrites original values WT-2544 Fix eviction statistics when clear is configured WT-2546 Eviction server not help evict pages sometimes WT-2547 Add 1-eviction-worker jobs to Jenkins WT-2548 Cap the amount of data handed to raw compression. WT-2549 joins using recno keys return no values WT-2550 java ex_schema example fails WT-2552 Public API for pluggable filesystems WT-2553 Document in-memory configuration and WT_CACHE_FULL error return WT-2554 Implement a framework for adding C test cases WT-2556 Typo in the Java example code WT-2557 format test program should discard log files after incremental backup WT-2558 WT_PAGE structure reorganization WT-2559 Windows segfault in logging code WT-2560 Stuck trying to update oldest transaction ID WT-2562 Reconfig02 test failing sometimes on PPC WT-2565 Item 3573 on page at [write-check] is a corrupted cell WT-2566 All lock operations should be barriers WT-2567 Segfault in test/format log truncate WT-2568 Java PackTest.java compilation error WT-2569 Win_handle_read should always call GetLastError on error WT-2570 Minor lint cleanups. WT-2571 Join code cleanup WT-2572 Don't select an in-memory format run if incompatible options configured WT-2573 Free of stack-allocated WT_REF WT-2574 Format doesn't free all allocated configure memory WT-2576 Variable-length column-store out-of-order return WT-2577 Core dump discarding non-existent addresses WT-2579 In-memory configurations break debugging support WT-2580 Potential SWIG naming conflict in Java WT-2581 Assert multi->disk_image == NULL WT-2582 Cache eviction server error: WT_RESTART WT-2583 Incremental backup can prevent future recovery WT-2584 Don't use periods in error messages WT-2586 Remove ex_config.c until config cursors are supported WT-2589 Check stats using WT_STAT_SET and 'clear' usage WT-2592 Joins using non-recno key types not working WT-2593 Disk full with pre-allocated log files WT-2595 Fix compiler warning in packing tests WT-2597 JSON dump needs LSM tests WT-2598 In-memory FS needs fast lookup on file names WT-2599 Split out the checksum code from the support directory WT-2600 Clean up test program #includes WT-2602 LSM stress hangs with very large uncompressed pages WT-2605 C tests focused on different schema types needed for join and other APIs WT-2609 Incorrect "skips API_END call" error. WT-2610 Investigate eviction hazard pointer check WT-2611 wtperf and/or WT_CONFIG_PARSER do not allow escaped double quotes WT-2612 The dist/s_prototypes script is creating a debugging file xxx. WT-2613 Windows build failing with a C4100 error WT-2615 Enabling checkpoints in test/format leads to reduced concurrency WT-2616 In-memory deadlock getting size WT-2617 Bug in pluggable file system example WT-2621 WiredTiger fails to compile on MSVC 2013 WT-2622 Unit test failed in test_cursor_random.test_cursor_random.test_cursor_random_multiple_page_records WT-2624 snprintf unsupported on MSVC 2013 WT-2626 snprintf errors with macro redefinition on MSVC2015 WT-2627 Coverity complaints WT-2628 Reconciliation can return without unlocking the page lock WT-2629 Introduction of ppc64le crc32c assembly file has made the stack executable WT-2630 Rename WT_FSTREAM methods to avoid using C99 reserved names WT-2632 Test format failures due to "checkpoints cannot be dropped when in-use" WT-2637 The file-extension documentation doesn't cover not-supported cases WT-2644 'wt load -r' (rename) fails with LSM WT-2646 Split the lock_wait flag into two, adding a checkpoint_wait flag WT-2651 Coverity 1355591 resource leak WT-2652 Logging code improvements WT-2653 The custom file-system example should show device configuration WT-2656 Builds failing on GCC 4.7 builder WT-2658 Only include PPC-specific files in PPC builds WT-2659 csuite tests, assorted lint and cleanup. WT-2660 Hang between eviction and connection close WT-2661 Coverity failures: 1356050-1356053 WT-2662 For internal spell checking, strip out double quote literals, they confuse aspell WT-2664 Change eviction so any eviction thread can find candidates WT-2667 Enhance WiredTiger Evergreen testing WT-2668 Create join statistics that are useful and are easy to understand WT-2671 Dump more information about the file layout in verify debug mode WT-2672 Handle system calls that don't set errno WT-2673 Stop automatically increasing memory page max WT-2674 Simplify metadata file check WT-2676 Don't use key size in column store in-memory splits. WT-2677 Fix JSON output so only printable ASCII is produced (seen on Solaris) WT-2682 Add option to configure WiredTiger with strict compiler flags WT-2683 WiredTiger no longer needs to return non-zero disk sizes WT-2685 Hazard pointer failure from clear walk WT-2686 Logging subsystem core dump WT-2687 Test suite should verify the exit status of the wt utility WT-2689 Use after free in WT_SESSION::open_cursor WT-2691 Use wrappers for ctype functions to avoid sign extension errors WT-2692 Fix race in file system example WT-2696 Race condition on unclean shutdown may miss log records with large updates WT-2698 Test/recovery hung WT-2702 Under high thread load, WiredTiger exceeds cache size WT-2704 Test/format hung on bengal WT-2706 Race condition on log file switch can cause missing log records WT-2707 dist/s_label enhancements, and error jump cleanups WT-2709 Connection reconfigure segfault in __wt_conn_cache_pool_destroy WT-2710 WT_FILE_HANDLE_INMEM no longer needs an off field WT-2712 Coverity 1356928 and 1356929: ASSERT_SIDE_EFFECT WT-2713 Document WT_PANIC so pluggable filesystems can panic. WT-2714 Lint WT-2715 random-abort test may write partial record at the end WT-2720 Pull request tester not running Python suite WT-2722 s_label or s_label_loop false positive WT-2724 Eviction workers created on open exit immediately WT-2763 Unit test test_intpack failing on OSX Branch: v3.2 https://github.com/mongodb/mongo/commit/385faa6ca72ad599d92d3948f1a2033d908e0226
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'}

        Message: WT-2763 Change test ID's in test_intpack to fix OSX test errors (#2872)

        OS X does case insensitive naming, which causes problems for parallel test suite. Update int packing tests to have unique names, and enforce case in-sensitive uniqueness in check_scenarios.
        Branch: mongodb-3.4
        https://github.com/wiredtiger/wiredtiger/commit/2c5343e7b9c81167fc0b8e3e14b2395d55afa5a8

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'} Message: WT-2763 Change test ID's in test_intpack to fix OSX test errors (#2872) OS X does case insensitive naming, which causes problems for parallel test suite. Update int packing tests to have unique names, and enforce case in-sensitive uniqueness in check_scenarios. Branch: mongodb-3.4 https://github.com/wiredtiger/wiredtiger/commit/2c5343e7b9c81167fc0b8e3e14b2395d55afa5a8
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

        Message: Import wiredtiger-wiredtiger-2.8.0-589-ga9e9696.tar.gz from wiredtiger branch mongodb-3.4

        ref: d8fb874..a9e9696
        for: 3.3.11

        SERVER-24971 Excessive memory held by sessions when application threads do evictions
        WT-1162 Add latency to Jenkins wtperf tests and plots
        WT-2026 Maximum pages size at eviction too large
        WT-2239 Make sure LSM cursors read up to date dsk_gen, it was racing with compact
        WT-2353 Failure to create async threads as part of a wiredtiger_open call will cause a hang
        WT-2380 Make scripts fail if code doesn't match style
        WT-2486 Update make check so that it runs faster
        WT-2578 remove write barriers from the TAILQ_INSERT_XXX macros
        WT-2648 cache-line alignment for new ports
        WT-2665 Limit allocator fragmentation in WiredTiger
        WT-2693 Check open_cursor error paths for consistent handling
        WT-2708 split child-update race with reconciliation/eviction
        WT-2711 Change statistics log configuration options
        WT-2728 Don't re-read log file headers during log_flush
        WT-2729 Focus eviction walks in largest trees
        WT-2730 cursor next/prev can return the wrong key/value pair when crossing a page boundary
        WT-2731 Raw compression can create pages that are larger than expected
        WT-2732 Coverity analysis defect 99665: Redundant test
        WT-2737 Scrub dirty pages rather than evicting them
        WT-2738 Remove the ability to change the default checkpoint name
        WT-2739 pluggable file systems documentation cleanups
        WT-2743 Thread count statistics always report 0
        WT-2744 partial line even with line buffering set
        WT-2746 track checkpoint I/O separately from eviction I/O
        WT-2751 column-store statistics incorrectly calculates the number of entries
        WT-2752 Fixes to zipfian wtperf workload config
        WT-2755 flexelint configuration treats size_t as 4B type
        WT-2756 Upgrade the autoconf archive package to check for swig 3.0
        WT-2757 Column tables behave differently when column names are provided
        WT-2759 Releasing the hot-backup lock doesn't require the schema lock.
        WT-2760 Fix a bug in backup related to directory sync. Change the filesystem API to make durable the default
        WT-2762 wtstats tool fails if checkpoint runs
        WT-2763 Unit test test_intpack failing on OSX
        WT-2764 Optimize checkpoints to reduce throughput disruption
        WT-2765 wt dump: indices need to be shown in the dump output
        WT-2767 test suite needs way to run an individual scenario
        WT-2769 Update documentation to reflect correct limits of memory_page_max
        WT-2770 Add statistics tracking schema operations
        WT-2772 Investigate log performance testing weirdness
        WT-2773 search_near in indexes does not find exact matches
        WT-2774 minor cleanups/improvements
        WT-2778 Python test suite: make scenario initialization consistent
        WT-2779 Raw compression created unexpectedly large pages on disk
        WT-2781 Enhance bulk cursor option with an option to return immediately on contention
        WT-2782 Missing a fs_directory_list_free in ex_file_system.c
        WT-2785 Scrub dirty pages rather than evicting them: single-page reconciliation
        WT-2791 Enhance OS X Evergreen unit test
        WT-2793 wtperf config improvements
        WT-2796 Memory leak in reconciliation uncovered by stress testing
        WT-2798 Crash vulnerability with nojournal after create during checkpoint
        WT-2800 Illegal file format in test/format on PPC
        WT-2801 Crash vulnerability from eviction of metadata during checkpoint
        WT-2802 Transaction commit causes heap-use-after free
        WT-2803 Add verbose functionality to WT Evergreen tests
        WT-2804 Don't read values in a tree without a snapshot
        WT-2805 Infinite recursion if error streams fail
        WT-2806 wtperf allocation size off-by-one
        Branch: master
        https://github.com/mongodb/mongo/commit/c4612847ed88c5e0500f0e9ecb2ecdcb49621cf1

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger-wiredtiger-2.8.0-589-ga9e9696.tar.gz from wiredtiger branch mongodb-3.4 ref: d8fb874..a9e9696 for: 3.3.11 SERVER-24971 Excessive memory held by sessions when application threads do evictions WT-1162 Add latency to Jenkins wtperf tests and plots WT-2026 Maximum pages size at eviction too large WT-2239 Make sure LSM cursors read up to date dsk_gen, it was racing with compact WT-2353 Failure to create async threads as part of a wiredtiger_open call will cause a hang WT-2380 Make scripts fail if code doesn't match style WT-2486 Update make check so that it runs faster WT-2578 remove write barriers from the TAILQ_INSERT_XXX macros WT-2648 cache-line alignment for new ports WT-2665 Limit allocator fragmentation in WiredTiger WT-2693 Check open_cursor error paths for consistent handling WT-2708 split child-update race with reconciliation/eviction WT-2711 Change statistics log configuration options WT-2728 Don't re-read log file headers during log_flush WT-2729 Focus eviction walks in largest trees WT-2730 cursor next/prev can return the wrong key/value pair when crossing a page boundary WT-2731 Raw compression can create pages that are larger than expected WT-2732 Coverity analysis defect 99665: Redundant test WT-2737 Scrub dirty pages rather than evicting them WT-2738 Remove the ability to change the default checkpoint name WT-2739 pluggable file systems documentation cleanups WT-2743 Thread count statistics always report 0 WT-2744 partial line even with line buffering set WT-2746 track checkpoint I/O separately from eviction I/O WT-2751 column-store statistics incorrectly calculates the number of entries WT-2752 Fixes to zipfian wtperf workload config WT-2755 flexelint configuration treats size_t as 4B type WT-2756 Upgrade the autoconf archive package to check for swig 3.0 WT-2757 Column tables behave differently when column names are provided WT-2759 Releasing the hot-backup lock doesn't require the schema lock. WT-2760 Fix a bug in backup related to directory sync. Change the filesystem API to make durable the default WT-2762 wtstats tool fails if checkpoint runs WT-2763 Unit test test_intpack failing on OSX WT-2764 Optimize checkpoints to reduce throughput disruption WT-2765 wt dump: indices need to be shown in the dump output WT-2767 test suite needs way to run an individual scenario WT-2769 Update documentation to reflect correct limits of memory_page_max WT-2770 Add statistics tracking schema operations WT-2772 Investigate log performance testing weirdness WT-2773 search_near in indexes does not find exact matches WT-2774 minor cleanups/improvements WT-2778 Python test suite: make scenario initialization consistent WT-2779 Raw compression created unexpectedly large pages on disk WT-2781 Enhance bulk cursor option with an option to return immediately on contention WT-2782 Missing a fs_directory_list_free in ex_file_system.c WT-2785 Scrub dirty pages rather than evicting them: single-page reconciliation WT-2791 Enhance OS X Evergreen unit test WT-2793 wtperf config improvements WT-2796 Memory leak in reconciliation uncovered by stress testing WT-2798 Crash vulnerability with nojournal after create during checkpoint WT-2800 Illegal file format in test/format on PPC WT-2801 Crash vulnerability from eviction of metadata during checkpoint WT-2802 Transaction commit causes heap-use-after free WT-2803 Add verbose functionality to WT Evergreen tests WT-2804 Don't read values in a tree without a snapshot WT-2805 Infinite recursion if error streams fail WT-2806 wtperf allocation size off-by-one Branch: master https://github.com/mongodb/mongo/commit/c4612847ed88c5e0500f0e9ecb2ecdcb49621cf1
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'}

        Message: WT-2763 Change test ID's in test_intpack to fix OSX test errors (#2872)

        OS X does case insensitive naming, which causes problems for parallel test suite. Update int packing tests to have unique names, and enforce case in-sensitive uniqueness in check_scenarios.
        Branch: mongodb-3.2
        https://github.com/wiredtiger/wiredtiger/commit/2c5343e7b9c81167fc0b8e3e14b2395d55afa5a8

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'} Message: WT-2763 Change test ID's in test_intpack to fix OSX test errors (#2872) OS X does case insensitive naming, which causes problems for parallel test suite. Update int packing tests to have unique names, and enforce case in-sensitive uniqueness in check_scenarios. Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/2c5343e7b9c81167fc0b8e3e14b2395d55afa5a8
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

        Message: Import wiredtiger: 911c940adab547d36ac305fc627a79e637fa3c40 from branch mongodb-3.2

        ref: dddca65..911c940ada
        for: 3.2.10

        SERVER-24971 Excessive memory held by sessions when application threads do evictions
        SERVER-25843 Coverity analysis defect 99856: Redundant test
        SERVER-25845 Coverity analysis defect 99859: Explicit null dereferenced
        SERVER-25846 Coverity analysis defect 99861: Dereference after null check
        WT-1162 Add latency to Jenkins wtperf tests and plots
        WT-2026 Maximum pages size at eviction too large
        WT-2221 Document which statistics are available via a "fast" configuration vs. an "all" configuration
        WT-2233 Investigate changing when the eviction server switches to aggressive mode.
        WT-2239 Make sure LSM cursors read up to date dsk_gen, it was racing with compact
        WT-2323 Allocate a transaction id at the beginning of join cursor iteration
        WT-2353 Failure to create async threads as part of a wiredtiger_open call will cause a hang
        WT-2380 Make scripts fail if code doesn't match style
        WT-2486 Update make check so that it runs faster
        WT-2555 make format run on Windows
        WT-2578 remove write barriers from the TAILQ_INSERT_XXX macros
        WT-2631 nullptr is passed for parameters marked with attribute non-null
        WT-2638 ftruncate may not be supported
        WT-2645 wt dump: push the complexity of collecting metadata into a dump cursor
        WT-2648 cache-line alignment for new ports
        WT-2665 Limit allocator fragmentation in WiredTiger
        WT-2678 The metadata should not imply that an empty value is true
        WT-2688 configure --enable-python doesn't check for availability of swig
        WT-2693 Check open_cursor error paths for consistent handling
        WT-2695 Integrate s390x accelerated crc32c support
        WT-2708 split child-update race with reconciliation/eviction
        WT-2711 Change statistics log configuration options
        WT-2719 add fuzz testing for WiredTiger options and reconfiguration.
        WT-2728 Don't re-read log file headers during log_flush
        WT-2729 Focus eviction walks in largest trees
        WT-2730 cursor next/prev can return the wrong key/value pair when crossing a page boundary
        WT-2731 Raw compression can create pages that are larger than expected
        WT-2732 Coverity analysis defect 99665: Redundant test
        WT-2734 Improve documentation of eviction behavior
        WT-2737 Scrub dirty pages rather than evicting them
        WT-2738 Remove the ability to change the default checkpoint name
        WT-2739 pluggable file systems documentation cleanups
        WT-2743 Thread count statistics always report 0
        WT-2744 partial line even with line buffering set
        WT-2746 track checkpoint I/O separately from eviction I/O
        WT-2751 column-store statistics incorrectly calculates the number of entries
        WT-2752 Fixes to zipfian wtperf workload config
        WT-2755 flexelint configuration treats size_t as 4B type
        WT-2756 Upgrade the autoconf archive package to check for swig 3.0
        WT-2757 Column tables behave differently when column names are provided
        WT-2759 Releasing the hot-backup lock doesn't require the schema lock.
        WT-2760 Fix a bug in backup related to directory sync. Change the filesystem API to make durable the default
        WT-2762 wtstats tool fails if checkpoint runs
        WT-2763 Unit test test_intpack failing on OSX
        WT-2764 Optimize checkpoints to reduce throughput disruption
        WT-2765 wt dump: indices need to be shown in the dump output
        WT-2766 Don't count eviction of lookaside file pages for the purpose of checking stuck cache
        WT-2767 test suite needs way to run an individual scenario
        WT-2769 Update documentation to reflect correct limits of memory_page_max
        WT-2770 Add statistics tracking schema operations
        WT-2772 Investigate log performance testing weirdness
        WT-2773 search_near in indexes does not find exact matches
        WT-2774 minor cleanups/improvements
        WT-2778 Python test suite: make scenario initialization consistent
        WT-2779 Raw compression created unexpectedly large pages on disk
        WT-2781 Enhance bulk cursor option with an option to return immediately on contention
        WT-2782 Missing a fs_directory_list_free in ex_file_system.c
        WT-2783 wtperf multi-btree.wtperf dumps core on Mac
        WT-2785 Scrub dirty pages rather than evicting them: single-page reconciliation
        WT-2787 Include src/include/wiredtiger_ext.h is problematic
        WT-2788 Java: freed memory overwrite during handle close can cause JNI crash
        WT-2791 Enhance OS X Evergreen unit test
        WT-2793 wtperf config improvements
        WT-2795 Update documentation around read-only configuration
        WT-2796 Memory leak in reconciliation uncovered by stress testing
        WT-2798 Crash vulnerability with nojournal after create during checkpoint
        WT-2800 Illegal file format in test/format on PPC
        WT-2801 Crash vulnerability from eviction of metadata during checkpoint
        WT-2802 Transaction commit causes heap-use-after free
        WT-2803 Add verbose functionality to WT Evergreen tests
        WT-2804 Don't read values in a tree without a snapshot
        WT-2805 Infinite recursion if error streams fail
        WT-2806 wtperf allocation size off-by-one
        WT-2807 Switch Jenkins performance tests to tcmalloc
        WT-2811 Reconciliation asserts that transaction time has gone backwards
        WT-2812 Error when reconfiguring cache targets
        WT-2813 small cache usage stuck even with large cache
        WT-2814 Enhance wtperf to support single-op truncate mode
        WT-2816 Improve WiredTiger eviction performance
        WT-2817 Investigate performance regression in develop, add workload to wtperf/runners
        WT-2818 The page visibility check when queuing pages for eviction is overly restrictive
        WT-2820 add gcc warn_unused_result attribute
        WT-2822 panic mutex and other functions that cannot fail
        WT-2823 support file handles without a truncate method
        WT-2824 wtperf displays connection and table create configurations twice
        WT-2826 clang38 false positive on uninitialized variable.
        WT-2827 checkpoint log_size configuration improvements
        WT-2828 Make long wtperf tests reflect mongoDB usage
        WT-2829 Switch automated testing to use enable-strict configure option
        WT-2832 Python test uses hard-coded temporary directory
        WT-2834 Join cursor: discrepancy with bloom filters
        WT-2835 WT_CONNECTION.leak-memory can skip memory map and cache cleanup
        WT-2838 Don't free session handles on close if leak memory is configured
        WT-2839 lint: Ignoring return value of function
        WT-2840 clang analysis: garbage values
        WT-2841 Jenkins Valgrind runner is reporting errors in test wt2719_reconfig
        WT-2842 split wtperf's configuration into per-database and per-run parts
        WT-2843 Fix a bug in recovery if there is no filesystem truncate support
        WT-2846 Several bugs related to reconfiguring eviction server at runtime
        WT-2847 Merge fair locks into read/write locks.
        WT-2850 clang 4.1 attribute warnings when building
        WT-2853 Multi threaded reader writer example shows temporary slowdown or lockup
        WT-2857 POSIX ftruncate calls should be #ifdef'd HAVE_FTRUNCATE
        WT-2862 Fix lint error in test case for forced eviction with multiple cursors
        WT-2863 Support UTF-8 paths on Windows
        WT-2865 eviction thread error failure
        WT-2866 Eviction server algorithm tuning
        WT-2867 Review and fix barrier usage in __lsm_tree_close
        WT-2868 Add sample_interval to checkpoint-stress wtperf config
        WT-2869 Performance regression on secondaries
        WT-2870 Rename wtperf checkpoint schema jobs
        WT-2871 __wt_verbose has the wrong GCC format attributes
        WT-2872 Recent stuck cache test/stress failures.
        WT-2873 Refactor CRC32 code
        WT-2875 Test test_wt2853_perf can run too long under valgrind
        WT-2876 Extend wtperf to support a log like table
        WT-2878 Verbose changes affected performance
        WT-2881 Add -Wpedantic to clang compiler warning flags
        WT-2883 wiredtiger_open with verbose=handleops recursive loop
        WT-2885 __wt_checkpoint_signal lint
        WT-2886 Decide how in-memory configuration and eviction_dirty_target interact
        WT-2888 Switch functions to return void where possible
        WT-2892 hot backup can race with block truncate
        WT-2896 Coverity #1362535: resource leak
        WT-2897 Checkpoints can become corrupted on failure
        WT-2901 Add option to disable checkpoint dirty stepdown phase
        WT-2903 Reduce the impact of checkpoint scrubbing on applications
        Branch: v3.2
        https://github.com/mongodb/mongo/commit/7d2acd6395ec84beca34718a75371bc11f0c9f60

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: 911c940adab547d36ac305fc627a79e637fa3c40 from branch mongodb-3.2 ref: dddca65..911c940ada for: 3.2.10 SERVER-24971 Excessive memory held by sessions when application threads do evictions SERVER-25843 Coverity analysis defect 99856: Redundant test SERVER-25845 Coverity analysis defect 99859: Explicit null dereferenced SERVER-25846 Coverity analysis defect 99861: Dereference after null check WT-1162 Add latency to Jenkins wtperf tests and plots WT-2026 Maximum pages size at eviction too large WT-2221 Document which statistics are available via a "fast" configuration vs. an "all" configuration WT-2233 Investigate changing when the eviction server switches to aggressive mode. WT-2239 Make sure LSM cursors read up to date dsk_gen, it was racing with compact WT-2323 Allocate a transaction id at the beginning of join cursor iteration WT-2353 Failure to create async threads as part of a wiredtiger_open call will cause a hang WT-2380 Make scripts fail if code doesn't match style WT-2486 Update make check so that it runs faster WT-2555 make format run on Windows WT-2578 remove write barriers from the TAILQ_INSERT_XXX macros WT-2631 nullptr is passed for parameters marked with attribute non-null WT-2638 ftruncate may not be supported WT-2645 wt dump: push the complexity of collecting metadata into a dump cursor WT-2648 cache-line alignment for new ports WT-2665 Limit allocator fragmentation in WiredTiger WT-2678 The metadata should not imply that an empty value is true WT-2688 configure --enable-python doesn't check for availability of swig WT-2693 Check open_cursor error paths for consistent handling WT-2695 Integrate s390x accelerated crc32c support WT-2708 split child-update race with reconciliation/eviction WT-2711 Change statistics log configuration options WT-2719 add fuzz testing for WiredTiger options and reconfiguration. WT-2728 Don't re-read log file headers during log_flush WT-2729 Focus eviction walks in largest trees WT-2730 cursor next/prev can return the wrong key/value pair when crossing a page boundary WT-2731 Raw compression can create pages that are larger than expected WT-2732 Coverity analysis defect 99665: Redundant test WT-2734 Improve documentation of eviction behavior WT-2737 Scrub dirty pages rather than evicting them WT-2738 Remove the ability to change the default checkpoint name WT-2739 pluggable file systems documentation cleanups WT-2743 Thread count statistics always report 0 WT-2744 partial line even with line buffering set WT-2746 track checkpoint I/O separately from eviction I/O WT-2751 column-store statistics incorrectly calculates the number of entries WT-2752 Fixes to zipfian wtperf workload config WT-2755 flexelint configuration treats size_t as 4B type WT-2756 Upgrade the autoconf archive package to check for swig 3.0 WT-2757 Column tables behave differently when column names are provided WT-2759 Releasing the hot-backup lock doesn't require the schema lock. WT-2760 Fix a bug in backup related to directory sync. Change the filesystem API to make durable the default WT-2762 wtstats tool fails if checkpoint runs WT-2763 Unit test test_intpack failing on OSX WT-2764 Optimize checkpoints to reduce throughput disruption WT-2765 wt dump: indices need to be shown in the dump output WT-2766 Don't count eviction of lookaside file pages for the purpose of checking stuck cache WT-2767 test suite needs way to run an individual scenario WT-2769 Update documentation to reflect correct limits of memory_page_max WT-2770 Add statistics tracking schema operations WT-2772 Investigate log performance testing weirdness WT-2773 search_near in indexes does not find exact matches WT-2774 minor cleanups/improvements WT-2778 Python test suite: make scenario initialization consistent WT-2779 Raw compression created unexpectedly large pages on disk WT-2781 Enhance bulk cursor option with an option to return immediately on contention WT-2782 Missing a fs_directory_list_free in ex_file_system.c WT-2783 wtperf multi-btree.wtperf dumps core on Mac WT-2785 Scrub dirty pages rather than evicting them: single-page reconciliation WT-2787 Include src/include/wiredtiger_ext.h is problematic WT-2788 Java: freed memory overwrite during handle close can cause JNI crash WT-2791 Enhance OS X Evergreen unit test WT-2793 wtperf config improvements WT-2795 Update documentation around read-only configuration WT-2796 Memory leak in reconciliation uncovered by stress testing WT-2798 Crash vulnerability with nojournal after create during checkpoint WT-2800 Illegal file format in test/format on PPC WT-2801 Crash vulnerability from eviction of metadata during checkpoint WT-2802 Transaction commit causes heap-use-after free WT-2803 Add verbose functionality to WT Evergreen tests WT-2804 Don't read values in a tree without a snapshot WT-2805 Infinite recursion if error streams fail WT-2806 wtperf allocation size off-by-one WT-2807 Switch Jenkins performance tests to tcmalloc WT-2811 Reconciliation asserts that transaction time has gone backwards WT-2812 Error when reconfiguring cache targets WT-2813 small cache usage stuck even with large cache WT-2814 Enhance wtperf to support single-op truncate mode WT-2816 Improve WiredTiger eviction performance WT-2817 Investigate performance regression in develop, add workload to wtperf/runners WT-2818 The page visibility check when queuing pages for eviction is overly restrictive WT-2820 add gcc warn_unused_result attribute WT-2822 panic mutex and other functions that cannot fail WT-2823 support file handles without a truncate method WT-2824 wtperf displays connection and table create configurations twice WT-2826 clang38 false positive on uninitialized variable. WT-2827 checkpoint log_size configuration improvements WT-2828 Make long wtperf tests reflect mongoDB usage WT-2829 Switch automated testing to use enable-strict configure option WT-2832 Python test uses hard-coded temporary directory WT-2834 Join cursor: discrepancy with bloom filters WT-2835 WT_CONNECTION.leak-memory can skip memory map and cache cleanup WT-2838 Don't free session handles on close if leak memory is configured WT-2839 lint: Ignoring return value of function WT-2840 clang analysis: garbage values WT-2841 Jenkins Valgrind runner is reporting errors in test wt2719_reconfig WT-2842 split wtperf's configuration into per-database and per-run parts WT-2843 Fix a bug in recovery if there is no filesystem truncate support WT-2846 Several bugs related to reconfiguring eviction server at runtime WT-2847 Merge fair locks into read/write locks. WT-2850 clang 4.1 attribute warnings when building WT-2853 Multi threaded reader writer example shows temporary slowdown or lockup WT-2857 POSIX ftruncate calls should be #ifdef'd HAVE_FTRUNCATE WT-2862 Fix lint error in test case for forced eviction with multiple cursors WT-2863 Support UTF-8 paths on Windows WT-2865 eviction thread error failure WT-2866 Eviction server algorithm tuning WT-2867 Review and fix barrier usage in __lsm_tree_close WT-2868 Add sample_interval to checkpoint-stress wtperf config WT-2869 Performance regression on secondaries WT-2870 Rename wtperf checkpoint schema jobs WT-2871 __wt_verbose has the wrong GCC format attributes WT-2872 Recent stuck cache test/stress failures. WT-2873 Refactor CRC32 code WT-2875 Test test_wt2853_perf can run too long under valgrind WT-2876 Extend wtperf to support a log like table WT-2878 Verbose changes affected performance WT-2881 Add -Wpedantic to clang compiler warning flags WT-2883 wiredtiger_open with verbose=handleops recursive loop WT-2885 __wt_checkpoint_signal lint WT-2886 Decide how in-memory configuration and eviction_dirty_target interact WT-2888 Switch functions to return void where possible WT-2892 hot backup can race with block truncate WT-2896 Coverity #1362535: resource leak WT-2897 Checkpoints can become corrupted on failure WT-2901 Add option to disable checkpoint dirty stepdown phase WT-2903 Reduce the impact of checkpoint scrubbing on applications Branch: v3.2 https://github.com/mongodb/mongo/commit/7d2acd6395ec84beca34718a75371bc11f0c9f60

          People

          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:
              Days since reply:
              27 weeks, 1 day ago
              Date of 1st Reply: