Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2872

Recent stuck cache test/stress failures.

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.9.0, 3.2.10, 3.3.14
    • Labels:
      None
    • # Replies:
      7
    • Last comment by Customer:
      true

      Description

      In the last day or two there have been a large number of failures of test/stress due to the cache being stuck. In all cases, only 5-6Mb is in use, but the cache is 27-33Mb in size. The failures are:
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-sanitizer/10775/console
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-sanitizer/10776/console
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-ppc/6382/console

        Issue Links

          Activity

          Hide
          sue.loverso Sue LoVerso added a comment -

          Here are the three CONFIGs.
          From 10775:

          ############################################
          #  RUN PARAMETERS
          ############################################
          abort=0
          auto_throttle=1
          backups=0
          bitcnt=7
          bloom=1
          bloom_bit_count=58
          bloom_hash_count=27
          bloom_oldest=0
          cache=32
          checkpoints=1
          checksum=on
          chunk_size=7
          compaction=0
          compression=lz4
          data_extend=1
          data_source=file
          delete_pct=11
          dictionary=0
          direct_io=0
          encryption=none
          evict_max=1
          file_type=variable-length column-store
          firstfit=0
          huffman_key=0
          huffman_value=0
          in_memory=0
          insert_pct=40
          internal_key_truncation=1
          internal_page_max=9
          isolation=snapshot
          key_gap=13
          key_max=70
          key_min=32
          leaf_page_max=17
          leak_memory=0
          logging=0
          logging_archive=1
          logging_compression=none
          logging_prealloc=0
          long_running_txn=0
          lsm_worker_threads=3
          merge_max=16
          mmap=1
          ops=100000
          prefix_compression=1
          prefix_compression_min=6
          quiet=1
          repeat_data_pct=47
          reverse=0
          rows=100000
          runs=1
          rebalance=1
          salvage=1
          split_pct=64
          statistics=1
          statistics_server=0
          threads=32
          timer=20
          transaction-frequency=58
          value_max=2733
          value_min=20
          verify=1
          wiredtiger_config=
          write_pct=52
          ############################################
          

          From 10776:

          ############################################
          #  RUN PARAMETERS
          ############################################
          abort=0
          auto_throttle=1
          backups=0
          bitcnt=2
          bloom=0
          bloom_bit_count=64
          bloom_hash_count=13
          bloom_oldest=0
          cache=27
          checkpoints=1
          checksum=uncompressed
          chunk_size=1
          compaction=0
          compression=zlib
          data_extend=0
          data_source=file
          delete_pct=14
          dictionary=0
          direct_io=0
          encryption=none
          evict_max=2
          file_type=variable-length column-store
          firstfit=0
          huffman_key=0
          huffman_value=0
          in_memory=0
          insert_pct=42
          internal_key_truncation=1
          internal_page_max=13
          isolation=snapshot
          key_gap=17
          key_max=37
          key_min=16
          leaf_page_max=17
          leak_memory=0
          logging=0
          logging_archive=0
          logging_compression=none
          logging_prealloc=1
          long_running_txn=0
          lsm_worker_threads=3
          merge_max=16
          mmap=1
          ops=100000
          prefix_compression=1
          prefix_compression_min=6
          quiet=1
          repeat_data_pct=62
          reverse=1
          rows=100000
          runs=1
          rebalance=1
          salvage=1
          split_pct=85
          statistics=0
          statistics_server=0
          threads=27
          timer=20
          transaction-frequency=46
          value_max=2213
          value_min=7
          verify=1
          wiredtiger_config=
          write_pct=40
          ############################################
          

          From 6382:

          ############################################
          #  RUN PARAMETERS
          ############################################
          abort=0
          auto_throttle=1
          backups=0
          bitcnt=5
          bloom=1
          bloom_bit_count=16
          bloom_hash_count=13
          bloom_oldest=0
          cache=33
          checkpoints=1
          checksum=uncompressed
          chunk_size=2
          compaction=0
          compression=zlib
          data_extend=0
          data_source=table
          delete_pct=33
          dictionary=0
          direct_io=0
          encryption=none
          evict_max=2
          file_type=row-store
          firstfit=0
          huffman_key=0
          huffman_value=0
          in_memory=0
          insert_pct=5
          internal_key_truncation=1
          internal_page_max=10
          isolation=snapshot
          key_gap=20
          key_max=23
          key_min=12
          leaf_page_max=17
          leak_memory=0
          logging=0
          logging_archive=1
          logging_compression=none
          logging_prealloc=1
          long_running_txn=0
          lsm_worker_threads=4
          merge_max=6
          mmap=1
          ops=100000
          prefix_compression=1
          prefix_compression_min=0
          quiet=1
          repeat_data_pct=3
          reverse=0
          rows=100000
          runs=100
          rebalance=1
          salvage=1
          split_pct=41
          statistics=0
          statistics_server=0
          threads=26
          timer=20
          transaction-frequency=96
          value_max=3086
          value_min=0
          verify=1
          wiredtiger_config=
          write_pct=33
          ############################################
          

          Show
          sue.loverso Sue LoVerso added a comment - Here are the three CONFIGs. From 10775: ############################################ # RUN PARAMETERS ############################################ abort=0 auto_throttle=1 backups=0 bitcnt=7 bloom=1 bloom_bit_count=58 bloom_hash_count=27 bloom_oldest=0 cache=32 checkpoints=1 checksum=on chunk_size=7 compaction=0 compression=lz4 data_extend=1 data_source=file delete_pct=11 dictionary=0 direct_io=0 encryption=none evict_max=1 file_type=variable-length column-store firstfit=0 huffman_key=0 huffman_value=0 in_memory=0 insert_pct=40 internal_key_truncation=1 internal_page_max=9 isolation=snapshot key_gap=13 key_max=70 key_min=32 leaf_page_max=17 leak_memory=0 logging=0 logging_archive=1 logging_compression=none logging_prealloc=0 long_running_txn=0 lsm_worker_threads=3 merge_max=16 mmap=1 ops=100000 prefix_compression=1 prefix_compression_min=6 quiet=1 repeat_data_pct=47 reverse=0 rows=100000 runs=1 rebalance=1 salvage=1 split_pct=64 statistics=1 statistics_server=0 threads=32 timer=20 transaction-frequency=58 value_max=2733 value_min=20 verify=1 wiredtiger_config= write_pct=52 ############################################ From 10776: ############################################ # RUN PARAMETERS ############################################ abort=0 auto_throttle=1 backups=0 bitcnt=2 bloom=0 bloom_bit_count=64 bloom_hash_count=13 bloom_oldest=0 cache=27 checkpoints=1 checksum=uncompressed chunk_size=1 compaction=0 compression=zlib data_extend=0 data_source=file delete_pct=14 dictionary=0 direct_io=0 encryption=none evict_max=2 file_type=variable-length column-store firstfit=0 huffman_key=0 huffman_value=0 in_memory=0 insert_pct=42 internal_key_truncation=1 internal_page_max=13 isolation=snapshot key_gap=17 key_max=37 key_min=16 leaf_page_max=17 leak_memory=0 logging=0 logging_archive=0 logging_compression=none logging_prealloc=1 long_running_txn=0 lsm_worker_threads=3 merge_max=16 mmap=1 ops=100000 prefix_compression=1 prefix_compression_min=6 quiet=1 repeat_data_pct=62 reverse=1 rows=100000 runs=1 rebalance=1 salvage=1 split_pct=85 statistics=0 statistics_server=0 threads=27 timer=20 transaction-frequency=46 value_max=2213 value_min=7 verify=1 wiredtiger_config= write_pct=40 ############################################ From 6382: ############################################ # RUN PARAMETERS ############################################ abort=0 auto_throttle=1 backups=0 bitcnt=5 bloom=1 bloom_bit_count=16 bloom_hash_count=13 bloom_oldest=0 cache=33 checkpoints=1 checksum=uncompressed chunk_size=2 compaction=0 compression=zlib data_extend=0 data_source=table delete_pct=33 dictionary=0 direct_io=0 encryption=none evict_max=2 file_type=row-store firstfit=0 huffman_key=0 huffman_value=0 in_memory=0 insert_pct=5 internal_key_truncation=1 internal_page_max=10 isolation=snapshot key_gap=20 key_max=23 key_min=12 leaf_page_max=17 leak_memory=0 logging=0 logging_archive=1 logging_compression=none logging_prealloc=1 long_running_txn=0 lsm_worker_threads=4 merge_max=6 mmap=1 ops=100000 prefix_compression=1 prefix_compression_min=0 quiet=1 repeat_data_pct=3 reverse=0 rows=100000 runs=100 rebalance=1 salvage=1 split_pct=41 statistics=0 statistics_server=0 threads=26 timer=20 transaction-frequency=96 value_max=3086 value_min=0 verify=1 wiredtiger_config= write_pct=33 ############################################
          Hide
          alexander.gorrod Alexander Gorrod added a comment -

          I just posted a version of this comment in WT-2866, but it is more useful here, so I'm duplicating it:

          I think the root cause for these failures is the new default for eviction_dirty_target, which means that there is a smaller upper bound on dirty pages. There is some (quite complex) logic in test/format to calculate a reasonable memory_page_max for the workload - I believe that needs to be adjusted to take into account the new default eviction_dirty_target.

          Show
          alexander.gorrod Alexander Gorrod added a comment - I just posted a version of this comment in WT-2866 , but it is more useful here, so I'm duplicating it: I think the root cause for these failures is the new default for eviction_dirty_target , which means that there is a smaller upper bound on dirty pages. There is some (quite complex) logic in test/format to calculate a reasonable memory_page_max for the workload - I believe that needs to be adjusted to take into account the new default eviction_dirty_target .
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2872 Ensure tests with tiny caches don't get stuck due to the dirty trigger. (#3017)
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/fa0b203b79d181e56fa73696ce744cbaf90a3c40

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2872 Ensure tests with tiny caches don't get stuck due to the dirty trigger. (#3017) Branch: develop https://github.com/wiredtiger/wiredtiger/commit/fa0b203b79d181e56fa73696ce744cbaf90a3c40
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2872 Ensure tests with tiny caches don't get stuck due to the dirty trigger. (#3017)
          Branch: mongodb-3.4
          https://github.com/wiredtiger/wiredtiger/commit/fa0b203b79d181e56fa73696ce744cbaf90a3c40

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2872 Ensure tests with tiny caches don't get stuck due to the dirty trigger. (#3017) Branch: mongodb-3.4 https://github.com/wiredtiger/wiredtiger/commit/fa0b203b79d181e56fa73696ce744cbaf90a3c40
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

          Message: Import wiredtiger: 569c70d13a7b3da0fe8eb1bac06a86865cb36a7c from branch mongodb-3.4

          ref: 7d3c0f9f50..569c70d13a
          for: 3.3.13

          SERVER-25843 Coverity analysis defect 99856: Redundant test
          SERVER-25845 Coverity analysis defect 99859: Explicit null dereferenced
          SERVER-25846 Coverity analysis defect 99861: Dereference after null check
          WT-2221 Document which statistics are available via a "fast" configuration vs. an "all" configuration
          WT-2233 Investigate changing when the eviction server switches to aggressive mode.
          WT-2323 Allocate a transaction id at the beginning of join cursor iteration
          WT-2555 make format run on Windows
          WT-2788 Java: freed memory overwrite during handle close can cause JNI crash
          WT-2816 Improve WiredTiger eviction performance
          WT-2824 wtperf displays connection and table create configurations twice
          WT-2842 split wtperf's configuration into per-database and per-run parts
          WT-2866 Eviction server algorithm tuning
          WT-2867 Review and fix barrier usage in __lsm_tree_close
          WT-2870 Rename wtperf checkpoint schema jobs
          WT-2871 __wt_verbose has the wrong GCC format attributes
          WT-2872 Recent stuck cache test/stress failures.
          WT-2873 Refactor CRC32 code
          WT-2875 Test test_wt2853_perf can run too long under valgrind
          WT-2876 Extend wtperf to support a log like table
          WT-2878 Verbose changes affected performance
          WT-2881 Add -Wpedantic to clang compiler warning flags
          WT-2882 Add CRC32 hardware scons detection, disable CRC hardware support on ARM for now
          WT-2883 wiredtiger_open with verbose=handleops recursive loop
          WT-2885 __wt_checkpoint_signal lint
          WT-2886 Decide how in-memory configuration and eviction_dirty_target interact
          WT-2888 Switch functions to return void where possible
          WT-2892 hot backup can race with block truncate
          WT-2896 Coverity #1362535: resource leak
          WT-2897 Checkpoints can become corrupted on failure
          WT-2901 Add option to disable checkpoint dirty stepdown phase
          Branch: master
          https://github.com/mongodb/mongo/commit/29b5a329c5c72fe87d1627bd99e682d9d5e2e34c

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: 569c70d13a7b3da0fe8eb1bac06a86865cb36a7c from branch mongodb-3.4 ref: 7d3c0f9f50..569c70d13a for: 3.3.13 SERVER-25843 Coverity analysis defect 99856: Redundant test SERVER-25845 Coverity analysis defect 99859: Explicit null dereferenced SERVER-25846 Coverity analysis defect 99861: Dereference after null check WT-2221 Document which statistics are available via a "fast" configuration vs. an "all" configuration WT-2233 Investigate changing when the eviction server switches to aggressive mode. WT-2323 Allocate a transaction id at the beginning of join cursor iteration WT-2555 make format run on Windows WT-2788 Java: freed memory overwrite during handle close can cause JNI crash WT-2816 Improve WiredTiger eviction performance WT-2824 wtperf displays connection and table create configurations twice WT-2842 split wtperf's configuration into per-database and per-run parts WT-2866 Eviction server algorithm tuning WT-2867 Review and fix barrier usage in __lsm_tree_close WT-2870 Rename wtperf checkpoint schema jobs WT-2871 __wt_verbose has the wrong GCC format attributes WT-2872 Recent stuck cache test/stress failures. WT-2873 Refactor CRC32 code WT-2875 Test test_wt2853_perf can run too long under valgrind WT-2876 Extend wtperf to support a log like table WT-2878 Verbose changes affected performance WT-2881 Add -Wpedantic to clang compiler warning flags WT-2882 Add CRC32 hardware scons detection, disable CRC hardware support on ARM for now WT-2883 wiredtiger_open with verbose=handleops recursive loop WT-2885 __wt_checkpoint_signal lint WT-2886 Decide how in-memory configuration and eviction_dirty_target interact WT-2888 Switch functions to return void where possible WT-2892 hot backup can race with block truncate WT-2896 Coverity #1362535: resource leak WT-2897 Checkpoints can become corrupted on failure WT-2901 Add option to disable checkpoint dirty stepdown phase Branch: master https://github.com/mongodb/mongo/commit/29b5a329c5c72fe87d1627bd99e682d9d5e2e34c
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: WT-2872 Ensure tests with tiny caches don't get stuck due to the dirty trigger. (#3017)
          Branch: mongodb-3.2
          https://github.com/wiredtiger/wiredtiger/commit/fa0b203b79d181e56fa73696ce744cbaf90a3c40

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: WT-2872 Ensure tests with tiny caches don't get stuck due to the dirty trigger. (#3017) Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/fa0b203b79d181e56fa73696ce744cbaf90a3c40
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

          Message: Import wiredtiger: 911c940adab547d36ac305fc627a79e637fa3c40 from branch mongodb-3.2

          ref: dddca65..911c940ada
          for: 3.2.10

          SERVER-24971 Excessive memory held by sessions when application threads do evictions
          SERVER-25843 Coverity analysis defect 99856: Redundant test
          SERVER-25845 Coverity analysis defect 99859: Explicit null dereferenced
          SERVER-25846 Coverity analysis defect 99861: Dereference after null check
          WT-1162 Add latency to Jenkins wtperf tests and plots
          WT-2026 Maximum pages size at eviction too large
          WT-2221 Document which statistics are available via a "fast" configuration vs. an "all" configuration
          WT-2233 Investigate changing when the eviction server switches to aggressive mode.
          WT-2239 Make sure LSM cursors read up to date dsk_gen, it was racing with compact
          WT-2323 Allocate a transaction id at the beginning of join cursor iteration
          WT-2353 Failure to create async threads as part of a wiredtiger_open call will cause a hang
          WT-2380 Make scripts fail if code doesn't match style
          WT-2486 Update make check so that it runs faster
          WT-2555 make format run on Windows
          WT-2578 remove write barriers from the TAILQ_INSERT_XXX macros
          WT-2631 nullptr is passed for parameters marked with attribute non-null
          WT-2638 ftruncate may not be supported
          WT-2645 wt dump: push the complexity of collecting metadata into a dump cursor
          WT-2648 cache-line alignment for new ports
          WT-2665 Limit allocator fragmentation in WiredTiger
          WT-2678 The metadata should not imply that an empty value is true
          WT-2688 configure --enable-python doesn't check for availability of swig
          WT-2693 Check open_cursor error paths for consistent handling
          WT-2695 Integrate s390x accelerated crc32c support
          WT-2708 split child-update race with reconciliation/eviction
          WT-2711 Change statistics log configuration options
          WT-2719 add fuzz testing for WiredTiger options and reconfiguration.
          WT-2728 Don't re-read log file headers during log_flush
          WT-2729 Focus eviction walks in largest trees
          WT-2730 cursor next/prev can return the wrong key/value pair when crossing a page boundary
          WT-2731 Raw compression can create pages that are larger than expected
          WT-2732 Coverity analysis defect 99665: Redundant test
          WT-2734 Improve documentation of eviction behavior
          WT-2737 Scrub dirty pages rather than evicting them
          WT-2738 Remove the ability to change the default checkpoint name
          WT-2739 pluggable file systems documentation cleanups
          WT-2743 Thread count statistics always report 0
          WT-2744 partial line even with line buffering set
          WT-2746 track checkpoint I/O separately from eviction I/O
          WT-2751 column-store statistics incorrectly calculates the number of entries
          WT-2752 Fixes to zipfian wtperf workload config
          WT-2755 flexelint configuration treats size_t as 4B type
          WT-2756 Upgrade the autoconf archive package to check for swig 3.0
          WT-2757 Column tables behave differently when column names are provided
          WT-2759 Releasing the hot-backup lock doesn't require the schema lock.
          WT-2760 Fix a bug in backup related to directory sync. Change the filesystem API to make durable the default
          WT-2762 wtstats tool fails if checkpoint runs
          WT-2763 Unit test test_intpack failing on OSX
          WT-2764 Optimize checkpoints to reduce throughput disruption
          WT-2765 wt dump: indices need to be shown in the dump output
          WT-2766 Don't count eviction of lookaside file pages for the purpose of checking stuck cache
          WT-2767 test suite needs way to run an individual scenario
          WT-2769 Update documentation to reflect correct limits of memory_page_max
          WT-2770 Add statistics tracking schema operations
          WT-2772 Investigate log performance testing weirdness
          WT-2773 search_near in indexes does not find exact matches
          WT-2774 minor cleanups/improvements
          WT-2778 Python test suite: make scenario initialization consistent
          WT-2779 Raw compression created unexpectedly large pages on disk
          WT-2781 Enhance bulk cursor option with an option to return immediately on contention
          WT-2782 Missing a fs_directory_list_free in ex_file_system.c
          WT-2783 wtperf multi-btree.wtperf dumps core on Mac
          WT-2785 Scrub dirty pages rather than evicting them: single-page reconciliation
          WT-2787 Include src/include/wiredtiger_ext.h is problematic
          WT-2788 Java: freed memory overwrite during handle close can cause JNI crash
          WT-2791 Enhance OS X Evergreen unit test
          WT-2793 wtperf config improvements
          WT-2795 Update documentation around read-only configuration
          WT-2796 Memory leak in reconciliation uncovered by stress testing
          WT-2798 Crash vulnerability with nojournal after create during checkpoint
          WT-2800 Illegal file format in test/format on PPC
          WT-2801 Crash vulnerability from eviction of metadata during checkpoint
          WT-2802 Transaction commit causes heap-use-after free
          WT-2803 Add verbose functionality to WT Evergreen tests
          WT-2804 Don't read values in a tree without a snapshot
          WT-2805 Infinite recursion if error streams fail
          WT-2806 wtperf allocation size off-by-one
          WT-2807 Switch Jenkins performance tests to tcmalloc
          WT-2811 Reconciliation asserts that transaction time has gone backwards
          WT-2812 Error when reconfiguring cache targets
          WT-2813 small cache usage stuck even with large cache
          WT-2814 Enhance wtperf to support single-op truncate mode
          WT-2816 Improve WiredTiger eviction performance
          WT-2817 Investigate performance regression in develop, add workload to wtperf/runners
          WT-2818 The page visibility check when queuing pages for eviction is overly restrictive
          WT-2820 add gcc warn_unused_result attribute
          WT-2822 panic mutex and other functions that cannot fail
          WT-2823 support file handles without a truncate method
          WT-2824 wtperf displays connection and table create configurations twice
          WT-2826 clang38 false positive on uninitialized variable.
          WT-2827 checkpoint log_size configuration improvements
          WT-2828 Make long wtperf tests reflect mongoDB usage
          WT-2829 Switch automated testing to use enable-strict configure option
          WT-2832 Python test uses hard-coded temporary directory
          WT-2834 Join cursor: discrepancy with bloom filters
          WT-2835 WT_CONNECTION.leak-memory can skip memory map and cache cleanup
          WT-2838 Don't free session handles on close if leak memory is configured
          WT-2839 lint: Ignoring return value of function
          WT-2840 clang analysis: garbage values
          WT-2841 Jenkins Valgrind runner is reporting errors in test wt2719_reconfig
          WT-2842 split wtperf's configuration into per-database and per-run parts
          WT-2843 Fix a bug in recovery if there is no filesystem truncate support
          WT-2846 Several bugs related to reconfiguring eviction server at runtime
          WT-2847 Merge fair locks into read/write locks.
          WT-2850 clang 4.1 attribute warnings when building
          WT-2853 Multi threaded reader writer example shows temporary slowdown or lockup
          WT-2857 POSIX ftruncate calls should be #ifdef'd HAVE_FTRUNCATE
          WT-2862 Fix lint error in test case for forced eviction with multiple cursors
          WT-2863 Support UTF-8 paths on Windows
          WT-2865 eviction thread error failure
          WT-2866 Eviction server algorithm tuning
          WT-2867 Review and fix barrier usage in __lsm_tree_close
          WT-2868 Add sample_interval to checkpoint-stress wtperf config
          WT-2869 Performance regression on secondaries
          WT-2870 Rename wtperf checkpoint schema jobs
          WT-2871 __wt_verbose has the wrong GCC format attributes
          WT-2872 Recent stuck cache test/stress failures.
          WT-2873 Refactor CRC32 code
          WT-2875 Test test_wt2853_perf can run too long under valgrind
          WT-2876 Extend wtperf to support a log like table
          WT-2878 Verbose changes affected performance
          WT-2881 Add -Wpedantic to clang compiler warning flags
          WT-2883 wiredtiger_open with verbose=handleops recursive loop
          WT-2885 __wt_checkpoint_signal lint
          WT-2886 Decide how in-memory configuration and eviction_dirty_target interact
          WT-2888 Switch functions to return void where possible
          WT-2892 hot backup can race with block truncate
          WT-2896 Coverity #1362535: resource leak
          WT-2897 Checkpoints can become corrupted on failure
          WT-2901 Add option to disable checkpoint dirty stepdown phase
          WT-2903 Reduce the impact of checkpoint scrubbing on applications
          Branch: v3.2
          https://github.com/mongodb/mongo/commit/7d2acd6395ec84beca34718a75371bc11f0c9f60

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: 911c940adab547d36ac305fc627a79e637fa3c40 from branch mongodb-3.2 ref: dddca65..911c940ada for: 3.2.10 SERVER-24971 Excessive memory held by sessions when application threads do evictions SERVER-25843 Coverity analysis defect 99856: Redundant test SERVER-25845 Coverity analysis defect 99859: Explicit null dereferenced SERVER-25846 Coverity analysis defect 99861: Dereference after null check WT-1162 Add latency to Jenkins wtperf tests and plots WT-2026 Maximum pages size at eviction too large WT-2221 Document which statistics are available via a "fast" configuration vs. an "all" configuration WT-2233 Investigate changing when the eviction server switches to aggressive mode. WT-2239 Make sure LSM cursors read up to date dsk_gen, it was racing with compact WT-2323 Allocate a transaction id at the beginning of join cursor iteration WT-2353 Failure to create async threads as part of a wiredtiger_open call will cause a hang WT-2380 Make scripts fail if code doesn't match style WT-2486 Update make check so that it runs faster WT-2555 make format run on Windows WT-2578 remove write barriers from the TAILQ_INSERT_XXX macros WT-2631 nullptr is passed for parameters marked with attribute non-null WT-2638 ftruncate may not be supported WT-2645 wt dump: push the complexity of collecting metadata into a dump cursor WT-2648 cache-line alignment for new ports WT-2665 Limit allocator fragmentation in WiredTiger WT-2678 The metadata should not imply that an empty value is true WT-2688 configure --enable-python doesn't check for availability of swig WT-2693 Check open_cursor error paths for consistent handling WT-2695 Integrate s390x accelerated crc32c support WT-2708 split child-update race with reconciliation/eviction WT-2711 Change statistics log configuration options WT-2719 add fuzz testing for WiredTiger options and reconfiguration. WT-2728 Don't re-read log file headers during log_flush WT-2729 Focus eviction walks in largest trees WT-2730 cursor next/prev can return the wrong key/value pair when crossing a page boundary WT-2731 Raw compression can create pages that are larger than expected WT-2732 Coverity analysis defect 99665: Redundant test WT-2734 Improve documentation of eviction behavior WT-2737 Scrub dirty pages rather than evicting them WT-2738 Remove the ability to change the default checkpoint name WT-2739 pluggable file systems documentation cleanups WT-2743 Thread count statistics always report 0 WT-2744 partial line even with line buffering set WT-2746 track checkpoint I/O separately from eviction I/O WT-2751 column-store statistics incorrectly calculates the number of entries WT-2752 Fixes to zipfian wtperf workload config WT-2755 flexelint configuration treats size_t as 4B type WT-2756 Upgrade the autoconf archive package to check for swig 3.0 WT-2757 Column tables behave differently when column names are provided WT-2759 Releasing the hot-backup lock doesn't require the schema lock. WT-2760 Fix a bug in backup related to directory sync. Change the filesystem API to make durable the default WT-2762 wtstats tool fails if checkpoint runs WT-2763 Unit test test_intpack failing on OSX WT-2764 Optimize checkpoints to reduce throughput disruption WT-2765 wt dump: indices need to be shown in the dump output WT-2766 Don't count eviction of lookaside file pages for the purpose of checking stuck cache WT-2767 test suite needs way to run an individual scenario WT-2769 Update documentation to reflect correct limits of memory_page_max WT-2770 Add statistics tracking schema operations WT-2772 Investigate log performance testing weirdness WT-2773 search_near in indexes does not find exact matches WT-2774 minor cleanups/improvements WT-2778 Python test suite: make scenario initialization consistent WT-2779 Raw compression created unexpectedly large pages on disk WT-2781 Enhance bulk cursor option with an option to return immediately on contention WT-2782 Missing a fs_directory_list_free in ex_file_system.c WT-2783 wtperf multi-btree.wtperf dumps core on Mac WT-2785 Scrub dirty pages rather than evicting them: single-page reconciliation WT-2787 Include src/include/wiredtiger_ext.h is problematic WT-2788 Java: freed memory overwrite during handle close can cause JNI crash WT-2791 Enhance OS X Evergreen unit test WT-2793 wtperf config improvements WT-2795 Update documentation around read-only configuration WT-2796 Memory leak in reconciliation uncovered by stress testing WT-2798 Crash vulnerability with nojournal after create during checkpoint WT-2800 Illegal file format in test/format on PPC WT-2801 Crash vulnerability from eviction of metadata during checkpoint WT-2802 Transaction commit causes heap-use-after free WT-2803 Add verbose functionality to WT Evergreen tests WT-2804 Don't read values in a tree without a snapshot WT-2805 Infinite recursion if error streams fail WT-2806 wtperf allocation size off-by-one WT-2807 Switch Jenkins performance tests to tcmalloc WT-2811 Reconciliation asserts that transaction time has gone backwards WT-2812 Error when reconfiguring cache targets WT-2813 small cache usage stuck even with large cache WT-2814 Enhance wtperf to support single-op truncate mode WT-2816 Improve WiredTiger eviction performance WT-2817 Investigate performance regression in develop, add workload to wtperf/runners WT-2818 The page visibility check when queuing pages for eviction is overly restrictive WT-2820 add gcc warn_unused_result attribute WT-2822 panic mutex and other functions that cannot fail WT-2823 support file handles without a truncate method WT-2824 wtperf displays connection and table create configurations twice WT-2826 clang38 false positive on uninitialized variable. WT-2827 checkpoint log_size configuration improvements WT-2828 Make long wtperf tests reflect mongoDB usage WT-2829 Switch automated testing to use enable-strict configure option WT-2832 Python test uses hard-coded temporary directory WT-2834 Join cursor: discrepancy with bloom filters WT-2835 WT_CONNECTION.leak-memory can skip memory map and cache cleanup WT-2838 Don't free session handles on close if leak memory is configured WT-2839 lint: Ignoring return value of function WT-2840 clang analysis: garbage values WT-2841 Jenkins Valgrind runner is reporting errors in test wt2719_reconfig WT-2842 split wtperf's configuration into per-database and per-run parts WT-2843 Fix a bug in recovery if there is no filesystem truncate support WT-2846 Several bugs related to reconfiguring eviction server at runtime WT-2847 Merge fair locks into read/write locks. WT-2850 clang 4.1 attribute warnings when building WT-2853 Multi threaded reader writer example shows temporary slowdown or lockup WT-2857 POSIX ftruncate calls should be #ifdef'd HAVE_FTRUNCATE WT-2862 Fix lint error in test case for forced eviction with multiple cursors WT-2863 Support UTF-8 paths on Windows WT-2865 eviction thread error failure WT-2866 Eviction server algorithm tuning WT-2867 Review and fix barrier usage in __lsm_tree_close WT-2868 Add sample_interval to checkpoint-stress wtperf config WT-2869 Performance regression on secondaries WT-2870 Rename wtperf checkpoint schema jobs WT-2871 __wt_verbose has the wrong GCC format attributes WT-2872 Recent stuck cache test/stress failures. WT-2873 Refactor CRC32 code WT-2875 Test test_wt2853_perf can run too long under valgrind WT-2876 Extend wtperf to support a log like table WT-2878 Verbose changes affected performance WT-2881 Add -Wpedantic to clang compiler warning flags WT-2883 wiredtiger_open with verbose=handleops recursive loop WT-2885 __wt_checkpoint_signal lint WT-2886 Decide how in-memory configuration and eviction_dirty_target interact WT-2888 Switch functions to return void where possible WT-2892 hot backup can race with block truncate WT-2896 Coverity #1362535: resource leak WT-2897 Checkpoints can become corrupted on failure WT-2901 Add option to disable checkpoint dirty stepdown phase WT-2903 Reduce the impact of checkpoint scrubbing on applications Branch: v3.2 https://github.com/mongodb/mongo/commit/7d2acd6395ec84beca34718a75371bc11f0c9f60

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:
                Days since reply:
                32 weeks, 5 days ago
                Date of 1st Reply: