Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2977

Csuite LSM Random test can occasionally fail

    Details

    • Type: Question
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.9.0, 3.2.11, 3.4.0-rc2
    • Labels:
      None
    • # Replies:
      5
    • Last comment by Customer:
      true
    • Sprint:
      Storage 2016-10-31

      Description

      The LSM random test can occasionally fail as follows:

       
      FAIL: test_wt2403_lsm_workload
      ==============================
       
      query_docs/87: count <= NUM_QUERIES / 100: same document was returned 75 times, likely we are seeing the one remaining value
      100000 documents inserted
      1000 documents read
      100000 documents set to update
      1000 documents read
      1000 documents read
      99999 documents deleted
      FAIL test_wt2403_lsm_workload (exit status: 1)
      

      The failure is due to a test seeing slightly higher than expected returns of the same document on a random cursor.

      The count here is the total number of times that a repeated document has returned and it is never reset.

      This part of random cursors is better tested within the python suite test_random_cursor (using a set) and can be removed.

        Activity

        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'}

        Message: WT-2977 Remove stash and check code from LSM test (#3097)
        Branch: develop
        https://github.com/wiredtiger/wiredtiger/commit/349f5349eaaeab99f7a7178e03ab34f8ff0ebd0c

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'} Message: WT-2977 Remove stash and check code from LSM test (#3097) Branch: develop https://github.com/wiredtiger/wiredtiger/commit/349f5349eaaeab99f7a7178e03ab34f8ff0ebd0c
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'}

        Message: WT-2977 Remove stash and check code from LSM test (#3097)
        Branch: mongodb-3.4
        https://github.com/wiredtiger/wiredtiger/commit/349f5349eaaeab99f7a7178e03ab34f8ff0ebd0c

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'} Message: WT-2977 Remove stash and check code from LSM test (#3097) Branch: mongodb-3.4 https://github.com/wiredtiger/wiredtiger/commit/349f5349eaaeab99f7a7178e03ab34f8ff0ebd0c
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

        Message: Import wiredtiger: ef9a7983ea47cea78400a4472a3d4e46735385c5 from branch mongodb-3.4

        ref: 6a31c2118c..ef9a7983ea
        for: 3.4.0-rc2

        WT-1592 Add ability to dump detailed cache information via statistics
        WT-2403 Enhance random cursor implementation for LSM trees
        WT-2880 Add support for Zstandard compression
        WT-2904 Fix a bug where the reported checkpoint size could be many times data size
        WT-2949 Add an option to wtperf to not close connection on shutdown
        WT-2954 Inserting multi-megabyte values can cause large in-memory pages
        WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks
        WT-2956 utility tests -h option is always overridden by the default setup
        WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized
        WT-2963 Race setting max_entries during eviction
        WT-2965 test_wt2323_join_visibility can hang on OSX
        WT-2974 lint
        WT-2976 Add a statistic tracking how long application threads spend doing I/O
        WT-2977 Csuite LSM Random test can occasionally fail
        WT-2985 Race during checkpoint can cause a core dump
        WT-2987 Fix a bug where opening a cursor on an incomplete table drops core
        WT-2988 Fix a bug where __wt_epoch potentially returns garbage values.
        Branch: master
        https://github.com/mongodb/mongo/commit/0609d0ce2ef563d7a4cde77d46396fe5c92c6df1

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: ef9a7983ea47cea78400a4472a3d4e46735385c5 from branch mongodb-3.4 ref: 6a31c2118c..ef9a7983ea for: 3.4.0-rc2 WT-1592 Add ability to dump detailed cache information via statistics WT-2403 Enhance random cursor implementation for LSM trees WT-2880 Add support for Zstandard compression WT-2904 Fix a bug where the reported checkpoint size could be many times data size WT-2949 Add an option to wtperf to not close connection on shutdown WT-2954 Inserting multi-megabyte values can cause large in-memory pages WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks WT-2956 utility tests -h option is always overridden by the default setup WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized WT-2963 Race setting max_entries during eviction WT-2965 test_wt2323_join_visibility can hang on OSX WT-2974 lint WT-2976 Add a statistic tracking how long application threads spend doing I/O WT-2977 Csuite LSM Random test can occasionally fail WT-2985 Race during checkpoint can cause a core dump WT-2987 Fix a bug where opening a cursor on an incomplete table drops core WT-2988 Fix a bug where __wt_epoch potentially returns garbage values. Branch: master https://github.com/mongodb/mongo/commit/0609d0ce2ef563d7a4cde77d46396fe5c92c6df1
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'}

        Message: WT-2977 Remove stash and check code from LSM test (#3097)
        Branch: mongodb-3.2
        https://github.com/wiredtiger/wiredtiger/commit/349f5349eaaeab99f7a7178e03ab34f8ff0ebd0c

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'daveh86', u'name': u'David Hows', u'email': u'howsdav@gmail.com'} Message: WT-2977 Remove stash and check code from LSM test (#3097) Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/349f5349eaaeab99f7a7178e03ab34f8ff0ebd0c
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

        Message: Import wiredtiger: b11ed312cedb905dec49dd2c9c262fabf64d13cd from branch mongodb-3.2

        ref: 9cf2f89d6d..b11ed312ce
        for: 3.2.11

        WT-1592 Dump detailed cache information via statistics
        WT-2403 Enhance random cursor implementation for LSM trees
        WT-2831 Skip creating a checkpoint if there have been no changes
        WT-2858 rename wtperf's CONFIG structure
        WT-2880 Add support for Zstandard compression
        WT-2895 Reduce the runtime of make check testing with disable long
        WT-2904 Fix a bug where the reported checkpoint size could be many times data size
        WT-2907 Bug in Java ConcurrentCloseTest case
        WT-2917 split wtperf's configuration into per-database and per-run parts
        WT-2920 Add statistic tracking application thread cache maintenance time
        WT-2931 Configure default in-memory dirty cache usage lower
        WT-2932 Allow applications to selectively ignore cache limit with in-memory configuration
        WT-2933 Fix a race between named snapshots and checkpoints
        WT-2937 test_inmem01 aborts due to stuck cache
        WT-2938 Assembly files should end in .sx, not .S
        WT-2941 Improve test/format to use faster key-generation functions
        WT-2942 verbose strings don't need newline
        WT-2946 dist/s_docs incompatible with OS X Xcode installation
        WT-2948 simplify error handling by making epoch time return never fail
        WT-2949 Add an option to wtperf to not close connection on shutdown
        WT-2950 Inserting multi-megabyte values can cause large in-memory pages
        WT-2954 Inserting multi-megabyte values can cause large in-memory pages
        WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks
        WT-2956 utility tests -h option is always overridden by the default setup
        WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized
        WT-2963 Race setting max_entries during eviction
        WT-2965 test_wt2323_join_visibility can hang on OSX
        WT-2974 lint
        WT-2976 Add a statistic tracking how long application threads spend doing I/O
        WT-2977 Csuite LSM Random test can occasionally fail
        WT-2985 Race during checkpoint can cause a core dump
        WT-2987 Fix a bug where opening a cursor on an incomplete table drops core
        WT-2988 __wt_epoch potentially returns garbage values.
        Branch: v3.2
        https://github.com/mongodb/mongo/commit/ebbb4eb0b091fa185b06a060d24b68eb6761ba4a

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: b11ed312cedb905dec49dd2c9c262fabf64d13cd from branch mongodb-3.2 ref: 9cf2f89d6d..b11ed312ce for: 3.2.11 WT-1592 Dump detailed cache information via statistics WT-2403 Enhance random cursor implementation for LSM trees WT-2831 Skip creating a checkpoint if there have been no changes WT-2858 rename wtperf's CONFIG structure WT-2880 Add support for Zstandard compression WT-2895 Reduce the runtime of make check testing with disable long WT-2904 Fix a bug where the reported checkpoint size could be many times data size WT-2907 Bug in Java ConcurrentCloseTest case WT-2917 split wtperf's configuration into per-database and per-run parts WT-2920 Add statistic tracking application thread cache maintenance time WT-2931 Configure default in-memory dirty cache usage lower WT-2932 Allow applications to selectively ignore cache limit with in-memory configuration WT-2933 Fix a race between named snapshots and checkpoints WT-2937 test_inmem01 aborts due to stuck cache WT-2938 Assembly files should end in .sx, not .S WT-2941 Improve test/format to use faster key-generation functions WT-2942 verbose strings don't need newline WT-2946 dist/s_docs incompatible with OS X Xcode installation WT-2948 simplify error handling by making epoch time return never fail WT-2949 Add an option to wtperf to not close connection on shutdown WT-2950 Inserting multi-megabyte values can cause large in-memory pages WT-2954 Inserting multi-megabyte values can cause large in-memory pages WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks WT-2956 utility tests -h option is always overridden by the default setup WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized WT-2963 Race setting max_entries during eviction WT-2965 test_wt2323_join_visibility can hang on OSX WT-2974 lint WT-2976 Add a statistic tracking how long application threads spend doing I/O WT-2977 Csuite LSM Random test can occasionally fail WT-2985 Race during checkpoint can cause a core dump WT-2987 Fix a bug where opening a cursor on an incomplete table drops core WT-2988 __wt_epoch potentially returns garbage values. Branch: v3.2 https://github.com/mongodb/mongo/commit/ebbb4eb0b091fa185b06a060d24b68eb6761ba4a

          People

          • Assignee:
            david.hows David Hows
            Reporter:
            david.hows David Hows
            Participants:
            Last commenter:
            Ramon Fernandez
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:
              Days since reply:
              26 weeks ago
              Date of 1st Reply:

                Agile