Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2949

Add an option to wtperf to not close connection on shutdown

    Details

    • # Replies:
      13
    • Last comment by Customer:
      true
    • Sprint:
      Storage 2016-10-31

      Description

      In running the evict-btree-stress-multi.wtperf workload, I've decided I'd really like an option in wtperf and drilled into conn->close to forego the checkpoint on close. This should likely be an undocumented option I believe. My 600 second workload takes 380 seconds after it completes in conn->close. We rarely want anything after the program prints out its performance numbers so the data is now disposable.

        Activity

        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

        Message: WT-2949 Add option to skip closing the connection after test runs. (#3082)

        • WT-2949 Add option to skip closing the connection after test runs.
        • Reverse the default value per review comments and add where needed to
          configs.
        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'} Message: WT-2949 Add option to skip closing the connection after test runs. (#3082) WT-2949 Add option to skip closing the connection after test runs. Reverse the default value per review comments and add where needed to configs. Add additional text/comments for new option. Branch: mongodb-3.4 https://github.com/wiredtiger/wiredtiger/commit/72f4d89fbef3bb07b8ef3c0b8a00f758487af7f3
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

        Message: Import wiredtiger: ef9a7983ea47cea78400a4472a3d4e46735385c5 from branch mongodb-3.4

        ref: 6a31c2118c..ef9a7983ea
        for: 3.4.0-rc2

        WT-1592 Add ability to dump detailed cache information via statistics
        WT-2403 Enhance random cursor implementation for LSM trees
        WT-2880 Add support for Zstandard compression
        WT-2904 Fix a bug where the reported checkpoint size could be many times data size
        WT-2949 Add an option to wtperf to not close connection on shutdown
        WT-2954 Inserting multi-megabyte values can cause large in-memory pages
        WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks
        WT-2956 utility tests -h option is always overridden by the default setup
        WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized
        WT-2963 Race setting max_entries during eviction
        WT-2965 test_wt2323_join_visibility can hang on OSX
        WT-2974 lint
        WT-2976 Add a statistic tracking how long application threads spend doing I/O
        WT-2977 Csuite LSM Random test can occasionally fail
        WT-2985 Race during checkpoint can cause a core dump
        WT-2987 Fix a bug where opening a cursor on an incomplete table drops core
        WT-2988 Fix a bug where __wt_epoch potentially returns garbage values.
        Branch: master
        https://github.com/mongodb/mongo/commit/0609d0ce2ef563d7a4cde77d46396fe5c92c6df1

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: ef9a7983ea47cea78400a4472a3d4e46735385c5 from branch mongodb-3.4 ref: 6a31c2118c..ef9a7983ea for: 3.4.0-rc2 WT-1592 Add ability to dump detailed cache information via statistics WT-2403 Enhance random cursor implementation for LSM trees WT-2880 Add support for Zstandard compression WT-2904 Fix a bug where the reported checkpoint size could be many times data size WT-2949 Add an option to wtperf to not close connection on shutdown WT-2954 Inserting multi-megabyte values can cause large in-memory pages WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks WT-2956 utility tests -h option is always overridden by the default setup WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized WT-2963 Race setting max_entries during eviction WT-2965 test_wt2323_join_visibility can hang on OSX WT-2974 lint WT-2976 Add a statistic tracking how long application threads spend doing I/O WT-2977 Csuite LSM Random test can occasionally fail WT-2985 Race during checkpoint can cause a core dump WT-2987 Fix a bug where opening a cursor on an incomplete table drops core WT-2988 Fix a bug where __wt_epoch potentially returns garbage values. Branch: master https://github.com/mongodb/mongo/commit/0609d0ce2ef563d7a4cde77d46396fe5c92c6df1
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

        Message: WT-2949 Add option to skip closing the connection after test runs. (#3082)

        • WT-2949 Add option to skip closing the connection after test runs.
        • Reverse the default value per review comments and add where needed to
          configs.
        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'} Message: WT-2949 Add option to skip closing the connection after test runs. (#3082) WT-2949 Add option to skip closing the connection after test runs. Reverse the default value per review comments and add where needed to configs. Add additional text/comments for new option. Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/72f4d89fbef3bb07b8ef3c0b8a00f758487af7f3
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'}

        Message: WT-2949 Add option to skip closing the connection after test runs. (#3082)

        • WT-2949 Add option to skip closing the connection after test runs.
        • Reverse the default value per review comments and add where needed to
          configs.
        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'sueloverso', u'name': u'sueloverso', u'email': u'sue@mongodb.com'} Message: WT-2949 Add option to skip closing the connection after test runs. (#3082) WT-2949 Add option to skip closing the connection after test runs. Reverse the default value per review comments and add where needed to configs. Add additional text/comments for new option. Branch: mongodb-3.2 https://github.com/wiredtiger/wiredtiger/commit/72f4d89fbef3bb07b8ef3c0b8a00f758487af7f3
        Hide
        xgen-internal-githook Githook User added a comment -

        Author:

        {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

        Message: Import wiredtiger: b11ed312cedb905dec49dd2c9c262fabf64d13cd from branch mongodb-3.2

        ref: 9cf2f89d6d..b11ed312ce
        for: 3.2.11

        WT-1592 Dump detailed cache information via statistics
        WT-2403 Enhance random cursor implementation for LSM trees
        WT-2831 Skip creating a checkpoint if there have been no changes
        WT-2858 rename wtperf's CONFIG structure
        WT-2880 Add support for Zstandard compression
        WT-2895 Reduce the runtime of make check testing with disable long
        WT-2904 Fix a bug where the reported checkpoint size could be many times data size
        WT-2907 Bug in Java ConcurrentCloseTest case
        WT-2917 split wtperf's configuration into per-database and per-run parts
        WT-2920 Add statistic tracking application thread cache maintenance time
        WT-2931 Configure default in-memory dirty cache usage lower
        WT-2932 Allow applications to selectively ignore cache limit with in-memory configuration
        WT-2933 Fix a race between named snapshots and checkpoints
        WT-2937 test_inmem01 aborts due to stuck cache
        WT-2938 Assembly files should end in .sx, not .S
        WT-2941 Improve test/format to use faster key-generation functions
        WT-2942 verbose strings don't need newline
        WT-2946 dist/s_docs incompatible with OS X Xcode installation
        WT-2948 simplify error handling by making epoch time return never fail
        WT-2949 Add an option to wtperf to not close connection on shutdown
        WT-2950 Inserting multi-megabyte values can cause large in-memory pages
        WT-2954 Inserting multi-megabyte values can cause large in-memory pages
        WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks
        WT-2956 utility tests -h option is always overridden by the default setup
        WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized
        WT-2963 Race setting max_entries during eviction
        WT-2965 test_wt2323_join_visibility can hang on OSX
        WT-2974 lint
        WT-2976 Add a statistic tracking how long application threads spend doing I/O
        WT-2977 Csuite LSM Random test can occasionally fail
        WT-2985 Race during checkpoint can cause a core dump
        WT-2987 Fix a bug where opening a cursor on an incomplete table drops core
        WT-2988 __wt_epoch potentially returns garbage values.
        Branch: v3.2
        https://github.com/mongodb/mongo/commit/ebbb4eb0b091fa185b06a060d24b68eb6761ba4a

        Show
        xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Import wiredtiger: b11ed312cedb905dec49dd2c9c262fabf64d13cd from branch mongodb-3.2 ref: 9cf2f89d6d..b11ed312ce for: 3.2.11 WT-1592 Dump detailed cache information via statistics WT-2403 Enhance random cursor implementation for LSM trees WT-2831 Skip creating a checkpoint if there have been no changes WT-2858 rename wtperf's CONFIG structure WT-2880 Add support for Zstandard compression WT-2895 Reduce the runtime of make check testing with disable long WT-2904 Fix a bug where the reported checkpoint size could be many times data size WT-2907 Bug in Java ConcurrentCloseTest case WT-2917 split wtperf's configuration into per-database and per-run parts WT-2920 Add statistic tracking application thread cache maintenance time WT-2931 Configure default in-memory dirty cache usage lower WT-2932 Allow applications to selectively ignore cache limit with in-memory configuration WT-2933 Fix a race between named snapshots and checkpoints WT-2937 test_inmem01 aborts due to stuck cache WT-2938 Assembly files should end in .sx, not .S WT-2941 Improve test/format to use faster key-generation functions WT-2942 verbose strings don't need newline WT-2946 dist/s_docs incompatible with OS X Xcode installation WT-2948 simplify error handling by making epoch time return never fail WT-2949 Add an option to wtperf to not close connection on shutdown WT-2950 Inserting multi-megabyte values can cause large in-memory pages WT-2954 Inserting multi-megabyte values can cause large in-memory pages WT-2955 Add statistics tracking the amount of time threads spend waiting for high level locks WT-2956 utility tests -h option is always overridden by the default setup WT-2959 Ensure WT_SESSION_IMPL is never used before it's initialized WT-2963 Race setting max_entries during eviction WT-2965 test_wt2323_join_visibility can hang on OSX WT-2974 lint WT-2976 Add a statistic tracking how long application threads spend doing I/O WT-2977 Csuite LSM Random test can occasionally fail WT-2985 Race during checkpoint can cause a core dump WT-2987 Fix a bug where opening a cursor on an incomplete table drops core WT-2988 __wt_epoch potentially returns garbage values. Branch: v3.2 https://github.com/mongodb/mongo/commit/ebbb4eb0b091fa185b06a060d24b68eb6761ba4a

          People

          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:
              Days since reply:
              21 weeks, 3 days ago
              Date of 1st Reply:

                Agile