Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2228

useless raw compression calls in the case of small or remaindered blocks

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.7.0
    • Labels:
      None
    • # Replies:
      3
    • Last comment by Customer:
      true

      Description

      The WiredTiger reconciliation process calls raw compression (for example, if the engine is configured with zlib), even when the data chunk is smaller than the allocation size and compression is known to be a waste of time. When the allocation size is a significant percentage of the maximum block size, this can be half or more of the calls to raw compression.

        Issue Links

          Activity

          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'keithbostic', u'name': u'Keith Bostic', u'email': u'keith@wiredtiger.com'}

          Message: WT-2228: The WiredTiger reconciliation process calls raw compression
          (for example, if the engine is configured with zlib), even when the data
          chunk is smaller than the allocation size and compression is known to
          be a waste of time. When the allocation size is a significant percentage
          of the maximum block size, this can be half or more of the calls to raw
          compression.
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/801fcc687c2669eaefd557a008544a386fd758df

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'keithbostic', u'name': u'Keith Bostic', u'email': u'keith@wiredtiger.com'} Message: WT-2228 : The WiredTiger reconciliation process calls raw compression (for example, if the engine is configured with zlib), even when the data chunk is smaller than the allocation size and compression is known to be a waste of time. When the allocation size is a significant percentage of the maximum block size, this can be half or more of the calls to raw compression. Branch: develop https://github.com/wiredtiger/wiredtiger/commit/801fcc687c2669eaefd557a008544a386fd758df
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'}

          Message: Merge pull request #2320 from wiredtiger/wt-2228-raw-compression

          WT-2228: avoid unnecessary raw-compression calls.
          Branch: develop
          https://github.com/wiredtiger/wiredtiger/commit/cace179242802786b9ecbdb5f229389c517dd531

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'agorrod', u'name': u'Alex Gorrod', u'email': u'alexander.gorrod@mongodb.com'} Message: Merge pull request #2320 from wiredtiger/wt-2228-raw-compression WT-2228 : avoid unnecessary raw-compression calls. Branch: develop https://github.com/wiredtiger/wiredtiger/commit/cace179242802786b9ecbdb5f229389c517dd531
          Hide
          xgen-internal-githook Githook User added a comment -

          Author:

          {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'}

          Message: Import wiredtiger-wiredtiger-mongodb-3.2-rc4-41-g8326df6.tar.gz from wiredtiger branch mongodb-3.2

          ref: b65381f..8326df6

          4c49948 WT-2244 Trigger in-memory splits sooner.
          9f2e4f3 WT-2248 WT_SESSION.close is updating WT_CONNECTION_IMPL.default_session.
          a6da10e SERVER-21553 Enable fast-path truncate after splits.
          39dfd21 WT-2243 Don't keep transaction IDs pinned for reading from checkpoints.
          4e1844c WT-2230 multi-split error path.
          cace179 WT-2228 avoid unnecessary raw-compression calls.
          890ee34 SERVER-21619 Don't do internal page splits after a tree is marked DEAD.
          6c7338f WT-2241 Use a lock to protect transaction ID allocation.
          978c237 WT-2234 Coverity analysis warnings.
          Branch: master
          https://github.com/mongodb/mongo/commit/e7181b542b25981db42f74cdaee4e7fc323d3e9d

          Show
          xgen-internal-githook Githook User added a comment - Author: {u'username': u'michaelcahill', u'name': u'Michael Cahill', u'email': u'michael.cahill@mongodb.com'} Message: Import wiredtiger-wiredtiger-mongodb-3.2-rc4-41-g8326df6.tar.gz from wiredtiger branch mongodb-3.2 ref: b65381f..8326df6 4c49948 WT-2244 Trigger in-memory splits sooner. 9f2e4f3 WT-2248 WT_SESSION.close is updating WT_CONNECTION_IMPL.default_session. a6da10e SERVER-21553 Enable fast-path truncate after splits. 39dfd21 WT-2243 Don't keep transaction IDs pinned for reading from checkpoints. 4e1844c WT-2230 multi-split error path. cace179 WT-2228 avoid unnecessary raw-compression calls. 890ee34 SERVER-21619 Don't do internal page splits after a tree is marked DEAD. 6c7338f WT-2241 Use a lock to protect transaction ID allocation. 978c237 WT-2234 Coverity analysis warnings. Branch: master https://github.com/mongodb/mongo/commit/e7181b542b25981db42f74cdaee4e7fc323d3e9d

            People

            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:
                Days since reply:
                1 year, 21 weeks, 2 days ago
                Date of 1st Reply: