Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-1063

LSM compact improvements

    XMLWordPrintable

    Details

    • Type: Task
    • Status: Closed
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: WT2.2.1
    • Component/s: None
    • Labels:
      None

      Description

      I'm seeing two things when I try to run medium-lsm-compact.wtperf (after WT-1053):

      1. There is an active chunk in the tree when compact starts. We don't do anything to force it to disk until the connection is closed after the compact. Then when we reopen in read-only mode, we get aggressive and merge all over again, just to get this one small chunk merged into the tree.
      2. Compact sometimes gives up early. I think what happens is that the merging thread gets stuck somewhere outside the main loop (like closing the bulk cursor and writing all the internal nodes for a merged chunk). That doesn't increment the merge activity counter, so compact thinks that merges are done.

      I don't like my solution for 1 – wtperf can force this chunk to disk by closing and reopening the connection before the compact. A better solution would be for LSM compact to force all chunks to be on disk before kicking off the compaction.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                alexander.gorrod Alexander Gorrod
                Reporter:
                michael.cahill Michael Cahill
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: