Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-961

Checkpoints can lose information

    XMLWordPrintableJSON

Details

    • Task
    • Status: Closed
    • Resolution: Done
    • None
    • WT2.2
    • None

    Description

      I have been running a new checkpoint test that verifies checkpoints by populating multiple tables with the same data. Then periodically checkpointing and verifying that all files have identical content.

      The test code is currently in pull request WT-959 - which is against the checkpoint-optimizations branch, but this issue is reproducible in the develop branch.

      The issue manifests as an error from the test code of the form:

      Key mismatch 1752007 from a ROW table is not 1934748 from a ROW table

      This means that one table has key 1752007 from a 

      ->next

      , and the other got a 1934748. The expectation is that both values are the same.

      After some debugging it appears as though:

      • The checkpoint on disk is also "missing" the data
      • The data is present in the table if read without a checkpoint
      • The same error occurs whether using a named or default checkpoint
      • There are no obvious memory corruptions leading to this issue
      • Looking at the internal tree structure in memory - it doesn't appear corrupted (this is also repeatable if opening another cursor on the same table/checkpoint, you'll see identical data)
      • This issue doesn't appear to be present in the 2.1.2 release - pointing towards a change in the new-split branch.

      Attachments

        Issue Links

          related to

          Task - A task that needs to be done. WT-1 placeholder WT-1

          • Closed

          Task - A task that needs to be done. WT-2 What does metadata look like?

          • Closed

          Task - A task that needs to be done. WT-3 What file formats are required?

          • Closed

          Task - A task that needs to be done. WT-4 Flexible cursor traversals

          • Closed

          Task - A task that needs to be done. WT-5 How does pget work: is it necessary?

          • Closed

          Task - A task that needs to be done. WT-6 Complex schema example

          • Closed

          Task - A task that needs to be done. WT-7 Do we need the handle->err/errx methods?

          • Closed

          Task - A task that needs to be done. WT-8 Do we need table load, bulk-load and/or dump methods?

          • Closed

          Task - A task that needs to be done. WT-9 Does adding schema need to be transactional?

          • Closed

          Task - A task that needs to be done. WT-10 Basic "getting started" tutorial

          • Closed

          Task - A task that needs to be done. WT-11 placeholder #11

          • Closed

          Task - A task that needs to be done. WT-12 Write more examples

          • Closed

          Task - A task that needs to be done. WT-13 Define supported platforms

          • Closed

          Task - A task that needs to be done. WT-14 Windows build

          • Closed

          Task - A task that needs to be done. WT-15 Automated build/test infrastructure

          • Closed

          Task - A task that needs to be done. WT-16 Test suite

          • Closed

          Task - A task that needs to be done. WT-17 Multithreaded tests

          • Closed

          Task - A task that needs to be done. WT-18 Coverage tests

          • Closed

          Task - A task that needs to be done. WT-19 Memory access / leak tests

          • Closed

          Task - A task that needs to be done. WT-20 API design

          • Closed

          Task - A task that needs to be done. WT-21 Record numbers in row stores

          • Closed

          Task - A task that needs to be done. WT-959 Checkpoint test

          • Closed

          Activity

            People

              alexander.gorrod@mongodb.com Alexander Gorrod
              alexander.gorrod@mongodb.com Alexander Gorrod
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: