Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-3239

Test format aborting with no dirty leaf pages and large numbers of dirty internal pages

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      We have seen a number of failures recently, where there have been 0 dirty leaf pages. And cache suck abort with only dirty internal pages.

      The following runs are examples of this:
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress/36063
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-ppc/9407

      Sample config:

      ############################################
      #  RUN PARAMETERS
      ############################################
      abort=0
      alter=0
      auto_throttle=1
      backups=0
      bitcnt=5
      bloom=1
      bloom_bit_count=48
      bloom_hash_count=28
      bloom_oldest=1
      cache=3
      checkpoints=1
      checksum=off
      chunk_size=4
      compaction=0
      compression=zlib
      data_extend=0
      data_source=table
      delete_pct=19
      dictionary=0
      direct_io=0
      encryption=rotn-7
      evict_max=4
      file_type=row-store
      firstfit=0
      huffman_key=0
      huffman_value=0
      in_memory=0
      insert_pct=26
      internal_key_truncation=1
      internal_page_max=9
      isolation=read-uncommitted
      key_gap=13
      key_max=256
      key_min=256
      leaf_page_max=9
      leak_memory=0
      logging=1
      logging_archive=0
      logging_compression=zlib-noraw
      logging_prealloc=0
      long_running_txn=0
      lsm_worker_threads=3
      merge_max=18
      mmap=1
      ops=100000
      prefix_compression=1
      prefix_compression_min=2
      quiet=1
      read_pct=50
      rebalance=1
      repeat_data_pct=23
      reverse=0
      rows=100000
      runs=1
      salvage=1
      split_pct=41
      statistics=0
      statistics_server=1
      threads=2
      timer=20
      transaction-frequency=27
      value_max=1240
      value_min=10
      verify=1
      wiredtiger_config=
      write_pct=5
      ############################################
      

      Example cache-dump output

      0x1145088:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x1145088:transaction state dump
      0x1145088:current ID: 44195
      0x1145088:last running ID: 44195
      0x1145088:oldest ID: 44195
      0x1145088:oldest named snapshot ID: 0
      0x1145088:checkpoint running? no
      0x1145088:checkpoint generation: 12
      0x1145088:checkpoint pinned ID: 0
      0x1145088:checkpoint txn ID: 0
      0x1145088:session count: 14
      0x1145088:Transaction state of active sessions:
      0x1145088:ID:      0, mod count: 0, pinned ID: 44195, snap min: 0, snap max: 0, metadata pinned ID: 44195, flags: 0x00000000, name: WT_CURSOR.prev, isolation: WT_ISO_READ_UNCOMMITTED
      0x1145088:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x1145088:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x1145088:cache dump
      0x1145088:file:wt.wt(checkpoint=WiredTigerCheckpoint.14):
      0x1145088:internal: 53 pages, 0MB, 53/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x1145088:leaf: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x1145088:file:wt.wt(<live>):
      0x1145088:internal: 216 pages, 2MB, 7/209 clean/dirty pages, 0/2 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x1145088:leaf: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x1145088:file:WiredTigerLAS.wt(<live>):
      0x1145088:internal: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x1145088:file:WiredTiger.wt(<live>):
      0x1145088:internal: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x1145088:cache dump: total found: 2MB vs tracked inuse 2MB
      0x1145088:total dirty bytes: 2MB
      0x1145088:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      

            Assignee:
            michael.cahill@mongodb.com Michael Cahill (Inactive)
            Reporter:
            david.hows David Hows
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: