Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-2953

Test format failure - stuck cache with 1/42MB dirty

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • WT2.9.0, 3.2.11, 3.4.0-rc3
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None
    • Storage 2016-11-21

      Run was on zSeries and failed with the following error on the tip of develop (6775c3401a4e51aeff02c0f369ba7a8a0b9af633)

      [1475808552:167916][37779:0x3ff877ff910], t, eviction-server: Cache stuck for too long, giving up: Connection timed out
      ==========
      cache dump
      file:wt.wt(<live>): 
      	internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      	leaf: 20 pages, 2MB, 14/6 clean/dirty pages, 0/1 clean/dirty MB, 0MB max page, 0MB max dirty page
      file:WiredTigerLAS.wt(<live>): 
      	internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      	leaf: 7 pages, 0MB, 7/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      file:WiredTiger.wt(<live>): 
      	internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      	leaf: 1 pages, 0MB, 1/0 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      cache dump: total found = 2MB vs tracked inuse 5MB
      total dirty bytes = 1MB
      ==========
      [1475808552:168023][37779:0x3ff877ff910], t, eviction-server: cache eviction thread error: Connection timed out
      [1475808552:168026][37779:0x3ff877ff910], t, eviction-server: the process must exit and restart: WT_PANIC: WiredTiger library panic
      [1475808552:168028][37779:0x3ff877ff910], t, eviction-server: aborting WiredTiger library
      

      Config:

      ############################################
      #  RUN PARAMETERS
      ############################################
      abort=0
      auto_throttle=1
      backups=1
      bitcnt=5
      bloom=1
      bloom_bit_count=34
      bloom_hash_count=15
      bloom_oldest=0
      cache=42
      checkpoints=1
      checksum=uncompressed
      chunk_size=4
      compaction=0
      compression=zlib
      data_extend=0
      data_source=table
      delete_pct=31
      dictionary=0
      direct_io=0
      encryption=none
      evict_max=2
      file_type=variable-length column-store
      firstfit=0
      huffman_key=0
      huffman_value=0
      in_memory=0
      insert_pct=25
      internal_key_truncation=1
      internal_page_max=16
      isolation=read-uncommitted
      key_gap=0
      key_max=99
      key_min=22
      leaf_page_max=15
      leak_memory=0
      logging=0
      logging_archive=1
      logging_compression=none
      logging_prealloc=0
      long_running_txn=0
      lsm_worker_threads=3
      merge_max=18
      mmap=1
      ops=100000
      prefix_compression=0
      prefix_compression_min=3
      quiet=1
      repeat_data_pct=29
      reverse=0
      rows=100000
      runs=100
      rebalance=1
      salvage=1
      split_pct=41
      statistics=0
      statistics_server=0
      threads=10
      timer=20
      transaction-frequency=9
      value_max=2641
      value_min=19
      verify=1
      wiredtiger_config=
      write_pct=60
      ############################################
      

      Run:
      http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-zseries/11362/consoleFull

      Michael attempted reproduction, but the issue did not reproduce readily on x86.

            Assignee:
            david.hows David Hows
            Reporter:
            david.hows David Hows
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: