Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-5234

test/format failure, cache is stuck but is not full

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None

      The Jenkins job http://build.wiredtiger.com:8080/job/wiredtiger-test-format-stress-sanitizer/25144 failed with a stuck cache, but the cache is not full. It is about 60% full. This was run on kodkod-aws.

      [1573676717:102592][19456:0x7f5c07bf5700], t, eviction-server: __evict_server, 440: Cache stuck for too long, giving up: Connection timed out
      t: process 19456
      0x7f5c0ec6d160:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x7f5c0ec6d160:transaction state dump
      0x7f5c0ec6d160:current ID: 46146
      0x7f5c0ec6d160:last running ID: 46059
      0x7f5c0ec6d160:metadata_pinned ID: 46034
      0x7f5c0ec6d160:oldest ID: 46034
      0x7f5c0ec6d160:durable timestamp: (0,0)
      0x7f5c0ec6d160:oldest timestamp: (0,0)
      0x7f5c0ec6d160:pinned timestamp: (0,0)
      0x7f5c0ec6d160:stable timestamp: (0,0)
      0x7f5c0ec6d160:has_durable_timestamp: no
      0x7f5c0ec6d160:has_oldest_timestamp: no
      0x7f5c0ec6d160:has_pinned_timestamp: no
      0x7f5c0ec6d160:has_stable_timestamp: no
      0x7f5c0ec6d160:oldest_is_pinned: no
      0x7f5c0ec6d160:stable_is_pinned: no
      0x7f5c0ec6d160:checkpoint running: no
      0x7f5c0ec6d160:checkpoint generation: 16
      0x7f5c0ec6d160:checkpoint pinned ID: 0
      0x7f5c0ec6d160:checkpoint txn ID: 0
      0x7f5c0ec6d160:oldest named snapshot ID: 0
      0x7f5c0ec6d160:session count: 41
      0x7f5c0ec6d160:Transaction state of active sessions:
      0x7f5c0ec6d160:ID: 46059, pinned ID: 46034, metadata pinned ID: 0, name: EMPTY
      0x7f5c0ec6d160:transaction id: 46059, mod count: 2, snap min: 46034, snap max: 46036, snapshot count: 1, commit_timestamp: (0,0), durable_timestamp: (0,0), first_commit_timestamp: (0,0), prepare_timestamp: (0,0), read_timestamp: (0,0), checkpoint LSN: [0][0], full checkpoint: false, rollback reason: , flags: 0x0000200c, isolation: WT_ISO_SNAPSHOT
      0x7f5c0ec6d160:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
      0x7f5c0ec6d160:cache dump
      0x7f5c0ec6d160:cache full: no
      0x7f5c0ec6d160:cache clean check: no (37.329%)
      0x7f5c0ec6d160:cache dirty check: yes (23.258%)
      0x7f5c0ec6d160:file:wt.wt(<live>):
      0x7f5c0ec6d160:internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x7f5c0ec6d160:leaf: 88 pages, 22MB, 52/36 clean/dirty pages, 11/10 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x7f5c0ec6d160:file:WiredTigerLAS.wt(<live>):
      0x7f5c0ec6d160:internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x7f5c0ec6d160:leaf: 0 pages
      0x7f5c0ec6d160:file:WiredTiger.wt(<live>):
      0x7f5c0ec6d160:internal: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x7f5c0ec6d160:leaf: 1 pages, 0MB, 0/1 clean/dirty pages, 0/0 clean/dirty MB, 0MB max page, 0MB max dirty page
      0x7f5c0ec6d160:cache dump: total found: 24MB vs tracked inuse 34MB
      0x7f5c0ec6d160:total dirty bytes: 10MB
      [1573676717:103492][19456:0x7f5c07bf5700], t, eviction-server: __wt_evict_thread_run, 315: cache eviction thread error: Connection timed out
      [1573676717:103509][19456:0x7f5c07bf5700], t, eviction-server: __wt_panic, 490: the process must exit and restart: WT_PANIC: WiredTiger library panic
      [1573676717:103518][19456:0x7f5c07bf5700], t, eviction-server: __wt_abort, 28: aborting WiredTiger library
      

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            sue.loverso@mongodb.com Susan LoVerso
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: