Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-9997

Cache stuck on PPC

    • Type: Icon: Build Failure Build Failure
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:

      format-stress-sanitizer-ppc-test-1 on rhel8-ppc

      Host: rhel81-ppc-7.pic.build.10gen.cc
      Project: wiredtiger
      Commit: f0393bc1

      Task Logs:

      format-stress-sanitizer-ppc-test-1 task_log

      Logs:

      Verbose Error message
          [1665720088:974352][13448:0x7fff908af170], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_server, 473: Cache stuck for too long, giving up: Connection timed out
      
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_rhel8_ppc_format_stress_sanitizer_ppc_test_1_f0393bc13fd194ccc8347e066d278849a8aed128_22_10_13_23_17_31/0?type=T#L1253
      
      Cache Stuck Failures
          0x10002a28d78:transaction state dump
          0x10002a28d78:current ID: 14
          0x10002a28d78:last running ID: 14
          0x10002a28d78:metadata_pinned ID: 14
          0x10002a28d78:oldest ID: 14
          0x10002a28d78:durable timestamp: (0, 8045)
          0x10002a28d78:oldest timestamp: (0, 8044)
          0x10002a28d78:pinned timestamp: (0, 8044)
          0x10002a28d78:stable timestamp: (0, 8044)
          0x10002a28d78:has_durable_timestamp: yes
          0x10002a28d78:has_oldest_timestamp: yes
          0x10002a28d78:has_pinned_timestamp: yes
          0x10002a28d78:has_stable_timestamp: yes
          0x10002a28d78:oldest_is_pinned: yes
          0x10002a28d78:stable_is_pinned: yes
          0x10002a28d78:checkpoint running: no
          0x10002a28d78:checkpoint generation: 11
          0x10002a28d78:checkpoint pinned ID: 0
          0x10002a28d78:checkpoint txn ID: 0
          0x10002a28d78:session count: 15
          0x10002a28d78:Transaction state of active sessions:
          0x10002a28d78:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
          0x10002a28d78:cache dump
          0x10002a28d78:cache full: no
          0x10002a28d78:cache clean check: yes (95.125%)
          0x10002a28d78:cache dirty check: no (0.000%)
          0x10002a28d78:cache updates check: no (0.007%)
          0x10002a28d78:file:T00002.wt(<live>):
          0x10002a28d78:internal: 37 pages, 25824.96 KB, 37/0 clean/dirty pages, 25824.96/0.00 clean / dirty KB, 761.52 KB max page, 0.00 KB max dirty page
          0x10002a28d78:leaf: 31494 pages, 51647.95 KB, 31494/0 clean/dirty pages, 51647.95 /0.00 /0.00 clean/dirty/updates KB, 2.77 KB max page, 0.00 KB max dirty page
          0x10002a28d78:file:T00001.wt(<live>):
          0x10002a28d78:internal: 255 pages, 22937.81 KB, 255/0 clean/dirty pages, 22937.81/0.00 clean / dirty KB, 127.32 KB max page, 0.00 KB max dirty page
          0x10002a28d78:leaf: 0 pages
          0x10002a28d78:file:T00003.wt(<live>):
          0x10002a28d78:internal: 58 pages, 7805.42 KB, 58/0 clean/dirty pages, 7805.42/0.00 clean / dirty KB, 162.32 KB max page, 0.00 KB max dirty page
          0x10002a28d78:leaf: 0 pages
          0x10002a28d78:file:WiredTigerHS.wt(<live>) eviction disabled at open:
          0x10002a28d78:internal: 1 pages, 0.27 KB, 1/0 clean/dirty pages, 0.27/0.00 clean / dirty KB, 0.27 KB max page, 0.00 KB max dirty page
          0x10002a28d78:leaf: 0 pages
          0x10002a28d78:file:WiredTiger.wt(<live>):
          0x10002a28d78:internal: 1 pages, 0.61 KB, 1/0 clean/dirty pages, 0.61/0.00 clean / dirty KB, 0.61 KB max page, 0.00 KB max dirty page
          0x10002a28d78:leaf: 1 pages, 14.42 KB, 1/0 clean/dirty pages, 14.42 /0.00 /7.53 clean/dirty/updates KB, 14.42 KB max page, 0.00 KB max dirty page
          0x10002a28d78:cache dump: total found: 114.15 MB vs tracked inuse 105.69 MB
          0x10002a28d78:total dirty bytes: 0.00 MB vs tracked dirty 0.00 MB
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_rhel8_ppc_format_stress_sanitizer_ppc_test_1_f0393bc13fd194ccc8347e066d278849a8aed128_22_10_13_23_17_31/0?type=T#L1255
      
      Verbose Error message
          [1665720089:34257][13448:0x7fff908af170], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 324: cache eviction thread error: Connection timed out
          [1665720089:34303][13448:0x7fff908af170], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 324: the process must exit and restart: WT_PANIC: WiredTiger library panic
          [1665720089:34324][13448:0x7fff908af170], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_rhel8_ppc_format_stress_sanitizer_ppc_test_1_f0393bc13fd194ccc8347e066d278849a8aed128_22_10_13_23_17_31/0?type=T#L1300
      
      Failure keywords
      #3  0x00007fff933b7b94 in __wt_panic_func (session=0x10002a28d78, error=<optimized out>, func=0x7fff93425210 <__PRETTY_FUNCTION__.19129> "__wt_evict_thread_run", line=<optimized out>, category=<optimized out>, fmt=<optimized out>) at ../src/support/err.c:570
      
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_rhel8_ppc_format_stress_sanitizer_ppc_test_1_f0393bc13fd194ccc8347e066d278849a8aed128_22_10_13_23_17_31/0?type=T#L1691
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: