Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-9999

Cache stuck error on ARM

    • Type: Icon: Build Failure Build Failure
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:

      format-stress-test-3 on ubuntu2004-stress-tests-arm64

      Host: i-0fcde4e899aca17d5
      Project: wiredtiger
      Commit: 11db7cab

      Task Logs:

      format-stress-test-3 task_log

      Logs:

      Verbose Error message
          [1665753301:109821][244377:0xffffa35e2100], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_server, 473: Cache stuck for too long, giving up: Connection timed out
      
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_ubuntu2004_stress_tests_arm64_format_stress_test_3_11db7cabac9c7f147ddad9a3a30a5eac2cd0487f_22_10_14_07_25_47/0?type=T#L1324
      
      Cache Stuck Failures
          0x313ed5b8:transaction state dump
          0x313ed5b8:current ID: 12
          0x313ed5b8:last running ID: 12
          0x313ed5b8:metadata_pinned ID: 12
          0x313ed5b8:oldest ID: 12
          0x313ed5b8:durable timestamp: (0, 7085)
          0x313ed5b8:oldest timestamp: (0, 7084)
          0x313ed5b8:pinned timestamp: (0, 7084)
          0x313ed5b8:stable timestamp: (0, 7084)
          0x313ed5b8:has_durable_timestamp: yes
          0x313ed5b8:has_oldest_timestamp: yes
          0x313ed5b8:has_pinned_timestamp: yes
          0x313ed5b8:has_stable_timestamp: yes
          0x313ed5b8:oldest_is_pinned: yes
          0x313ed5b8:stable_is_pinned: yes
          0x313ed5b8:checkpoint running: no
          0x313ed5b8:checkpoint generation: 9
          0x313ed5b8:checkpoint pinned ID: 0
          0x313ed5b8:checkpoint txn ID: 0
          0x313ed5b8:session count: 12
          0x313ed5b8:Transaction state of active sessions:
          0x313ed5b8:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
          0x313ed5b8:cache dump
          0x313ed5b8:cache full: no
          0x313ed5b8:cache clean check: yes (95.800%)
          0x313ed5b8:cache dirty check: no (0.000%)
          0x313ed5b8:cache updates check: no (0.007%)
          0x313ed5b8:file:F00001(<live>):
          0x313ed5b8:internal: 3 pages, 96.34 KB, 3/0 clean/dirty pages, 96.34/0.00 clean / dirty KB, 51.71 KB max page, 0.00 KB max dirty page
          0x313ed5b8:leaf: 316 pages, 36871.62 KB, 316/0 clean/dirty pages, 36871.62 /0.00 /0.00 clean/dirty/updates KB, 120.27 KB max page, 0.00 KB max dirty page
          0x313ed5b8:file:T00003.wt(<live>):
          0x313ed5b8:internal: 7 pages, 204.18 KB, 7/0 clean/dirty pages, 204.18/0.00 clean / dirty KB, 40.01 KB max page, 0.00 KB max dirty page
          0x313ed5b8:leaf: 230 pages, 54476.04 KB, 230/0 clean/dirty pages, 54476.04 /0.00 /0.00 clean/dirty/updates KB, 239.30 KB max page, 0.00 KB max dirty page
          0x313ed5b8:file:F00002(<live>):
          0x313ed5b8:internal: 9 pages, 8252.97 KB, 9/0 clean/dirty pages, 8252.97/0.00 clean / dirty KB, 1067.63 KB max page, 0.00 KB max dirty page
          0x313ed5b8:leaf: 0 pages
          0x313ed5b8:file:WiredTigerHS.wt(<live>) eviction disabled at open:
          0x313ed5b8:internal: 1 pages, 0.27 KB, 1/0 clean/dirty pages, 0.27/0.00 clean / dirty KB, 0.27 KB max page, 0.00 KB max dirty page
          0x313ed5b8:leaf: 0 pages
          0x313ed5b8:file:WiredTiger.wt(<live>):
          0x313ed5b8:internal: 1 pages, 0.61 KB, 1/0 clean/dirty pages, 0.61/0.00 clean / dirty KB, 0.61 KB max page, 0.00 KB max dirty page
          0x313ed5b8:leaf: 1 pages, 13.44 KB, 1/0 clean/dirty pages, 13.44 /0.00 /7.48 clean/dirty/updates KB, 13.44 KB max page, 0.00 KB max dirty page
          0x313ed5b8:cache dump: total found: 105.38 MB vs tracked inuse 97.57 MB
          0x313ed5b8:total dirty bytes: 0.00 MB vs tracked dirty 0.00 MB
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_ubuntu2004_stress_tests_arm64_format_stress_test_3_11db7cabac9c7f147ddad9a3a30a5eac2cd0487f_22_10_14_07_25_47/0?type=T#L1326
      
      Verbose Error message
          [1665753301:111000][244377:0xffffa35e2100], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 324: cache eviction thread error: Connection timed out
          [1665753301:111009][244377:0xffffa35e2100], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 324: the process must exit and restart: WT_PANIC: WiredTiger library panic
          [1665753301:111014][244377:0xffffa35e2100], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_ubuntu2004_stress_tests_arm64_format_stress_test_3_11db7cabac9c7f147ddad9a3a30a5eac2cd0487f_22_10_14_07_25_47/0?type=T#L1371
      
      Failure keywords
          /data/mci/0e2f7ea64eaaca80ac3bf52f39a53de8/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.11.0.1(__wt_panic_func+0x168)[0xffffa763ada4]
      #3  0x0000ffffa763ada4 in __wt_panic_func (session=session@entry=0x313ed5b8, error=error@entry=110, func=func@entry=0xffffa7698590 <__PRETTY_FUNCTION__.38837> "__wt_evict_thread_run", line=line@entry=324, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0xffffa7698ab0 "cache eviction thread error") at ../src/support/err.c:570
      Link: https://evergreen.mongodb.com/task_log_raw/wiredtiger_ubuntu2004_stress_tests_arm64_format_stress_test_3_11db7cabac9c7f147ddad9a3a30a5eac2cd0487f_22_10_14_07_25_47/0?type=T#L1380
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: