Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-13956

cache stuck in linux-directio on 8.0

    • Type: Icon: Build Failure Build Failure
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • StorEng - Defined Pipeline

      linux-directio on ubuntu2004-arm64

      Host: i-0fa00a7e9065317b9
      Project: wiredtiger-mongo-v8.0
      Commit: 53e41b83

      Task Logs:

      linux-directio task_log

      Logs:

      d7a30b7fb WT-13670 Add import config support to not panic (#11130) (v8.0 backport) (#11173)
      
      

      logs

      linux-directio task_log

      Logs:

          [1734509784:170411][37513:0xffff81a1b1e0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_server, 498: Cache stuck for too long, giving up: Connection timed out
      
      

      logs

      linux-directio task_log

      Logs:

          0x2d698080:transaction state dump
          0x2d698080:current ID: 425972
          0x2d698080:last running ID: 425972
          0x2d698080:metadata_pinned ID: 276006
          0x2d698080:oldest ID: 425972
          0x2d698080:durable timestamp: (0, 416609)
          0x2d698080:oldest timestamp: (0, 416439)
          0x2d698080:pinned timestamp: (0, 416439)
          0x2d698080:stable timestamp: (0, 416439)
          0x2d698080:has_durable_timestamp: yes
          0x2d698080:has_oldest_timestamp: yes
          0x2d698080:has_pinned_timestamp: yes
          0x2d698080:has_stable_timestamp: yes
          0x2d698080:oldest_is_pinned: yes
          0x2d698080:stable_is_pinned: yes
          0x2d698080:checkpoint running: yes
          0x2d698080:checkpoint generation: 6
          0x2d698080:checkpoint pinned ID: 275747
          0x2d698080:checkpoint txn ID: 276006
          0x2d698080:session count: 53
          0x2d698080:Transaction state of active sessions:
          0x2d698080:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
          0x2d698080:cache dump
          0x2d698080:cache full: no
          0x2d698080:cache clean check: no (30.801%)
          0x2d698080:cache dirty check: no (18.650%)
          0x2d698080:cache updates check: yes (10.145%)
          0x2d698080:file:T00003.wt(<live>):
          0x2d698080:internal: 21 pages, 957.22 KB, 1/20 clean/dirty pages, 4.00/953.22 clean / dirty KB, 78.68 KB max page, 78.68 KB max dirty page
          0x2d698080:leaf: 4141 pages, 24346.95 KB, 4141/0 clean/dirty pages, 24346.95 /0.00 /0.00 clean/dirty/updates KB, 6.82 KB max page, 0.00 KB max dirty page
          0x2d698080:file:T00002.wt(<live>):
          0x2d698080:internal: 196 pages, 5097.65 KB, 80/116 clean/dirty pages, 2174.78/2922.88 clean / dirty KB, 110.93 KB max page, 35.38 KB max dirty page
          0x2d698080:leaf: 26143 pages, 239285.24 KB, 400/25743 clean/dirty pages, 3434.86 /235850.38 /128310.27 clean/dirty/updates KB, 447.24 KB max page, 447.24 KB max dirty page
          0x2d698080:file:T00001.wt(<live>):
          0x2d698080:internal: 6 pages, 469.64 KB, 5/1 clean/dirty pages, 401.04/68.60 clean / dirty KB, 101.72 KB max page, 68.60 KB max dirty page
          0x2d698080:leaf: 1575 pages, 113506.32 KB, 1575/0 clean/dirty pages, 113506.32 /0.00 /0.00 clean/dirty/updates KB, 153.42 KB max page, 0.00 KB max dirty page
          0x2d698080:file:WiredTigerHS.wt(<live>):
          0x2d698080:internal: 1 pages, 49.41 KB, 0/1 clean/dirty pages, 0.00/49.41 clean / dirty KB, 49.41 KB max page, 49.41 KB max dirty page
          0x2d698080:leaf: 259 pages, 5851.14 KB, 258/1 clean/dirty pages, 5825.47 /25.66 /5.75 clean/dirty/updates KB, 100.41 KB max page, 25.66 KB max dirty page
          0x2d698080:file:WiredTiger.wt(<live>):
          0x2d698080:internal: 1 pages, 0.74 KB, 0/1 clean/dirty pages, 0.00/0.74 clean / dirty KB, 0.74 KB max page, 0.74 KB max dirty page
          0x2d698080:leaf: 1 pages, 9.87 KB, 0/1 clean/dirty pages, 0.00 /9.87 /2.16 clean/dirty/updates KB, 9.87 KB max page, 9.87 KB max dirty page
          0x2d698080:cache dump: total found: 410.88 MB vs tracked inuse 380.44 MB
          0x2d698080:total dirty bytes: 234.26 MB vs tracked dirty 234.26 MB
      

      logs

      linux-directio task_log

      Logs:

          [1734509784:179774][37513:0xffff81a1b1e0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 352: cache eviction thread error: Connection timed out
          [1734509784:179786][37513:0xffff81a1b1e0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_thread_run, 352: the process must exit and restart: WT_PANIC: WiredTiger library panic
          [1734509784:179791][37513:0xffff81a1b1e0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library
      

      logs

      linux-directio task_log

      Logs:

      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #1  0x0000ffff825c4aac in __GI_abort () at abort.c:79
      #2  0x0000ffff82950ab4 in __wt_abort (session=session@entry=0x2d698080) at /data/mci/9427e7459d8f19d027ac0f21187c1b70/wiredtiger/src/os_common/os_abort.c:30
      #3  0x0000ffff829dc4a4 in __wt_panic_func (session=session@entry=0x2d698080, error=error@entry=110, func=func@entry=0xffff82a3c440 <__PRETTY_FUNCTION__.18> "__evict_thread_run", line=line@entry=352, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0xffff82a3bfb8 "cache eviction thread error") at /data/mci/9427e7459d8f19d027ac0f21187c1b70/wiredtiger/src/support/err.c:570
      #4  0x0000ffff82907a20 in __evict_thread_run (session=0x2d698080, thread=0x2d66d690) at /data/mci/9427e7459d8f19d027ac0f21187c1b70/wiredtiger/src/evict/evict_lru.c:352
      #5  0x0000ffff829f21a8 in __thread_run (arg=0x2d66d690) at /data/mci/9427e7459d8f19d027ac0f21187c1b70/wiredtiger/src/support/thread_group.c:31
      #6  0x0000ffff8274a624 in start_thread (arg=0xffff829f2178 <__thread_run>) at pthread_create.c:477
      #7  0x0000ffff8267562c in thread_start () at ../sysdeps/unix/sysv/linux/aarch64/clone.S:78
      

      logs

            Assignee:
            backlog-server-storage-engines [DO NOT USE] Backlog - Storage Engines Team
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: