Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-11112

format cache stuck - cache full clean (no updates)

    • Type: Icon: Build Failure Build Failure
    • Resolution: Cannot Reproduce
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • 8
    • 2023-06-27 Lord of the Sprints

      format-stress-test-1 on ubuntu2004-stress-tests-arm64

      Host: i-0d59825468a037323
      Project: wiredtiger-mongo-v6.0
      Commit: 65c2075c

      Task Logs:

      format-stress-test-1 task_log

      Logs:

          [1684818109:115929][18453:0xffff970961c0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __evict_server, 473: Cache stuck for too long, giving up: Connection timed out
      
      

      logs

      format-stress-test-1 task_log

      Logs:

          0x1690cb20:transaction state dump
          0x1690cb20:current ID: 2
          0x1690cb20:last running ID: 2
          0x1690cb20:metadata_pinned ID: 2
          0x1690cb20:oldest ID: 2
          0x1690cb20:durable timestamp: (0, 1)
          0x1690cb20:oldest timestamp: (0, 1)
          0x1690cb20:pinned timestamp: (0, 1)
          0x1690cb20:stable timestamp: (0, 1)
          0x1690cb20:has_durable_timestamp: yes
          0x1690cb20:has_oldest_timestamp: yes
          0x1690cb20:has_pinned_timestamp: yes
          0x1690cb20:has_stable_timestamp: yes
          0x1690cb20:oldest_is_pinned: yes
          0x1690cb20:stable_is_pinned: no
          0x1690cb20:checkpoint running: no
          0x1690cb20:checkpoint generation: 2
          0x1690cb20:checkpoint pinned ID: 0
          0x1690cb20:checkpoint txn ID: 0
          0x1690cb20:session count: 15
          0x1690cb20:Transaction state of active sessions:
          0x1690cb20:=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=
          0x1690cb20:cache dump
          0x1690cb20:cache full: yes
          0x1690cb20:cache clean check: yes (127.324%)
          0x1690cb20:cache dirty check: no (0.000%)
          0x1690cb20:cache updates check: no (0.000%)
          0x1690cb20:file:T00001.wt(<live>) eviction disabled at open:
          0x1690cb20: handle opened exclusively, cannot walk tree, skipping
          0x1690cb20:file:WiredTigerHS.wt(<live>):
          0x1690cb20:internal: 1 pages, 0.56 KB, 1/0 clean/dirty pages, 0.56/0.00 clean / dirty KB, 0.56 KB max page, 0.00 KB max dirty page
          0x1690cb20:leaf: 0 pages
          0x1690cb20:file:WiredTiger.wt(<live>):
          0x1690cb20:internal: 1 pages, 0.60 KB, 1/0 clean/dirty pages, 0.60/0.00 clean / dirty KB, 0.60 KB max page, 0.00 KB max dirty page
          0x1690cb20:leaf: 0 pages
          0x1690cb20:cache dump: total found: 0.00 MB vs tracked inuse 259.36 MB
          0x1690cb20:total dirty bytes: 0.00 MB vs tracked dirty 259.36 MB
      

      logs

      format-stress-test-1 task_log

      Logs:

          [1684818109:116040][18453:0xffff970961c0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 324: cache eviction thread error: Connection timed out
          [1684818109:116044][18453:0xffff970961c0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_evict_thread_run, 324: the process must exit and restart: WT_PANIC: WiredTiger library panic
          [1684818109:116048][18453:0xffff970961c0], t, eviction-server: [WT_VERB_DEFAULT][ERROR]: __wt_abort, 28: aborting WiredTiger library
      

      logs

      format-stress-test-1 task_log

      Logs:

          /data/mci/95db87d644da9e5643b1a9d94392e33b/wiredtiger/cmake_build/test/format/../../libwiredtiger.so.10.0.2(__wt_panic_func+0x158)[0xffff9bfe2808]
      #3  0x0000ffff9bfe2808 in __wt_panic_func (session=session@entry=0x1690cb20, error=error@entry=110, func=func@entry=0xffff9c03a340 <__PRETTY_FUNCTION__.38509> "__wt_evict_thread_run", line=line@entry=324, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0xffff9c03a830 "cache eviction thread error") at ../src/support/err.c:550
      #3  0x0000ffff9510d808 in __wt_panic_func (session=session@entry=0x37651080, error=error@entry=2, func=func@entry=0xffff95170808 <__PRETTY_FUNCTION__.38501> "__reconcile", line=line@entry=351, category=category@entry=WT_VERB_DEFAULT, fmt=fmt@entry=0xffff95171008 "reconciliation failed after building the disk image") at ../src/support/err.c:550
      

      logs

            Assignee:
            siddhartha.mahajan@mongodb.com Sid Mahajan
            Reporter:
            Xgen-BuildBaron-User xgen-buildbaron-user
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: