Failed to promote a node to primary due to reconfigure returning WT_NOTFOUND

XMLWordPrintableJSON

    • Storage Engines, Storage Engines - Persistence
    • None
    • None

      The dev cluster for disagg in atlas is in a crash loop to promote the node to the primary.

      {"t":{"$date":"2025-09-10T14:16:19.564+00:00"},"s":"I", "c":"DISAGG", "id":10985322,"ctx":"Disagg-2","msg":"Got last completed checkpoint marker","attr":{"lastCheckpointMetadata":"metadata_lsn=7547801455260860553","lastCheckpointLsn":7547801455260860554,"stableTimestamp":{"$timestamp":{"t":1757359471,"i":1}}}}
{"t":{"$date":"2025-09-10T14:16:19.564+00:00"},"s":"I", "c":"DISAGG", "id":10985325,"ctx":"Disagg-2","msg":"Promoting Wiredtiger to leader"}
{"t":{"$date":"2025-09-10T14:16:19.681+00:00"},"s":"F", "c":"ASSERT", "id":23083, "ctx":"Disagg-2","msg":"Invariant failure","attr":{"expr":"_conn->reconfigure(_conn, leaderConfig)","error":"UnknownError: -31803: WT_NOTFOUND: item not found - ","location":"src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp:2355:5:virtual void mongo::WiredTigerKVEngine::promoteToLeader()"}}

            Assignee:
            Peter Macko
            Reporter:
            Chenhao Qu
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: