[SERVER-37236] MongoDB 4.0 Invariant when rolling back committed writes. Created: 20/Sep/18  Updated: 06/Dec/22

Status: Backlog
Project: Core Server
Component/s: Replication
Affects Version/s: 4.0.2
Fix Version/s: None

Type: Improvement Priority: Minor - P4
Reporter: Kevin Arhelger Assignee: Backlog - Replication Team
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Assigned Teams:
Replication
Participants:

 Description   

Rolling back majority committed writes in MongoDB 4.0 results in an invariant / crash.

This should likely be handled in a more user friendly way and issue some sort of warning.

2018-09-06T16:39:43.080-0500 E STORAGE  [rsBackgroundSync] WiredTiger error (22) [1536269983:80513][32583:0x700005968000], WT_CONNECTION.set_timestamp: __wt_txn_global_set_timestamp, 488: set_timestamp: oldest timestamp 5b919e5b000001d8 must not be later than commit timestamp 5b919e4700000001: Invalid argument Raw: [1536269983:80513][32583:0x700005968000], WT_CONNECTION.set_timestamp: __wt_txn_global_set_timestamp, 488: set_timestamp: oldest timestamp 5b919e5b000001d8 must not be later than commit timestamp 5b919e4700000001: Invalid argument
2018-09-06T16:39:43.081-0500 F -        [rsBackgroundSync] Invariant failure: conn->set_timestamp(conn, commitTSConfigString) resulted in status BadValue: 22: Invalid argument at src/mongo/db/storage/wiredtiger/wiredtiger_record_store.cpp 1789
2018-09-06T16:39:43.081-0500 F -        [rsBackgroundSync]
 
***aborting after invariant() failure
 
 
2018-09-06T16:39:43.087-0500 F -        [rsBackgroundSync] Got signal: 6 (Abort trap: 6).
 0x10568b359 0x10568ac2d 0x7fff7a311f5a 0xd5872bfe 0x7fff7a0af1ae 0x105681365 0x103fdcd36 0x1044e8c90 0x1041b578c 0x1041b4ac2 0x104247873 0x10422601b 0x104225106 0x1042240a8 0x1042217cf 0x104221528 0x104227a10 0x7fff7a31b661 0x7fff7a31b50d 0x7fff7a31abf9
.....
 mongod(_ZN5mongo12_GLOBAL__N_110abruptQuitEi+0xBD) [0x10568ac2d]
 libsystem_platform.dylib(_sigtramp+0x1A) [0x7fff7a311f5a]
 ??? [0xd5872bfe]
 libsystem_c.dylib(abort+0x7F) [0x7fff7a0af1ae]
 mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0x2F5) [0x105681365]
 mongod(_ZN5mongo21WiredTigerRecordStore19cappedTruncateAfterEPNS_16OperationContextENS_8RecordIdEb+0x1126) [0x103fdcd36]
 mongod(_ZN5mongo14CollectionImpl19cappedTruncateAfterEPNS_16OperationContextENS_8RecordIdEb+0xE0) [0x1044e8c90]
 mongod(_ZN5mongo4repl23ReplicationRecoveryImpl16_truncateOplogToEPNS_16OperationContextENS_9TimestampE+0x4BC) [0x1041b578c]
 mongod(_ZN5mongo4repl23ReplicationRecoveryImpl16recoverFromOplogEPNS_16OperationContextEN5boost8optionalINS_9TimestampEEE+0x1B2) [0x1041b4ac2]
 mongod(_ZN5mongo4repl12RollbackImpl11runRollbackEPNS_16OperationContextE+0x903) [0x104247873]
 mongod(_ZN5mongo4repl14BackgroundSync34_runRollbackViaRecoverToCheckpointEPNS_16OperationContextERKNS_11HostAndPortEPNS0_14OplogInterfaceEPNS0_16StorageInterfaceENSt3__18functionIFPNS_12DBClientBaseEvEEE+0x29B) [0x10422601b]
 mongod(_ZN5mongo4repl14BackgroundSync12_runRollbackEPNS_16OperationContextERKNS_6StatusERKNS_11HostAndPortEiPNS0_16StorageInterfaceE+0x5C6) [0x104225106]
 mongod(_ZN5mongo4repl14BackgroundSync8_produceEv+0x1F08) [0x1042240a8]
 mongod(_ZN5mongo4repl14BackgroundSync12_runProducerEv+0xEF) [0x1042217cf]
 mongod(_ZN5mongo4repl14BackgroundSync4_runEv+0x3B8) [0x104221528]
 mongod(_ZNSt3__114__thread_proxyINS_5tupleIJZN5mongo4repl14BackgroundSync7startupEPNS2_16OperationContextEE3$_4EEEEEPvS9_+0x60) [0x104227a10]
 libsystem_pthread.dylib(_pthread_body+0x154) [0x7fff7a31b661]
 libsystem_pthread.dylib(_pthread_body+0x0) [0x7fff7a31b50d]
 libsystem_pthread.dylib(thread_start+0xD) [0x7fff7a31abf9]
-----  END BACKTRACE  -----


Generated at Thu Feb 08 04:45:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.