Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-37236

MongoDB 4.0 Invariant when rolling back committed writes.

    • Type: Icon: Improvement Improvement
    • Resolution: Unresolved
    • Priority: Icon: Minor - P4 Minor - P4
    • None
    • Affects Version/s: 4.0.2
    • Component/s: Replication
    • Labels:
      None
    • Replication

      Rolling back majority committed writes in MongoDB 4.0 results in an invariant / crash.

      This should likely be handled in a more user friendly way and issue some sort of warning.

      Unable to find source-code formatter for language: text. Available languages are: actionscript, ada, applescript, bash, c, c#, c++, cpp, css, erlang, go, groovy, haskell, html, java, javascript, js, json, lua, none, nyan, objc, perl, php, python, r, rainbow, ruby, scala, sh, sql, swift, visualbasic, xml, yaml
      2018-09-06T16:39:43.080-0500 E STORAGE  [rsBackgroundSync] WiredTiger error (22) [1536269983:80513][32583:0x700005968000], WT_CONNECTION.set_timestamp: __wt_txn_global_set_timestamp, 488: set_timestamp: oldest timestamp 5b919e5b000001d8 must not be later than commit timestamp 5b919e4700000001: Invalid argument Raw: [1536269983:80513][32583:0x700005968000], WT_CONNECTION.set_timestamp: __wt_txn_global_set_timestamp, 488: set_timestamp: oldest timestamp 5b919e5b000001d8 must not be later than commit timestamp 5b919e4700000001: Invalid argument
      2018-09-06T16:39:43.081-0500 F -        [rsBackgroundSync] Invariant failure: conn->set_timestamp(conn, commitTSConfigString) resulted in status BadValue: 22: Invalid argument at src/mongo/db/storage/wiredtiger/wiredtiger_record_store.cpp 1789
      2018-09-06T16:39:43.081-0500 F -        [rsBackgroundSync]
      
      ***aborting after invariant() failure
      
      
      2018-09-06T16:39:43.087-0500 F -        [rsBackgroundSync] Got signal: 6 (Abort trap: 6).
       0x10568b359 0x10568ac2d 0x7fff7a311f5a 0xd5872bfe 0x7fff7a0af1ae 0x105681365 0x103fdcd36 0x1044e8c90 0x1041b578c 0x1041b4ac2 0x104247873 0x10422601b 0x104225106 0x1042240a8 0x1042217cf 0x104221528 0x104227a10 0x7fff7a31b661 0x7fff7a31b50d 0x7fff7a31abf9
      .....
       mongod(_ZN5mongo12_GLOBAL__N_110abruptQuitEi+0xBD) [0x10568ac2d]
       libsystem_platform.dylib(_sigtramp+0x1A) [0x7fff7a311f5a]
       ??? [0xd5872bfe]
       libsystem_c.dylib(abort+0x7F) [0x7fff7a0af1ae]
       mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0x2F5) [0x105681365]
       mongod(_ZN5mongo21WiredTigerRecordStore19cappedTruncateAfterEPNS_16OperationContextENS_8RecordIdEb+0x1126) [0x103fdcd36]
       mongod(_ZN5mongo14CollectionImpl19cappedTruncateAfterEPNS_16OperationContextENS_8RecordIdEb+0xE0) [0x1044e8c90]
       mongod(_ZN5mongo4repl23ReplicationRecoveryImpl16_truncateOplogToEPNS_16OperationContextENS_9TimestampE+0x4BC) [0x1041b578c]
       mongod(_ZN5mongo4repl23ReplicationRecoveryImpl16recoverFromOplogEPNS_16OperationContextEN5boost8optionalINS_9TimestampEEE+0x1B2) [0x1041b4ac2]
       mongod(_ZN5mongo4repl12RollbackImpl11runRollbackEPNS_16OperationContextE+0x903) [0x104247873]
       mongod(_ZN5mongo4repl14BackgroundSync34_runRollbackViaRecoverToCheckpointEPNS_16OperationContextERKNS_11HostAndPortEPNS0_14OplogInterfaceEPNS0_16StorageInterfaceENSt3__18functionIFPNS_12DBClientBaseEvEEE+0x29B) [0x10422601b]
       mongod(_ZN5mongo4repl14BackgroundSync12_runRollbackEPNS_16OperationContextERKNS_6StatusERKNS_11HostAndPortEiPNS0_16StorageInterfaceE+0x5C6) [0x104225106]
       mongod(_ZN5mongo4repl14BackgroundSync8_produceEv+0x1F08) [0x1042240a8]
       mongod(_ZN5mongo4repl14BackgroundSync12_runProducerEv+0xEF) [0x1042217cf]
       mongod(_ZN5mongo4repl14BackgroundSync4_runEv+0x3B8) [0x104221528]
       mongod(_ZNSt3__114__thread_proxyINS_5tupleIJZN5mongo4repl14BackgroundSync7startupEPNS2_16OperationContextEE3$_4EEEEEPvS9_+0x60) [0x104227a10]
       libsystem_pthread.dylib(_pthread_body+0x154) [0x7fff7a31b661]
       libsystem_pthread.dylib(_pthread_body+0x0) [0x7fff7a31b50d]
       libsystem_pthread.dylib(thread_start+0xD) [0x7fff7a31abf9]
      -----  END BACKTRACE  -----
      

            Assignee:
            backlog-server-repl [DO NOT USE] Backlog - Replication Team
            Reporter:
            kevin.arhelger@mongodb.com Kevin Arhelger
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated: