Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-20677

Failed collMod during replication results in fassert shutdown

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Duplicate
    • Affects Version/s: 3.1.8
    • Fix Version/s: None
    • Component/s: Replication
    • Labels:
      None
    • Backwards Compatibility:
      Fully Compatible
    • Operating System:
      ALL

      Description

      State at time of failure:
      • cloud-dev-0, PRIMARY, mmapv1, 3.0.6
      • cloud-dev-1, SECONDARY, mmapv1, 3.1.8
      • cloud-dev-2, STARTUP2, wt, 3.1.8
      Log Snippet

      2015-09-28T22:29:57.211+0000 E REPL     [repl writer worker 0] failed to apply update: { ts: Timestamp 1443455631000|18, h: -9014016430135857895, v: 2, op: "u", ns: "mmsdbjobs.data.jobsProcessor", o2: { _id: ObjectId('56096289e4b0e5c46d2025c3') }, o: { $set: { expireAt: new Date(1443459111840), updated: 1443455631840, status: "COMPLETED" } } }
      2015-09-28T22:29:57.211+0000 I REPL     [repl writer worker 0] adding missing object
      2015-09-28T22:29:57.271+0000 I REPL     [repl writer worker 0] missing object not found on source. presumably deleted later in oplog
      2015-09-28T22:29:57.271+0000 I REPL     [repl writer worker 0] o2: { _id: ObjectId('56096289e4b0e5c46d2025c3') }
      2015-09-28T22:29:57.271+0000 I REPL     [repl writer worker 0] o firstfield: $set
      2015-09-28T22:29:57.285+0000 E REPL     [repl writer worker 4] failed to apply update: { ts: Timestamp 1443455664000|17, h: 6934536607052632399, v: 2, op: "u", ns: "mmsdbconfig.config.agentSessions", o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }, o: { $set: { lud: new Date(1443455664494), uc: 6393 } } }
      2015-09-28T22:29:57.285+0000 I REPL     [repl writer worker 4] adding missing object
      2015-09-28T22:29:57.317+0000 I REPL     [repl writer worker 4] missing object not found on source. presumably deleted later in oplog
      2015-09-28T22:29:57.317+0000 I REPL     [repl writer worker 4] o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }
      2015-09-28T22:29:57.317+0000 I REPL     [repl writer worker 4] o firstfield: $set
      2015-09-28T22:29:57.452+0000 E REPL     [repl writer worker 10] failed to apply update: { ts: Timestamp 1443455719000|198, h: 849378850158100444, v: 2, op: "u", ns: "mmsdbconfig.config.agentSessions", o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }, o: { $set: { lud: new Date(1443455719516), uc: 6394 } } }
      2015-09-28T22:29:57.452+0000 I REPL     [repl writer worker 10] adding missing object
      2015-09-28T22:29:57.505+0000 I REPL     [repl writer worker 10] missing object not found on source. presumably deleted later in oplog
      2015-09-28T22:29:57.505+0000 I REPL     [repl writer worker 10] o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }
      2015-09-28T22:29:57.505+0000 I REPL     [repl writer worker 10] o firstfield: $set
      2015-09-28T22:29:57.625+0000 E REPL     [repl writer worker 4] failed to apply update: { ts: Timestamp 1443455774000|625, h: -8965142833625862340, v: 2, op: "u", ns: "mmsdbconfig.config.agentSessions", o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }, o: { $set: { lud: new Date(1443455774497), uc: 6395 } } }
      2015-09-28T22:29:57.625+0000 I REPL     [repl writer worker 4] adding missing object
      2015-09-28T22:29:57.678+0000 I REPL     [repl writer worker 4] missing object not found on source. presumably deleted later in oplog
      2015-09-28T22:29:57.678+0000 I REPL     [repl writer worker 4] o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }
      2015-09-28T22:29:57.678+0000 I REPL     [repl writer worker 4] o firstfield: $set
      2015-09-28T22:29:57.882+0000 E REPL     [repl writer worker 5] failed to apply update: { ts: Timestamp 1443455829000|608, h: 6458318593359235959, v: 2, op: "u", ns: "mmsdbconfig.config.agentSessions", o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }, o: { $set: { lud: new Date(1443455829500), uc: 6396 } } }
      2015-09-28T22:29:57.882+0000 I REPL     [repl writer worker 5] adding missing object
      2015-09-28T22:29:57.918+0000 I REPL     [repl writer worker 5] missing object not found on source. presumably deleted later in oplog
      2015-09-28T22:29:57.919+0000 I REPL     [repl writer worker 5] o2: { _id: "grabar-0.grabar-test.55d2398ce4b0b44f5b06273b.mongo.plumbing-44c2b15f292bece3cc3fb87c9bee564c-5421c55ce4b0aa879d8b8328" }
      2015-09-28T22:29:57.919+0000 I REPL     [repl writer worker 5] o firstfield: $set
      2015-09-28T22:29:57.936+0000 E REPL     [repl writer worker 6] Failed command { collMod: "data.rrd", noPadding: true, usePowerOf2Sizes: false } on mmsdbrrd-raw-dbs-PT5S-PT2H-20150928T1555 with status NamespaceNotFound ns does not exist during oplog application
      2015-09-28T22:29:57.936+0000 I REPL     [repl writer worker 6] adding missing object
      2015-09-28T22:29:57.958+0000 F REPL     [repl writer worker 6] cannot fetch missing document without _id field: { ts: Timestamp 1443455834000|31, h: -7038049490327803840, v: 2, op: "c", ns: "mmsdbrrd-raw-dbs-PT5S-PT2H-20150928T1555.$cmd", o: { collMod: "data.rrd", noPadding: true, usePowerOf2Sizes: false } }
      2015-09-28T22:29:57.958+0000 I -        [repl writer worker 6] Fatal Assertion 28742
      2015-09-28T22:29:57.958+0000 I -        [repl writer worker 6] 
       
      ***aborting after fassert() failure
      

      Full Logs

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              siyuan.zhou Siyuan Zhou
              Reporter:
              cailin.nelson Cailin Nelson
              Participants:
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: