Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-12413

Assertion on config servers

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical - P2 Critical - P2
    • None
    • 2.4.8
    • Replication
    • None
    • centos, vmware, nexgen
    • ALL
    • Hide

      had major san outages and this started showing.

      Show
      had major san outages and this started showing.

    Description

      Mon Jan 20 16:35:48.110 [conn2699] update config.mongos query:

      { _id: "render-mu04.colo:27017" }

      update: { $set:

      { ping: new Date(1390253748104), up: 111620, waiting: true, mongoVersion: "2.4.8" }

      } idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:17346 8ms
      Mon Jan 20 16:35:48.149 [conn2707] end connection 10.84.150.185:53977 (20 connections now open)
      Mon Jan 20 16:35:48.286 [conn2709] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xde05e1 0xda15bd 0xab95c1 0xa72524 0xa6b229 0xa8e021 0xa914e5 0xa93847 0x9f6b78 0x9fc0f8 0x6e83a8 0xdccbae 0x3ef9407851 0x3ef90e894d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]
      /usr/bin/mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xda15bd]
      /usr/bin/mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab95c1]
      /usr/bin/mongod() [0xa72524]
      /usr/bin/mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa6b229]
      /usr/bin/mongod() [0xa8e021]
      /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa914e5]
      /usr/bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa93847]
      /usr/bin/mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f6b78]
      /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9fc0f8]
      /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e83a8]
      /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdccbae]
      /lib64/libpthread.so.0() [0x3ef9407851]
      /lib64/libc.so.6(clone+0x6d) [0x3ef90e894d]
      Mon Jan 20 16:35:48.294 [conn2709] update config.mongos query:

      { _id: "render-mu02.colo:27017" }

      update: { $set:

      { ping: new Date(1390253748288), up: 111618, waiting: false, mongoVersion: "2.4.8" }

      } idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:17495 8ms
      Mon Jan 20 16:35:48.296 [conn2709] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xde05e1 0xda15bd 0xab95c1 0xa72524 0xa6b229 0xa8e021 0xa914e5 0xa93847 0x9f6b78 0x9fc0f8 0x6e83a8 0xdccbae 0x3ef9407851 0x3ef90e894d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]
      /usr/bin/mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xda15bd]
      /usr/bin/mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab95c1]
      /usr/bin/mongod() [0xa72524]
      /usr/bin/mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa6b229]
      /usr/bin/mongod() [0xa8e021]
      /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa914e5]
      /usr/bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa93847]
      /usr/bin/mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f6b78]
      /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9fc0f8]
      /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e83a8]
      /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdccbae]
      /lib64/libpthread.so.0() [0x3ef9407851]
      /lib64/libc.so.6(clone+0x6d) [0x3ef90e894d]
      Mon Jan 20 16:35:48.305 [conn2709] update config.mongos query:

      { _id: "render-mu02.colo:27017" }

      update: { $set:

      { ping: new Date(1390253748298), up: 111618, waiting: true, mongoVersion: "2.4.8" }

      } idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:17230 8ms
      Mon Jan 20 16:35:49.004 [conn2709] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xde05e1 0xda15bd 0xab95c1 0xa72524 0xa6b229 0xa90f18 0xa93847 0x9f6b78 0x9fc0f8 0x6e83a8 0xdccbae 0x3ef9407851 0x3ef90e894d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]
      /usr/bin/mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xda15bd]
      /usr/bin/mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab95c1]
      /usr/bin/mongod() [0xa72524]
      /usr/bin/mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa6b229]
      /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2768) [0xa90f18]
      /usr/bin/mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa93847]
      /usr/bin/mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f6b78]
      /usr/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9fc0f8]
      /usr/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e83a8]
      /usr/bin/mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdccbae]
      /lib64/libpthread.so.0() [0x3ef9407851]
      /lib64/libc.so.6(clone+0x6d) [0x3ef90e894d]
      Mon Jan 20 16:35:49.012 [conn2709] update config.lockpings query:

      { _id: "render-mu02.colo:27017:1390142130:1804289383" }

      update: { $set:

      { ping: new Date(1390253748931) }

      } nscanned:1 keyUpdates:1 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:16427 8ms
      Mon Jan 20 16:35:49.074 [conn2709] end connection 10.84.150.182:40943 (19 connections now open)
      Mon Jan 20 16:35:50.544 [replmaster] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xde05e1 0xda15bd 0xab95c1 0xa72524 0xa6b872 0xb8d045 0xe28e69 0x3ef9407851 0x3ef90e894d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xde05e1]

      Attachments

        Activity

          People

            bruce.lucas@mongodb.com Bruce Lucas (Inactive)
            ilasic igor lasic
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: