Uploaded image for project: 'Documentation'
  1. Documentation
  2. DOCS-1807

ongo config server throw many exceptions

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major - P3 Major - P3
    • 01112017-cleanup
    • None
    • None
    • None

    Description

      mongos> db.runCommand({shardcollection:"kwlib.kwlib_tes8",key:{cat_id:1,word:1}})
      {
      "code" : 8017,
      "ok" : 0,
      "errmsg" : "exception: update not consistent ns: config.chunks query:

      { _id: \"kwlib.kwlib_tes8-cat_id_MinKeyword_MinKey\" }

      update: { _id: \"kwlib.kwlib_tes8-cat_id_MinKeyword_MinKey\", lastmod: Timestamp 1000|0, lastmodEpoch: ObjectId('5209d6e034b400779211aef6'), ns: \"kwlib.kwlib_tes8\", min:

      { cat_id: MinKey, word: MinKey }

      , max:

      { cat_id: MaxKey, word: MaxKey }

      , shard: \"shard0000\" } gle1:

      { updatedExisting: false, n: 1, lastOp: Timestamp 1376376544000|1, connectionId: 22, waited: 23, err: null, ok: 1.0 }

      gle2:

      { err: \"!loc.isNull()\", n: 0, connectionId: 20, waited: 44, ok: 1.0 }

      "
      }
      There are many exception in the mongo config server log file:
      /lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
      Tue Aug 13 16:22:06.490 [replmaster] caught exception in replMasterThread()
      Tue Aug 13 16:22:14.796 [conn21] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa678a9 0xa8a641 0xa8db05 0xa8fe67 0x9f2ff8 0x9f8588 0x6e8b68 0xdc659e 0x33c90064a7 0x33c84d3c2d
      mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
      mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
      mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
      mongod [0xa69fa4]
      mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa678a9]
      mongod [0xa8a641]
      mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa8db05]
      mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa8fe67]
      mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f2ff8]
      mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9f8588]
      mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e8b68]
      mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdc659e]
      /lib64/libpthread.so.0 [0x33c90064a7]
      /lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
      Tue Aug 13 16:22:18.173 [conn21] update config.mongos query:

      { _id: "localhost.localdomain:55555" }

      update: { $set:

      { ping: new Date(1376382134795), up: 23018, waiting: false, mongoVersion: "2.4.5" }

      } idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:17844 3377ms
      Tue Aug 13 16:22:18.514 [replmaster] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa68242 0xb88ce5 0xe225d9 0x33c90064a7 0x33c84d3c2d
      mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
      mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
      mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
      mongod [0xa69fa4]
      mongod(_ZN5mongo12logKeepaliveEv+0x42) [0xa68242]
      mongod [0xb88ce5]
      mongod [0xe225d9]
      /lib64/libpthread.so.0 [0x33c90064a7]
      /lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
      Tue Aug 13 16:22:20.416 [replmaster] caught exception in replMasterThread()
      Tue Aug 13 16:22:31.488 [conn21] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa678a9 0xa8a641 0xa8db05 0xa8fe67 0x9f2ff8 0x9f8588 0x6e8b68 0xdc659e 0x33c90064a7 0x33c84d3c2d
      mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
      mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
      mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
      mongod [0xa69fa4]
      mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa678a9]
      mongod [0xa8a641]
      mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa8db05]
      mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa8fe67]
      mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f2ff8]
      mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9f8588]
      mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e8b68]
      mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdc659e]
      /lib64/libpthread.so.0 [0x33c90064a7]
      /lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
      Tue Aug 13 16:22:31.734 [conn21] update config.mongos query:

      { _id: "localhost.localdomain:55555" }

      update: { $set:

      { ping: new Date(1376382134797), up: 23018, waiting: true, mongoVersion: "2.4.5" }

      } idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:492267 246ms
      Tue Aug 13 16:22:41.489 [replmaster] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa68242 0xb88ce5 0xe225d9 0x33c90064a7 0x33c84d3c2d
      mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
      mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
      mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
      mongod [0xa69fa4]
      mongod(_ZN5mongo12logKeepaliveEv+0x42) [0xa68242]
      mongod [0xb88ce5]
      mongod [0xe225d9]
      /lib64/libpthread.so.0 [0x33c90064a7]
      /lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
      Tue Aug 13 16:22:41.495 [replmaster] caught exception in replMasterThread()
      Tue Aug 13 16:22:44.801 [conn18] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
      0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa678a9 0xa8a641 0xa8db05 0xa8fe67 0x9f2ff8 0x9f8588 0x6e8b68 0xdc659e 0x33c90064a7 0x33c84d3c2d
      mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
      mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
      mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
      mongod [0xa69fa4]
      mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa678a9]
      mongod [0xa8a641]
      mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa8db05]
      mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa8fe67]
      mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f2ff8]
      mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9f8588]
      mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e8b68]
      mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdc659e]
      /lib64/libpthread.so.0 [0x33c90064a7]
      /lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
      Reporter: chenjun
      E-mail: chenjun819@paithink.com

      Attachments

        Activity

          People

            barrie Barrie Segal
            cj chenjun
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:
              10 years, 27 weeks, 1 day ago