[DOCS-1805] mongo config server throw many exceptions Created: 13/Aug/13  Updated: 03/Nov/17  Resolved: 13/Aug/13

Status: Closed
Project: Documentation
Component/s: None
Affects Version/s: None
Fix Version/s: 01112017-cleanup

Type: Improvement Priority: Major - P3
Reporter: auto Assignee: Barrie Segal
Resolution: Duplicate Votes: 0
Labels: collector-298ba4e7
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

[root@localhost bin]# mongos -version
MongoS version 2.4.5 starting: pid=5781 port=27017 64-bit host=localhost.localdomain (--help for usage)
git version: a2ddc68ba7c9cee17bfe69ed840383ec3506602b
build sys info: Linux ip-10-2-29-40 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_49
Linux localhost.localdomain 2.6.18-164.el5xen #1 SMP Tue Aug 18 15:59:52 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux

Location: http://docs.mongodb.org/ecosystem/drivers/
User-Agent: Mozilla/5.0 (Windows NT 5.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/28.0.1500.95 Safari/537.36
Referrer: http://www.mongodb.org/get-involved
Screen Resolution: 1366 x 768
repo: docs-ecosystem
source: drivers


Issue Links:
Duplicate
duplicates DOCS-1807 ongo config server throw many exceptions Closed
Participants:
Days since reply: 10 years, 27 weeks, 1 day ago

 Description   

mongos> db.runCommand({shardcollection:"kwlib.kwlib_tes8",key:{cat_id:1,word:1}})
{
"code" : 8017,
"ok" : 0,
"errmsg" : "exception: update not consistent ns: config.chunks query:

{ _id: \"kwlib.kwlib_tes8-cat_id_MinKeyword_MinKey\" }

update: { _id: \"kwlib.kwlib_tes8-cat_id_MinKeyword_MinKey\", lastmod: Timestamp 1000|0, lastmodEpoch: ObjectId('5209d6e034b400779211aef6'), ns: \"kwlib.kwlib_tes8\", min:

{ cat_id: MinKey, word: MinKey }

, max:

{ cat_id: MaxKey, word: MaxKey }

, shard: \"shard0000\" } gle1:

{ updatedExisting: false, n: 1, lastOp: Timestamp 1376376544000|1, connectionId: 22, waited: 23, err: null, ok: 1.0 }

gle2:

{ err: \"!loc.isNull()\", n: 0, connectionId: 20, waited: 44, ok: 1.0 }

"
}

There are many exception in the mongo config server log file:

/lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
Tue Aug 13 16:22:06.490 [replmaster] caught exception in replMasterThread()
Tue Aug 13 16:22:14.796 [conn21] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa678a9 0xa8a641 0xa8db05 0xa8fe67 0x9f2ff8 0x9f8588 0x6e8b68 0xdc659e 0x33c90064a7 0x33c84d3c2d
mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
mongod [0xa69fa4]
mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa678a9]
mongod [0xa8a641]
mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa8db05]
mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa8fe67]
mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f2ff8]
mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9f8588]
mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e8b68]
mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdc659e]
/lib64/libpthread.so.0 [0x33c90064a7]
/lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
Tue Aug 13 16:22:18.173 [conn21] update config.mongos query:

{ _id: "localhost.localdomain:55555" }

update: { $set:

{ ping: new Date(1376382134795), up: 23018, waiting: false, mongoVersion: "2.4.5" }

} idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:17844 3377ms
Tue Aug 13 16:22:18.514 [replmaster] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa68242 0xb88ce5 0xe225d9 0x33c90064a7 0x33c84d3c2d
mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
mongod [0xa69fa4]
mongod(_ZN5mongo12logKeepaliveEv+0x42) [0xa68242]
mongod [0xb88ce5]
mongod [0xe225d9]
/lib64/libpthread.so.0 [0x33c90064a7]
/lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
Tue Aug 13 16:22:20.416 [replmaster] caught exception in replMasterThread()
Tue Aug 13 16:22:31.488 [conn21] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa678a9 0xa8a641 0xa8db05 0xa8fe67 0x9f2ff8 0x9f8588 0x6e8b68 0xdc659e 0x33c90064a7 0x33c84d3c2d
mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
mongod [0xa69fa4]
mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa678a9]
mongod [0xa8a641]
mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa8db05]
mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa8fe67]
mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f2ff8]
mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9f8588]
mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e8b68]
mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdc659e]
/lib64/libpthread.so.0 [0x33c90064a7]
/lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
Tue Aug 13 16:22:31.734 [conn21] update config.mongos query:

{ _id: "localhost.localdomain:55555" }

update: { $set:

{ ping: new Date(1376382134797), up: 23018, waiting: true, mongoVersion: "2.4.5" }

} idhack:1 fastmod:1 keyUpdates:0 exception: assertion src/mongo/db/pdfile.cpp:1816 locks(micros) w:492267 246ms
Tue Aug 13 16:22:41.489 [replmaster] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa68242 0xb88ce5 0xe225d9 0x33c90064a7 0x33c84d3c2d
mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
mongod [0xa69fa4]
mongod(_ZN5mongo12logKeepaliveEv+0x42) [0xa68242]
mongod [0xb88ce5]
mongod [0xe225d9]
/lib64/libpthread.so.0 [0x33c90064a7]
/lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]
Tue Aug 13 16:22:41.495 [replmaster] caught exception in replMasterThread()
Tue Aug 13 16:22:44.801 [conn18] local.oplog.$main Assertion failure !loc.isNull() src/mongo/db/pdfile.cpp 1816
0xdd9e31 0xd9b04d 0xab5be1 0xa69fa4 0xa678a9 0xa8a641 0xa8db05 0xa8fe67 0x9f2ff8 0x9f8588 0x6e8b68 0xdc659e 0x33c90064a7 0x33c84d3c2d
mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdd9e31]
mongod(_ZN5mongo12verifyFailedEPKcS1_j+0xfd) [0xd9b04d]
mongod(_ZN5mongo11DataFileMgr17fast_oplog_insertEPNS_16NamespaceDetailsEPKci+0x511) [0xab5be1]
mongod [0xa69fa4]
mongod(_ZN5mongo5logOpEPKcS1_RKNS_7BSONObjEPS2_Pbb+0x49) [0xa678a9]
mongod [0xa8a641]
mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d35) [0xa8db05]
mongod(_ZN5mongo13updateObjectsEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa8fe67]
mongod(_ZN5mongo14receivedUpdateERNS_7MessageERNS_5CurOpE+0x4d8) [0x9f2ff8]
mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xac8) [0x9f8588]
mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x98) [0x6e8b68]
mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x42e) [0xdc659e]
/lib64/libpthread.so.0 [0x33c90064a7]
/lib64/libc.so.6(clone+0x6d) [0x33c84d3c2d]

Reporter: chenjun
E-mail: chenjun819@paithink.com



 Comments   
Comment by chenjun [ 13/Aug/13 ]

I have created an report to core server......

Generated at Thu Feb 08 07:41:56 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.