[SERVER-7428] can't lock_W, threadState=119; cero_prod Fatal Assertion 16114 Created: 19/Oct/12  Updated: 11/Jul/16  Resolved: 26/Nov/12

Status: Closed
Project: Core Server
Component/s: Concurrency
Affects Version/s: 2.2.0
Fix Version/s: 2.2.3, 2.3.2

Type: Bug Priority: Major - P3
Reporter: Stephen Lee Assignee: Andy Schwerin
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Related
related to SERVER-6364 Remove/replace write lock in replAuth... Closed
Backwards Compatibility: Fully Compatible
Operating System: Linux
Participants:

 Description   

Fri Oct 19 17:01:31 [conn44738] can't lock_W, threadState=119
Fri Oct 19 17:01:31 [conn44738] cero_prod Fatal Assertion 16114
0xade6e1 0x802e03 0xadbd04 0x9f329e 0x853832 0x8560c9 0x85e5e0 0x6571f1 0x658d5d 0x659c1e 0x6afa08 0x6b3241 0xb5ba7d 0xb5d052 0x56fa52 0x5dbf11 0x7f2dec90fe9a 0x7f2debc254bd
/mongodb/c23/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xade6e1]
/mongodb/c23/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0x802e03]
/mongodb/c23/bin/mongod(_ZN5mongo4Lock11GlobalWriteC1Ebi+0x264) [0xadbd04]
/mongodb/c23/bin/mongod(_ZN5mongo16replAuthenticateEPNS_12DBClientBaseE+0x14e) [0x9f329e]
/mongodb/c23/bin/mongod(_ZN5mongo6Cloner2goEPKcRKNS_12CloneOptionsERSt3setISsSt4lessISsESaISsEERSsPi+0xf92) [0x853832]
/mongodb/c23/bin/mongod(_ZN5mongo6Cloner2goEPKcRSsRKSsbbbbbbPi+0x139) [0x8560c9]
/mongodb/c23/bin/mongod(_ZN5mongo9CmdCopyDb3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x1000) [0x85e5e0]
/mongodb/c23/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRNS_14BSONObjBuilderEb+0x51) [0x6571f1]
/mongodb/c23/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xcfd) [0x658d5d]
/mongodb/c23/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x2ae) [0x659c1e]
/mongodb/c23/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x38) [0x6afa08]
/mongodb/c23/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0xbc1) [0x6b3241]
/mongodb/c23/bin/mongod() [0xb5ba7d]
/mongodb/c23/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x3a2) [0xb5d052]
/mongodb/c23/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x82) [0x56fa52]
/mongodb/c23/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x411) [0x5dbf11]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f2dec90fe9a]
/lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f2debc254bd]
Fri Oct 19 17:01:31 [conn44738]
***aborting after fassert() failure



 Comments   
Comment by auto [ 08/Jan/13 ]

Author:

{u'date': u'2012-11-26T19:49:39Z', u'name': u'Andy Schwerin', u'email': u'schwerin@10gen.com'}

Message: SERVER-7428 Regression test.
Branch: v2.2
https://github.com/mongodb/mongo/commit/4473320aca6097d567cb4f3b2e48ad776dd544b1

Comment by auto [ 08/Jan/13 ]

Author:

{u'date': u'2012-11-26T18:58:49Z', u'name': u'Andy Schwerin', u'email': u'schwerin@10gen.com'}

Message: SERVER-7428 Only obtain a ReadContext on the "local" database when performing replAuthenticate.

No need for global write privilege, just database read to read the local.system.users collection.
Branch: v2.2
https://github.com/mongodb/mongo/commit/9094e68b9b10e32e48949a45bd12515e2bf562c0

Comment by auto [ 26/Nov/12 ]

Author:

{u'date': u'2012-11-26T19:49:39Z', u'email': u'schwerin@10gen.com', u'name': u'Andy Schwerin'}

Message: SERVER-7428 Regression test.
Branch: master
https://github.com/mongodb/mongo/commit/25c8a4947a4b06b4a0eb21b6f995902529281b56

Comment by auto [ 26/Nov/12 ]

Author:

{u'date': u'2012-11-26T18:58:49Z', u'email': u'schwerin@10gen.com', u'name': u'Andy Schwerin'}

Message: SERVER-7428 Only obtain a ReadContext on the "local" database when performing replAuthenticate.

No need for global write privilege, just database read to read the local.system.users collection.
Branch: master
https://github.com/mongodb/mongo/commit/5765b96d9c11f7ec84609e5554e2ba3b3821dced

Comment by Daniel Pasette (Inactive) [ 20/Nov/12 ]

I am able to reproduce this crash with this script:

// Setup fromDb with no auth
var fromDb = MongoRunner.runMongod({ port: 29000 });
 
// Setup toDb with auth
var toDb = MongoRunner.runMongod({auth : "", port : 31001});
var admin = toDb.getDB("admin");
admin.addUser("foo","bar");
admin.auth("foo","bar");
 
admin.copyDatabase('test', 'test', fromDb.host)

Comment by Tad Marshall [ 19/Oct/12 ]

Second stack trace from original report:

Fri Oct 19 17:01:31 [conn16] can't lock_W, threadState=119
Fri Oct 19 17:01:31 [conn16]  cero_prod_final Fatal Assertion 16114
0xade6e1 0x802e03 0xadbd04 0x9f329e 0x853832 0x8560c9 0x85e5e0 0x6571f1 0x658d5d 0x659c1e 0x6afa08 0x6b3241 0xb5ba7d 0xb5d052 0x56fa52 0x5dbf11 0x7f7bc092ae9a 0x7f7bbfc404bd
 /mongodb/c19/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xade6e1]
 /mongodb/c19/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0x802e03]
 /mongodb/c19/bin/mongod(_ZN5mongo4Lock11GlobalWriteC1Ebi+0x264) [0xadbd04]
 /mongodb/c19/bin/mongod(_ZN5mongo16replAuthenticateEPNS_12DBClientBaseE+0x14e) [0x9f329e]
 /mongodb/c19/bin/mongod(_ZN5mongo6Cloner2goEPKcRKNS_12CloneOptionsERSt3setISsSt4lessISsESaISsEERSsPi+0xf92) [0x853832]
 /mongodb/c19/bin/mongod(_ZN5mongo6Cloner2goEPKcRSsRKSsbbbbbbPi+0x139) [0x8560c9]
 /mongodb/c19/bin/mongod(_ZN5mongo9CmdCopyDb3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x1000) [0x85e5e0]
 /mongodb/c19/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRNS_14BSONObjBuilderEb+0x51) [0x6571f1]
 /mongodb/c19/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xcfd) [0x658d5d]
 /mongodb/c19/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x2ae) [0x659c1e]
 /mongodb/c19/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x38) [0x6afa08]
 /mongodb/c19/bin/mongod(_ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1_+0xbc1) [0x6b3241]
 /mongodb/c19/bin/mongod() [0xb5ba7d]
 /mongodb/c19/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0x3a2) [0xb5d052]
 /mongodb/c19/bin/mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0x82) [0x56fa52]
 /mongodb/c19/bin/mongod(_ZN5mongo3pms9threadRunEPNS_13MessagingPortE+0x411) [0x5dbf11]
 /lib/x86_64-linux-gnu/libpthread.so.0(+0x7e9a) [0x7f7bc092ae9a]
 /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f7bbfc404bd]
Fri Oct 19 17:01:31 [conn16]
 
***aborting after fassert() failure

Generated at Thu Feb 08 03:14:30 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.