[SERVER-22457] Assertion: 28556:Didn't find RecordId in WiredTigerRecordStore Created: 03/Feb/16  Updated: 09/Sep/16  Resolved: 05/Mar/16

Status: Closed
Project: Core Server
Component/s: WiredTiger
Affects Version/s: 3.0.7
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: nifan Assignee: Ramon Fernandez Marina
Resolution: Incomplete Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to SERVER-21201 Increase logging severity for Asserti... Closed
Operating System: ALL
Participants:

 Description   

2015-12-14T10:26:04.776+0100 I -        [conn267438] Assertion: 28556:Didn't find RecordId in WiredTigerRecordStore
2015-12-14T10:26:04.783+0100 I CONTROL  [conn267438]
 0xf785c9 0xf17401 0xefc65f 0xd9075c 0x92cbe0 0xa1d42b 0xbeb084 0xbeb434 0xbb99b4 0xacf8d0 0x82a0bd 0xf2b46b 0x7f379b8b2b50 0x7f379a3f895d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"400000","o":"B785C9"},{"b":"400000","o":"B17401"},{"b":"400000","o":"AFC65F"},{"b":"400000","o":"99075C"},{"b":"400000","o":"52CBE0"},{"b":"400000","o":"61D42B"},{"b":"400000","o":"7EB084"},{"b":"400000","o":"7EB434"},{"b":"400000","o":"7B99B4"},{"b":"400000","o":"6CF8D0"},{"b":"400000","o":"42A0BD"},{"b":"400000","o":"B2B46B"},{"b":"7F379B8AC000","o":"6B50"},{"b":"7F379A31D000","o":"DB95D"}],"processInfo":{ "mongodbVersion" : "3.0.7", "gitVersion" : "6ce7cbe8c6b899552dadd907604559806aa2e9bd", "uname" : { "sysname" : "Linux", "release" : "3.2.0-4-amd64", "version" : "#1 SMP Debian 3.2.68-1+deb7u6", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000", "buildId" : "0520DC2A91D540A37F4E7859EB3FFED4590CBFCD" }, { "b" : "7FFDD34EC000", "elfType" : 3, "buildId" : "9DFFE775123E377BD7ED77E6ADF00E11CE8EF9FE" }, { "b" : "7F379B8AC000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "FEF281218797AD6AE726DD5FCEDECADD9E9F51DC" }, { "b" : "7F379B64B000", "path" : "/usr/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "B3CDB575971D8B696AC6A6F8872620CAC9D2D273" }, { "b" : "7F379B253000", "path" : "/usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "E75BB3082373F77A79E8030BDC6C6A280284E759" }, { "b" : "7F379B04B000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "F58D5DE3E7A2989E915422BA4203FE53DBA449A0" }, { "b" : "7F379AE47000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "5D1CA3A3D93ED5B6C6462FFA03E787FDBE4013A3" }, { "b" : "7F379AB40000", "path" : "/usr/lib/x86_64-linux-gnu/libstdc++.so.6", "elfType" : 3, "buildId" : "8711429397A5AF8B6269B867D830EDF6E0225B8D" }, { "b" : "7F379A8BE000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "7F58D6664571941C86B2D969701A572AD4D7BF1D" }, { "b" : "7F379A6A8000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "F980B1188708F8D8B5C35D185444AF4CB939AA1E" }, { "b" : "7F379A31D000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "A745EBA2C16BA80AE1EF1A7A7B70740C2CF1B363" }, { "b" : "7F379BAC8000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "9B23F2A44CC8CA6175CBD8D64584B1C7EA5FD18C" }, { "b" : "7F379A106000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "1EFEB71FD4999C2307570D673A724EA4E1D85267" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf785c9]
 mongod(_ZN5mongo10logContextEPKc+0xE1) [0xf17401]
 mongod(_ZN5mongo11msgassertedEiPKc+0xAF) [0xefc65f]
 mongod(_ZNK5mongo21WiredTigerRecordStore7dataForEPNS_16OperationContextERKNS_8RecordIdE+0xDC) [0xd9075c]
 mongod(_ZNK5mongo10Collection6docForEPNS_16OperationContextERKNS_8RecordIdE+0x20) [0x92cbe0]
 mongod(_ZN5mongo10FetchStage4workEPm+0x2BB) [0xa1d42b]
 mongod(_ZN5mongo12PlanExecutor18getNextSnapshottedEPNS_11SnapshottedINS_7BSONObjEEEPNS_8RecordIdE+0xA4) [0xbeb084]
 mongod(_ZN5mongo12PlanExecutor7getNextEPNS_7BSONObjEPNS_8RecordIdE+0x34) [0xbeb434]
 mongod(_ZN5mongo8runQueryEPNS_16OperationContextERNS_7MessageERNS_12QueryMessageERKNS_15NamespaceStringERNS_5CurOpES3_+0xA74) [0xbb99b4]
 mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xB10) [0xacf8d0]
 mongod(_ZN5mongo16MyMessageHandler7processERNS_7MessageEPNS_21AbstractMessagingPortEPNS_9LastErrorE+0xDD) [0x82a0bd]
 mongod(_ZN5mongo17PortMessageServer17handleIncomingMsgEPv+0x34B) [0xf2b46b]
 libpthread.so.0(+0x6B50) [0x7f379b8b2b50]
 libc.so.6(clone+0x6D) [0x7f379a3f895d]
-----  END BACKTRACE  -----
2015-12-14T10:26:04.783+0100 I QUERY    [conn267438] assertion 28556 Didn't find RecordId in WiredTigerRecordStore ns:audiences.audiences query:{ next_update: { $lte: new Date(1450085164768) } }
2015-12-14T10:26:04.783+0100 I QUERY    [conn267438]  ntoskip:0 ntoreturn:1000



 Comments   
Comment by Ramon Fernandez Marina [ 03/Feb/16 ]

nifan, we need to find out which query is triggering this assertion. If you're able to trigger the assertion reliably, can you please send us the query and the explain() output on it?

If you can't find which query is responsible, one possibility is to log all queries using db.setProfilingLevel() as follows:

use admin
db.setProfilingLevel(2,0)

Please note that this will increase the amount of logging and may have an impact on performance, so you should reset it to previous values after you've found the offending query.

Thanks,
Ramón.

Generated at Thu Feb 08 04:00:28 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.