2019-03-19T20:37:56.362+0100 I COMMAND  [sessionCatalogMigration-itrie2_itrie1_5c91446a5185a86c2d246272] command local.oplog.rs command: find { find: "oplog.rs", filter:
{ ts: Timestamp(1552863055, 9), t: 239 }, ntoreturn: 1, singleBatch: true, oplogReplay: true, $db: "local" } planSummary: COLLSCAN keysExamined:0 docsExamined:1 cursorExh
austed:1 numYields:1 nreturned:0 reslen:398 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 2 } }, oplog: { acquireCount: { r: 2 } } } protocol
:op_msg 1360ms
2019-03-19T20:37:56.362+0100 I COMMAND  [conn6457] command config.$cmd command: update { update: "system.sessions", bypassDocumentValidation: false, ordered: false, updat
es: 898, shardVersion: [ Timestamp(179, 1), ObjectId('5c42aabe13fd3d908bf27061') ], writeConcern: { w: "majority", wtimeout: 15000 }, allowImplicitCollectionCreation: false, $clusterTime: { clusterTime: Timestamp(1553024271, 6), signature: { hash: BinData(0, D00936184179BF8DDA7DC319337E8BC350B85509), keyId: 6648063836051996776 } }, $configServerState: { opTime: { ts: Timestamp(1553024269, 5), t: 451 } }, $db: "config" } numYields:0 reslen:526 locks:{ Global: { acquireCount: { r: 898, w: 898 } }, Database: { acquireCount: { w: 898 } }, Collection: { acquireCount: { w: 898 } } } protocol:op_msg 4522ms
2019-03-19T20:37:56.362+0100 F STORAGE  [sessionCatalogMigration-itrie2_itrie1_5c91446a5185a86c2d246272] Statement id 4 from transaction [ { id: UUID("fc3817bf-31f1-4724-8e88-ae56fbeb0140"), uid: BinData(0, FE60665B5FAB12FFF1199B13F2E546C3DFF6CB11B425BCD5D38A7F7121EAEAF3) }:2 ] was committed once with opTime { ts: Timestamp(1552863055, 9), t: 239 } and a second time with opTime { ts: Timestamp(1553024276, 4), t: 243 }. This indicates possible data corruption or server bug and the process will be terminated.
2019-03-19T20:37:56.362+0100 F -        [sessionCatalogMigration-itrie2_itrie1_5c91446a5185a86c2d246272] Fatal Assertion 40526 at src/mongo/db/session.cpp 128
2019-03-19T20:37:56.362+0100 F -        [sessionCatalogMigration-itrie2_itrie1_5c91446a5185a86c2d246272]

***aborting after fassert() failure


2019-03-19T20:37:56.482+0100 I NETWORK  [listener] connection accepted from 144.76.137.190:56777 #6469 (79 connections now open)
2019-03-19T20:37:56.504+0100 I WRITE    [conn6457] update config.system.sessions command: { q: { _id: { id: UUID("a0b6b995-afab-4383-9a8f-d363c4da386c"), uid: BinData(0,FE60665B5FAB12FFF1199B13F2E546C3DFF6CB11B425BCD5D38A7F7121EAEAF3) } }, u: { $currentDate: { lastUse: true } }, multi: false, upsert: true } planSummary: IDHACK keysExamined:1 docsExamined:1 nMatched:1 nModified:1 numYields:1 locks:{ Global: { acquireCount: { r: 2, w: 2 } }, Database: { acquireCount: { w: 2 } }, Collection: { acquireCount: { w: 2 } } } 119ms
2019-03-19T20:37:56.565+0100 I NETWORK  [conn6469] received client metadata from 144.76.137.190:56777 conn6469: { driver: { name: "NetworkInterfaceTL", version: "4.0.5" }, os: { type: "Linux", name: "Ubuntu", architecture: "x86_64", version: "14.04" } }
2019-03-19T20:37:56.578+0100 I ACCESS   [conn6469] Successfully authenticated as principal __system on local
2019-03-19T20:37:56.907+0100 I NETWORK  [conn6462] end connection 10.8.0.138:50330 (78 connections now open)
2019-03-19T20:37:56.937+0100 I COMMAND  [conn6467] command infotrie_crawler.output command: find { find: "output", filter: { doc_id: "608da81bd490fe30885142ed404ba8cc" }, projection: { summ: 1, _id: 0 }, limit: 1, shardVersion: [ Timestamp(2950, 0), ObjectId('592e1219afc7c220cf84ffcb') ], lsid: { id: UUID("87c9a127-9073-4aa4-8ce2-3343cdee093b"), uid: BinData(0, FE60665B5FAB12FFF1199B13F2E546C3DFF6CB11B425BCD5D38A7F7121EAEAF3) }, $clusterTime: { clusterTime: Timestamp(1553024276, 934), signature: { hash: BinData(0, 124E80394EC6160204DB913D08762EC1DEF16CB9), keyId: 6648063836051996776 } }, $client: { driver: { name: "PyMongo", version: "3.7.2" }, os: { type: "Linux", name:"Ubuntu 16.04 xenial", architecture: "x86_64", version: "4.15.0-32-generic" }, platform: "CPython 2.7.12.final.0", mongos: { host: "itrie-namenode-2:27017", client: "144.76.137.190:52900", version: "4.0.5" } }, $configServerState: { opTime: { ts: Timestamp(1553024276, 3), t: 451 } }, $db: "infotrie_crawler" } planSummary: IXSCAN { doc_id: 1 } keysExamined:1 docsExamined:1 cursorExhausted:1 numYields:1 nreturned:1 reslen:5614 locks:{ Global: { acquireCount: { r: 2 } }, Database: { acquireCount: { r: 2 } }, Collection: { acquireCount: { r: 2 } } } protocol:op_msg 208ms
2019-03-19T20:37:57.054+0100 F -        [sessionCatalogMigration-itrie2_itrie1_5c91446a5185a86c2d246272] Got signal: 6 (Aborted).
 0x56335755c2e1 0x56335755b4f9 0x56335755b9dd 0x7f21dd6b5390 0x7f21dd30f428 0x7f21dd31102a 0x563355b84a13 0x563356ab5595 0x563356abe7fc 0x563355c70404 0x5633574b5d1a 0x563355fa672a 0x563355fa8012 0x563355fa9b5a 0x56335766ba20 0x7f21dd6ab6ba 0x7f21dd3e141d
----- BEGIN BACKTRACE -----
{"backtrace":[{"b":"563355171000","o":"23EB2E1","s":"_ZN5mongo15printStackTraceERSo"},{"b":"563355171000","o":"23EA4F9"},{"b":"563355171000","o":"23EA9DD"},{"b":"7F21DD6A4000","o":"11390"},{"b":"7F21DD2DA000","o":"35428","s":"gsignal"},{"b":"7F21DD2DA000","o":"3702A","s":"abort"},{"b":"563355171000","o":"A13A13","s":"_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj"},{"b":"563355171000","o":"1944595"},{"b":"563355171000","o":"194D7FC"},{"b":"563355171000","o":"AFF404","s":"_ZN5mongo22WiredTigerRecoveryUnit7_commitEv"},{"b":"563355171000","o":"2344D1A","s":"_ZN5mongo15WriteUnitOfWork6commitEv"},{"b":"563355171000","o":"E3572A"},{"b":"563355171000","o":"E37012","s":"_ZN5mongo34SessionCatalogMigrationDestination31_retrieveSessionStateFromSourceEPNS_14ServiceContextE"},{"b":"563355171000","o":"E38B5A"},{"b":"563355171000","o":"24FAA20"},{"b":"7F21DD6A4000","o":"76BA"},{"b":"7F21DD2DA000","o":"10741D","s":"clone"}],"processInfo":{ "mongodbVersion" : "4.0.5", "gitVersion" : "3739429dd92b92d1b0ab120911a23d50bf03c412", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "4.15.0-43-generic", "version" : "#46~16.04.1-Ubuntu SMP Fri Dec 7 13:31:08 UTC 2018", "machine" : "x86_64" }, "somap" : [ { "b" : "563355171000", "elfType" : 3, "buildId" : "D2BD849936E6F1CDEAA6678F57E07D725B522378" }, { "b" : "7FFE79AED000", "elfType" : 3, "buildId" : "8A9FB8766CA3C3EA4ACB0A90232B0F770DDBA7CC" }, { "b" : "7F21DEAB5000", "path" : "/usr/lib/x86_64-linux-gnu/libcurl.so.4", "elfType" : 3, "buildId" : "93EA3FEB7AC8F28D7F4F59F5B94226A20A6F9023" }, { "b" : "7F21DE89A000", "path" : "/lib/x86_64-linux-gnu/libresolv.so.2", "elfType" : 3, "buildId" : "6EF73266978476EF9F2FD2CF31E57F4597CB74F8" }, { "b" : "7F21DE455000", "path" : "/lib/x86_64-linux-gnu/libcrypto.so.1.0.0", "elfType" : 3, "buildId" : "8942CA58A3B910E883CC31E04A23DBD09729B4B0" }, { "b" : "7F21DE1EC000", "path" : "/lib/x86_64-linux-gnu/libssl.so.1.0.0", "elfType" : 3, "buildId" : "473092A9AF373FB0CAB555F9A003BC67F47756B6" }, { "b" : "7F21DDFE8000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "8CC8D0D119B142D839800BFF71FB71E73AEA7BD4" }, { "b" : "7F21DDDE0000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "89C34D7A182387D76D5CDA1F7718F5D58824DFB3" }, { "b" : "7F21DDAD7000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "DFB85DE42DAFFD09640C8FE377D572DE3E168920" }, { "b" : "7F21DD8C1000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "68220AE2C65D65C1B6AAA12FA6765A6EC2F5F434" }, { "b" : "7F21DD6A4000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "CE17E023542265FC11D9BC8F534BB4F070493D30" }, { "b" : "7F21DD2DA000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "B5381A457906D279073822A5CEB24C4BFEF94DDB" }, { "b" : "7F21DED24000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "5D7B6259552275A3C17BD4C3FD05F5A6BF40CAA5" }, { "b" : "7F21DD0A7000", "path" : "/usr/lib/x86_64-linux-gnu/libidn.so.11", "elfType" : 3, "buildId" : "E09D3783AD1D0BBCD3204FA01E4EF6D756E18F57" }, { "b" : "7F21DCE8B000", "path" : "/usr/lib/x86_64-linux-gnu/librtmp.so.1", "elfType" : 3, "buildId" : "8D1CC1204D6B6D33BD1D2C5A2A0516A2234322CF" }, { "b" : "7F21DCC41000", "path" : "/usr/lib/x86_64-linux-gnu/libgssapi_krb5.so.2", "elfType" : 3, "buildId" : "41971A4A3CCDC54A447F41DF4BD96C948C546E0E" }, { "b" : "7F21DCA32000", "path" : "/usr/lib/x86_64-linux-gnu/liblber-2.4.so.2", "elfType" : 3, "buildId" : "5B146086EC173C299BA45F0C92E068D68CC7AD37" }, { "b" : "7F21DC7E1000", "path" : "/usr/lib/x86_64-linux-gnu/libldap_r-2.4.so.2", "elfType" : 3, "buildId" : "D02A94DB90567C2C45F40C8565809A041FD22A55" }, { "b" : "7F21DC5C7000", "path" : "/lib/x86_64-linux-gnu/libz.so.1", "elfType" : 3, "buildId" : "8D9BD4CE26E45EF16075C67D5F5EEAFD8B562832" }, { "b" : "7F21DC297000", "path" : "/usr/lib/x86_64-linux-gnu/libgnutls.so.30", "elfType" : 3, "buildId" : "3CE893F6D1382C2C7648DCCB06E71B1C7E0861CC" }, { "b" : "7F21DC064000", "path": "/usr/lib/x86_64-linux-gnu/libhogweed.so.4", "elfType" : 3, "buildId" : "B11678F560199547DCF726384EA39153EE0DFABF" }, { "b" : "7F21DBE2E000", "path" : "/usr/lib/x86_64-linux-gnu/libnettle.so.6", "elfType" : 3, "buildId" : "D6B36C5A463EE0FA84FDD6D5FD3F7726EDB90D54" }, { "b" : "7F21DBBAE000", "path" : "/usr/lib/x86_64-linux-gnu/libgmp.so.10", "elfType" : 3, "buildId" : "7B3533D5998D20EE1A1BE3F87789B69041E7F620" }, { "b" : "7F21DB8DC000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5.so.3", "elfType" : 3, "buildId" : "0EEF7058B0737B68BDF89E5DC604D0AC389C8BB1" }, { "b" : "7F21DB6AD000", "path" : "/usr/lib/x86_64-linux-gnu/libk5crypto.so.3", "elfType" : 3, "buildId" : "FFBA483A43D9EF73925AC116811890C037523DA1" }, { "b" : "7F21DB4A9000", "path" : "/lib/x86_64-linux-gnu/libcom_err.so.2", "elfType" : 3, "buildId" : "1E16CB57F699E215A2A8D4EFEF90883BC749B12D" }, { "b" : "7F21DB29E000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5support.so.0", "elfType" : 3, "buildId" : "B789D8D4B4FC333405AB34387D9237F954060EA4" },{ "b" : "7F21DB083000", "path" : "/usr/lib/x86_64-linux-gnu/libsasl2.so.2", "elfType" : 3, "buildId" : "87783DF8A1058CD150F8886CB36340384093C18F" }, { "b" : "7F21DAE42000", "path" : "/usr/lib/x86_64-linux-gnu/libgssapi.so.3", "elfType" : 3, "buildId" : "1FE877BE52A424D0636AFD4D35BB330E41D6E0F3" }, { "b" : "7F21DABDE000", "path" : "/usr/lib/x86_64-linux-gnu/libp11-kit.so.0", "elfType" : 3, "buildId" : "A0E2D03FF5CF65937F4425D4EFD4D655243809EB" }, { "b" : "7F21DA9CB000", "path" : "/usr/lib/x86_64-linux-gnu/libtasn1.so.6", "elfType" : 3, "buildId" : "E07E186694852D8F69459C6AB28A53F8DA3CE3B6" }, { "b" : "7F21DA7C7000", "path" : "/lib/x86_64-linux-gnu/libkeyutils.so.1", "elfType" : 3, "buildId" : "3364D4BF2113C4E8D17EF533867ECC99A53413D6" }, { "b" : "7F21DA5BE000", "path" : "/usr/lib/x86_64-linux-gnu/libheimntlm.so.0", "elfType" : 3, "buildId" : "73A8EADBC85860662B24850E71D4AFBE22C33359" }, { "b" : "7F21DA334000", "path" : "/usr/lib/x86_64-linux-gnu/libkrb5.so.26", "elfType" : 3, "buildId" : "59E742306A4EA2872E061ECCE92F35FADDA75357" }, { "b" : "7F21DA092000", "path" : "/usr/lib/x86_64-linux-gnu/libasn1.so.8", "elfType" : 3, "buildId" : "E5C159E415406AE79D21056D752BA949C408B5B1" }, { "b" : "7F21D9E5F000", "path" : "/usr/lib/x86_64-linux-gnu/libhcrypto.so.4", "elfType" : 3, "buildId" : "7D15576E1F096614D360784E4A01A1F5FAF908C9" }, { "b" : "7F21D9C49000", "path" : "/usr/lib/x86_64-linux-gnu/libroken.so.18", "elfType" : 3, "buildId" : "481DB33C28D88E43DA6BED65E1A7599407D4D818" }, { "b" : "7F21D9A41000", "path" :"/usr/lib/x86_64-linux-gnu/libffi.so.6", "elfType" : 3, "buildId" : "9D9C958F1F4894AFEF6AECD90D1C430EA29AC34F" }, { "b" : "7F21D9818000", "path" : "/usr/lib/x86_64-linux-gnu/libwind.so.0", "elfType" : 3, "buildId" : "57E25072866B2D30CF02EBE7AE623B84F96FA700" }, { "b" : "7F21D9609000", "path" : "/usr/lib/x86_64-linux-gnu/libheimbase.so.1", "elfType" : 3, "buildId" : "F6F1B4E9F89B716C4A0BA5819BDFFAF4A13EFB91" }, { "b" : "7F21D93BE000", "path" : "/usr/lib/x86_64-linux-gnu/libhx509.so.5", "elfType" : 3, "buildId" : "C60082E3BB78D0D42868D9B359B89BF66CE5A1A7" }, { "b" : "7F21D90E9000", "path" : "/usr/lib/x86_64-linux-gnu/libsqlite3.so.0", "elfType" : 3, "buildId" : "D9782BA023CAEC26B15D8676E3A5D07B55E121EF" }, { "b" : "7F21D8EB1000", "path" : "/lib/x86_64-linux-gnu/libcrypt.so.1", "elfType" : 3, "buildId" : "7BDD51353D50310FFA1587E4AA01B40ABE32D582" } ] }}
 mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x56335755c2e1]
 mongod(+0x23EA4F9) [0x56335755b4f9]
 mongod(+0x23EA9DD) [0x56335755b9dd]
 libpthread.so.0(+0x11390) [0x7f21dd6b5390]
 libc.so.6(gsignal+0x38) [0x7f21dd30f428]
 libc.so.6(abort+0x16A) [0x7f21dd31102a]
 mongod(_ZN5mongo32fassertFailedNoTraceWithLocationEiPKcj+0x0) [0x563355b84a13]
 mongod(+0x1944595) [0x563356ab5595]
 mongod(+0x194D7FC) [0x563356abe7fc]
 mongod(_ZN5mongo22WiredTigerRecoveryUnit7_commitEv+0xA4) [0x563355c70404]
 mongod(_ZN5mongo15WriteUnitOfWork6commitEv+0x4A) [0x5633574b5d1a]
 mongod(+0xE3572A) [0x563355fa672a]
 mongod(_ZN5mongo34SessionCatalogMigrationDestination31_retrieveSessionStateFromSourceEPNS_14ServiceContextE+0x1722) [0x563355fa8012]
 mongod(+0xE38B5A) [0x563355fa9b5a]
 mongod(+0x24FAA20) [0x56335766ba20]
 libpthread.so.0(+0x76BA) [0x7f21dd6ab6ba]
 libc.so.6(clone+0x6D) [0x7f21dd3e141d]
-----  END BACKTRACE  -----