Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-54051

Got signal: 8 (Floating point exception)

    • Type: Icon: Task Task
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.4.18
    • Component/s: None
    • Labels:
      None
    • Environment:
      debian8

      it seems like the mongod crashed during Move Chunk,following is the mongod log output

      2021-01-26T21:55:16.755462+08:00 [conn207467] forking for cleanup of chunk data
      2021-01-26T21:55:16.755528+08:00 [conn207467] about to log metadata event into changelog: { _id: "ocean-spmongod01-12355.i.nease.net-2021-01-26T21:55:16.755+0800-60101f4410c3a62fbda185f4", server: "ocean-spmongod01-12355.i.nease.net", clientAddr: "10.191.49.75:38659", time: new Date(1611669316755), what: "moveChunk.from", ns: "entitydb_10001.HomeBuildingEntity", details: { min: { _id: 4544145803305126124 }, max: { _id: 4544456102686042480 }, step 1 of 7: 0, step 2 of 7: 43, step 3 of 7: 95, step 4 of 7: 399, step 5 of 7: 12, step 6 of 7: 60, step 7 of 7: 0, to: "smongo177", from: "smongo205", note: "success" } }
      2021-01-26T21:55:16.755577+08:00 [RangeDeleter] Deleter starting delete for: entitydb_10001.HomeBuildingEntity from { _id: 4544145803305126124 } -> { _id: 4544456102686042480 }, with opId: 594016188
      2021-01-26T21:55:16.757652+08:00 [conn207467] command admin.$cmd command: moveChunk { moveChunk: "entitydb_10001.HomeBuildingEntity", shardVersion: [ Timestamp 45715000|1, ObjectId('5bd9add5f47203867a329ae9') ], epoch: ObjectId('5bd9add5f47203867a329ae9'), configdb: "config5/10.191.48.75:27019,10.191.49.75:27019,10.191.50.75:27019", fromShard: "smongo205", toShard: "smongo177", min: { _id: 4544145803305126124 }, max: { _id: 4544456102686042480 }, chunkVersion: [ Timestamp 45715000|1, ObjectId('5bd9add5f47203867a329ae9') ], maxChunkSizeBytes: 67108864, waitForDelete: false, takeDistLock: false } numYields:3 reslen:154 locks:{ Global: { acquireCount: { r: 26, w: 8 } }, Database: { acquireCount: { r: 9, w: 6, W: 2 } }, Collection: { acquireCount: { r: 9, W: 4 } }, Metadata: { acquireCount: { w: 2 } }, oplog: { acquireCount: { w: 2 } } } protocol:op_command 615ms
      2021-01-26T21:55:16.864518+08:00 [RangeDeleter] rangeDeleter deleted 509 documents for entitydb_10001.HomeBuildingEntity from { _id: 4544145803305126124 } -> { _id: 4544456102686042480 }
      2021-01-26T21:55:17.151673+08:00 [conn207467] Starting chunk migration ns: entitydb_10001.HomeBuildingEntity, [{ _id: 4544456102686042480 }, { _id: 4544456797610238007 }), fromShard: smongo205, toShard: smongo174 with expected collection version 45716|1||5bd9add5f47203867a329ae9
      2021-01-26T21:55:17.151714+08:00 [conn207467] Refreshing chunks for collection entitydb_10001.HomeBuildingEntity based on version 45716|1||5bd9add5f47203867a329ae9
      2021-01-26T21:55:17.192740+08:00 [CatalogCacheLoader-829] Refresh for collection entitydb_10001.HomeBuildingEntity took 40 ms and found version 45716|1||5bd9add5f47203867a329ae9
      2021-01-26T21:55:17.192878+08:00 [conn207467] about to log metadata event into changelog: { _id: "ocean-spmongod01-12355.i.nease.net-2021-01-26T21:55:17.192+0800-60101f4510c3a62fbda186ac", server: "ocean-spmongod01-12355.i.nease.net", clientAddr: "10.191.49.75:38659", time: new Date(1611669317192), what: "moveChunk.start", ns: "entitydb_10001.HomeBuildingEntity", details: { min: { _id: 4544456102686042480 }, max: { _id: 4544456797610238007 }, from: "smongo205", to: "smongo174" } }
      2021-01-26T21:55:17.207661+08:00 [conn207467] Invalid operation at address: 0x5593ac1139ca
      2021-01-26T21:55:17.287822+08:00 [conn207467] Got signal: 8 (Floating point exception).#012#012 0x5593ac577111 0x5593ac576329 0x5593ac576996 0x7fe720037890 0x5593ac1139ca 0x5593ac11426b 0x5593ac1311e9 0x5593ac135bd5 0x5593ac137e0e 0x5593aba8a465 0x5593aba8b751 0x5593ac0a721b 0x5593abca9ca8 0x5593ab8abfed 0x5593ab8ac91d 0x5593ac4f4ca1 0x7fe720030064 0x7fe71fd6562d#012----- BEGIN BACKTRACE -----#012{"backtrace":[{"b":"5593AB037000","o":"1540111","s":"_ZN5mongo15printStackTraceERSo"},{"b":"5593AB037000","o":"153F329"},{"b":"5593AB037000","o":"153F996"},{"b":"7FE720028000","o":"F890"},{"b":"5593AB037000","o":"10DC9CA","s":"_ZN5mongo32MigrationChunkClonerSourceLegacy17_storeCurrentLocsEPNS_16OperationContextE"},{"b":"5593AB037000","o":"10DD26B","s":"_ZN5mongo32MigrationChunkClonerSourceLegacy10startCloneEPNS_16OperationContextE"},{"b":"5593AB037000","o":"10FA1E9","s":"_ZN5mongo22MigrationSourceManager10startCloneEPNS_16OperationContextE"},{"b":"5593AB037000","o":"10FEBD5"},{"b":"5593AB037000","o":"1100E0E"},{"b":"5593AB037000","o":"A53465","s":"_ZN5mongo7Command3runEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS3_21ReplyBuilderInterfaceE"},{"b":"5593AB037000","o":"A54751","s":"_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_RKNS_3rpc16RequestInterfaceEPNS4_21ReplyBuilderInterfaceE"},{"b":"5593AB037000","o":"107021B","s":"_ZN5mongo11runCommandsEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS2_21ReplyBuilderInterfaceE"},{"b":"5593AB037000","o":"C72CA8","s":"_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE"},{"b":"5593AB037000","o":"874FED","s":"_ZN5mongo23ServiceEntryPointMongod12_sessionLoopERKSt10shared_ptrINS_9transport7SessionEE"},{"b":"5593AB037000","o":"87591D"},{"b":"5593AB037000","o":"14BDCA1"},{"b":"7FE720028000","o":"8064"},{"b":"7FE71FC7D000","o":"E862D","s":"clone"}],"processInfo":{ "mongodbVersion" : "3.4.18", "gitVersion" : "4410706bef6463369ea2f42399e9843903b31923", "compiledModules" : [], "uname" : { "sysname" : "Linux", "release" : "3.16.0-4-amd64", "version" : "#1 SMP Debian 3.16.51-3 (2017-12-13)", "machine" : "x86_64" }, "somap" : [ { "b" : "5593AB037000", "elfType" : 3, "buildId" : "5406210FB8EA276753CEBC1FF8EBB939A9829119" }, { "b" : "7FFFA97ED000", "path" : "linux-vdso.so.1", "elfType" : 3, "buildId" : "A28EC3982D8B06A7BE4A805A79590341785F9902" }, { "b" : "7FE720960000", "path" : "/lib/x86_64-linux-gnu/librt.so.1", "elfType" : 3, "buildId" : "A63C95FB33CCA970E141D2E13774B997C1CF0565" }, { "b" : "7FE72075C000", "path" : "/lib/x86_64-linux-gnu/libdl.so.2", "elfType" : 3, "buildId" : "D70B531D672A34D71DB42EB32B68E63F2DCC5B6A" }, { "b" : "7FE72045B000", "path" : "/lib/x86_64-linux-gnu/libm.so.6", "elfType" : 3, "buildId" : "152C93BA3E8590F7ED0BCDDF868600D55EC4DD6F" }, { "b" : "7FE720245000", "path" : "/lib/x86_64-linux-gnu/libgcc_s.so.1", "elfType" : 3, "buildId" : "D5FB04F64B3DAEA6D6B68B5E8B9D4D2BC1A6E1FC" }, { "b" : "7FE720028000", "path" : "/lib/x86_64-linux-gnu/libpthread.so.0", "elfType" : 3, "buildId" : "9DA9387A60FFC196AEDB9526275552AFEF499C44" }, { "b" : "7FE71FC7D000", "path" : "/lib/x86_64-linux-gnu/libc.so.6", "elfType" : 3, "buildId" : "48C48BC6ABB794461B8A558DD76B29876A0551F0" }, { "b" : "7FE720B68000", "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3, "buildId" : "1D98D41FBB1EABA7EC05D0FD7624B85D6F51C03C" } ] }}#012 mongod(_ZN5mongo15printStackTraceERSo+0x41) [0x5593ac577111]#012 mongod(+0x153F329) [0x5593ac576329]#012 mongod(+0x153F996) [0x5593ac576996]#012 libpthread.so.0(+0xF890) [0x7fe720037890]#012 mongod(_ZN5mongo32MigrationChunkClonerSourceLegacy17_storeCurrentLocsEPNS_16OperationContextE+0x44A) [0x5593ac1139ca]#012 mongod(_ZN5mongo32MigrationChunkClonerSourceLegacy10startCloneEPNS_16OperationContextE+0x5B) [0x5593ac11426b]#012 mongod(_ZN5mongo22MigrationSourceManager10startCloneEPNS_16OperationContextE+0x1269) [0x5593ac1311e9]#012 mongod(+0x10FEBD5) [0x5593ac135bd5]#012 mongod(+0x1100E0E) [0x5593ac137e0e]#012 mongod(_ZN5mongo7Command3runEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS3_21ReplyBuilderInterfaceE+0x935) [0x5593aba8a465]#012 mongod(_ZN5mongo7Command11execCommandEPNS_16OperationContextEPS0_RKNS_3rpc16RequestInterfaceEPNS4_21ReplyBuilderInterfaceE+0xF81) [0x5593aba8b751]#012 mongod(_ZN5mongo11runCommandsEPNS_16OperationContextERKNS_3rpc16RequestInterfaceEPNS2_21ReplyBuilderInterfaceE+0x23B) [0x5593ac0a721b]#012 mongod(_ZN5mongo16assembleResponseEPNS_16OperationContextERNS_7MessageERNS_10DbResponseERKNS_11HostAndPortE+0xD38) [0x5593abca9ca8]#012 mongod(_ZN5mongo23ServiceEntryPointMongod12_sessionLoopERKSt10shared_ptrINS_9transport7SessionEE+0x1FD) [0x5593ab8abfed]#012 mongod(+0x87591D) [0x5593ab8ac91d]#012 mongod(+0x14BDCA1) [0x5593ac4f4ca1]#012 libpthread.so.0(+0x8064) [0x7fe720030064]#012 libc.so.6(clone+0x6D) [0x7fe71fd6562d]#012----- END BACKTRACE -----

            Assignee:
            bruce.lucas@mongodb.com Bruce Lucas (Inactive)
            Reporter:
            xuchenliang123@gmail.com chenliang xu
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: