Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-15871

Segmentation fault in secondary rebuilding index in background

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Critical - P2 Critical - P2
    • None
    • Affects Version/s: 2.6.5
    • Labels:
      None
    • Fully Compatible
    • ALL

      We have a segfault on a secondary node during a background index build:

      2014-10-30T05:33:35.382+0100 [repl index builder 83991] build index on: 542-110-6347.keyword_adgroup properties: { v: 1, key: { adgroup: 1 }, name
      : "adgroup_1", ns: "542-110-6347.keyword_adgroup", background: true }
      2014-10-30T05:33:35.383+0100 [repl index builder 83991]          building index in background
      2014-10-30T05:33:35.453+0100 [repl writer worker 4] CMD: drop 542-110-6347.keyword_adgroup
      2014-10-30T05:33:35.453+0100 [repl writer worker 4] halting index build: { campaign: 1 }
      2014-10-30T05:33:35.453+0100 [repl writer worker 4] SEVERE: Invalid access at address: 0
      2014-10-30T05:33:35.461+0100 [repl writer worker 4] SEVERE: Got signal: 11 (Segmentation fault).
      ...
       /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0x11e9b11]
       /usr/bin/mongod() [0x11e8eee]
       /usr/bin/mongod() [0x11e8fdf]
       /lib/x86_64-linux-gnu/libpthread.so.0(+0x10340) [0x7f41bf498340]
       /usr/bin/mongod(_ZN5mongo12IndexCatalog23killMatchingIndexBuildsERKNS0_17IndexKillCriteriaE+0x218) [0x8da668]
       /usr/bin/mongod(_ZN5mongo12IndexBuilder23killMatchingIndexBuildsEPNS_10CollectionERKNS_12IndexCatalog17IndexKillCriteriaE+0x15) [0xb8aa95]
       /usr/bin/mongod(_ZN5mongo7CmdDrop15stopIndexBuildsEPNS_8DatabaseERKNS_7BSONObjE+0xe9) [0xa2f5a9]
       /usr/bin/mongod(_ZN5mongo7CmdDrop3runERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x1c0) [0xa31e80]
       /usr/bin/mongod(_ZN5mongo12_execCommandEPNS_7CommandERKSsRNS_7BSONObjEiRSsRNS_14BSONObjBuilderEb+0x3a) [0xa2939a]
       /usr/bin/mongod(_ZN5mongo7Command11execCommandEPS0_RNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x19b1) [0xa2b151]
       /usr/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_11_BufBuilderINS_16TrivialAllocatorEEERNS_14BSONObjBuilderEbi+0x6c6) [0xa2c9a6]
       /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0x973) [0xe547d3]
       /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x4fe) [0xeb8d9e]
       /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x50) [0xeb96b0]
       /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x19e) [0x117f0ee]
       /usr/bin/mongod() [0x122e4a9]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x8182) [0x7f41bf490182]
       /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f41be79530d]
      2014-10-30T08:33:23.307+0100 ***** SERVER RESTARTED *****
      

      In the same server we had this two related issues:
      SERVER-14494, SERVER-15038

      Attached you can see the log trace

        1. mongo_issue.txt
          7 kB
        2. mongod.issue15871.log
          45.14 MB

            Assignee:
            milkie@mongodb.com Eric Milkie
            Reporter:
            eduherraiz Edu Herraiz
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved: