ERROR: 13601 Couldn't remap private view: errno:12 Cannot allocate memory

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Duplicate
    • Priority: Major - P3
    • None
    • Affects Version/s: 1.8.0-rc1
    • Component/s: None
    • None
    • Environment:
    • Linux
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      mongod with --dur enabled crashed during initial replica sync. Had re-synced another member of the same set yesterday, but with --dur disabled.

      Tue Mar 8 15:42:26 [conn17] query admin.$cmd ntoreturn:1 command:

      { writebacklisten: ObjectId('4d67ad81e97c2a1ce3d5ec21') }

      reslen:60 300037ms
      6361400/12622543 50%
      Tue Mar 8 15:42:33 [conn8] query admin.$cmd ntoreturn:1 command:

      { writebacklisten: ObjectId('4d6be173f9824b3eeb5a29b5') }

      reslen:60 300037ms
      7490400/12622543 59%
      8694400/12622543 68%
      9825600/12622543 77%
      10759800/12622543 85%
      11843200/12622543 93%
      Tue Mar 8 15:43:30 [replica set sync] done building bottom layer, going to commit
      Tue Mar 8 15:44:09 [replica set sync] done for 12622543 records 388.626secs
      Tue Mar 8 15:44:09 [replica set sync] info: indexing in foreground on this replica; was a background index build on the primary
      Tue Mar 8 15:44:09 [replica set sync] building new index on

      { p: 1.0 }

      for sd.metrics_110224
      1307800/4276440 30%
      2424900/4276440 56%
      3062600/4276440 71%
      4000000/4276440 93%
      Tue Mar 8 15:44:54 [replica set sync] external sort used : 5 files in 44 secs
      2272200/4276440 53%
      Tue Mar 8 15:45:09 [replica set sync] done building bottom layer, going to commit
      Tue Mar 8 15:45:10 [replica set sync] done for 4276440 records 61.114secs
      Tue Mar 8 15:45:10 [replica set sync] info: indexing in foreground on this replica; was a background index build on the primary
      Tue Mar 8 15:45:10 [replica set sync] building new index on

      { p: 1.0 }

      for sd.metrics_110225
      1000000/4261678 23%
      1893600/4261678 44%
      2604200/4261678 61%
      3287700/4261678 77%
      Tue Mar 8 15:46:00 [replica set sync] external sort used : 5 files in 49 secs
      Tue Mar 8 15:46:03 [replica set sync] ERROR: 13601 Couldn't remap private view: errno:12 Cannot allocate memory
      Tue Mar 8 15:46:03 [replica set sync] aborting
      Tue Mar 8 15:46:03 Got signal: 6 (Aborted).

      Tue Mar 8 15:46:04 Backtrace:
      0x8a4c29 0x30ac2302d0 0x30ac230265 0x30ac231d10 0x5bc4df 0x629d7d 0x62de32 0x62e225 0x62e944 0x67e60f 0x684d12 0x776cf9 0x777a78 0x7794d0 0x77a91f 0x7251b8 0x726b2d 0x727b6d 0x70e002 0x70fa78
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x8a4c29]
      /lib64/libc.so.6 [0x30ac2302d0]
      /lib64/libc.so.6(gsignal+0x35) [0x30ac230265]
      /lib64/libc.so.6(abort+0x110) [0x30ac231d10]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo16MemoryMappedFile16remapPrivateViewEPv+0x10f) [0x5bc4df]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo8MongoMMF19remapThePrivateViewEv+0x4d) [0x629d7d]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo3dur17_REMAPPRIVATEVIEWEv+0x212) [0x62de32]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo3dur16REMAPPRIVATEVIEWEv+0x25) [0x62e225]
      /home/david/mongodb/latest/bin/mongod [0x62e944]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo12BtreeBuilder24mayCommitProgressDurablyEv+0x2f) [0x67e60f]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo12BtreeBuilder6addKeyERNS_7BSONObjENS_7DiskLocE+0xd2) [0x684d12]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo14fastBuildIndexEPKcPNS_16NamespaceDetailsERNS_12IndexDetailsEi+0xf99) [0x776cf9]
      /home/david/mongodb/latest/bin/mongod [0x777a78]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11DataFileMgr6insertEPKcPKvibRKNS_11BSONElementEb+0xf60) [0x7794d0]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11DataFileMgr16insertWithObjModEPKcRNS_7BSONObjEb+0x5f) [0x77a91f]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo6Cloner4copyEPKcS2_bbbbNS_5QueryE+0x3a8) [0x7251b8]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo6Cloner2goEPKcRSsRKSsbbbb+0x10cd) [0x726b2d]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo9cloneFromEPKcRSsRKSsbbbb+0x3d) [0x727b6d]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11ReplSetImpl18_syncDoInitialSyncEv+0xf12) [0x70e002]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11ReplSetImpl17syncDoInitialSyncEv+0x28) [0x70fa78]

      Tue Mar 8 15:46:04 terminate() called, printing stack:
      0x8a3ebd 0x30b2abcdb6 0x30b2abcde3 0x30b2abd2ef 0x7dc554 0x7dd831 0x645405 0x649941 0x757ad5 0x75a000 0x8a80ae 0x8b84f0 0x30aca0673d 0x30ac2d3f6d
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11myterminateEv+0x4d) [0x8a3ebd]
      /usr/lib64/libstdc++.so.6 [0x30b2abcdb6]
      /usr/lib64/libstdc++.so.6 [0x30b2abcde3]
      /usr/lib64/libstdc++.so.6 [0x30b2abd2ef]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xbf4) [0x7dc554]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dd831]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x645405]
      /home/david/mongodb/latest/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x32e1) [0x649941]
      /home/david/mongodb/latest/bin/mongod [0x757ad5]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b0) [0x75a000]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo10connThreadEPNS_13MessagingPortE+0x21e) [0x8a80ae]
      /home/david/mongodb/latest/bin/mongod(thread_proxy+0x80) [0x8b84f0]
      /lib64/libpthread.so.0 [0x30aca0673d]
      /lib64/libc.so.6(clone+0x6d) [0x30ac2d3f6d]
      Tue Mar 8 15:46:04 Got signal: 6 (Aborted).

      Tue Mar 8 15:46:04 Backtrace:
      0x8a4c29 0x30ac2302d0 0x30ac230265 0x30ac231d10 0x8a3f8b 0x30b2abcdb6 0x30b2abcde3 0x30b2abd2ef 0x7dc554 0x7dd831 0x645405 0x649941 0x757ad5 0x75a000 0x8a80ae 0x8b84f0 0x30aca0673d 0x30ac2d3f6d
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x8a4c29]
      /lib64/libc.so.6 [0x30ac2302d0]
      /lib64/libc.so.6(gsignal+0x35) [0x30ac230265]
      /lib64/libc.so.6(abort+0x110) [0x30ac231d10]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11myterminateEv+0x11b) [0x8a3f8b]
      /usr/lib64/libstdc++.so.6 [0x30b2abcdb6]
      /usr/lib64/libstdc++.so.6 [0x30b2abcde3]
      /usr/lib64/libstdc++.so.6 [0x30b2abd2ef]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0xbf4) [0x7dc554]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dd831]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x645405]
      /home/david/mongodb/latest/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x32e1) [0x649941]
      /home/david/mongodb/latest/bin/mongod [0x757ad5]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b0) [0x75a000]
      /home/david/mongodb/latest/bin/mongod(_ZN5mongo10connThreadEPNS_13MessagingPortE+0x21e) [0x8a80ae]
      /home/david/mongodb/latest/bin/mongod(thread_proxy+0x80) [0x8b84f0]
      /lib64/libpthread.so.0 [0x30aca0673d]
      /lib64/libc.so.6(clone+0x6d) [0x30ac2d3f6d]

      Tue Mar 8 15:46:04 [conn5] ERROR: Client::shutdown not called: conn

            Assignee:
            Unassigned
            Reporter:
            David Mytton
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: