Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-3135

mmap private failed with out of memory - Assertion: 13636:createPrivateMap failed

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Blocker - P1 Blocker - P1
    • None
    • 1.8.1
    • None
    • None
    • CentOS release 5.4 (Final) Kernel 2.6.18-194.17.1.el5
    • Linux

    Description

      Possibly related to SERVER-2597 but without crash.
      On a 64bit system I start mongo 1.8.1 on existing data (30G) which was created by MongoDB 1.6.5 (which never caused problems):

      /data/labs/bin/mongod --dbpath /data/labs/db --nohttpinterface --journal --port 5003

      Everything I do end up in an exception, even in db shell:

      > db.stats()
      {
      "assertion" : "createPrivateMap failed (look in log for error)",
      "assertionCode" : 13636,
      "errmsg" : "db assertion failure",
      "ok" : 0
      }
      > show dbs
      Tue May 24 15:47:16 uncaught exception: listDatabases failed:{
      "errmsg" : "exception: createPrivateMap failed (look in log for error)",
      "code" : 13636,
      "ok" : 0
      }

      The exception taken from command line is:

      Tue May 24 15:46:08 [initandlisten] MongoDB starting : pid=24245 port=5003 dbpath=/data/labs/db/ 64-bit
      Tue May 24 15:46:08 [initandlisten] db version v1.8.1, pdfile version 4.5
      Tue May 24 15:46:08 [initandlisten] git version: a429cd4f535b2499cc4130b06ff7c26f41c00f04
      Tue May 24 15:46:08 [initandlisten] build sys info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
      Tue May 24 15:46:08 [initandlisten] journal dir=/data/labs/db/journal
      Tue May 24 15:46:08 [initandlisten] recover : no journal files present, no recovery needed
      Tue May 24 15:46:08 [initandlisten] waiting for connections on port 5003
      Tue May 24 15:46:42 [initandlisten] connection accepted from 127.0.0.1:50990 #1
      Tue May 24 15:46:48 [conn1] ERROR: mmap private failed with out of memory. (64 bit build)
      Tue May 24 15:46:48 [conn1] Assertion: 13636:createPrivateMap failed (look in log for error)
      0x55ece9 0x627520 0x627e8c 0x773c2a 0x7677bb 0x767e42 0x769c29 0x76a43b 0x762056 0x76286e 0x7db1cf 0x7dc741 0x642c25 0x6477c6 0x752225 0x757938 0x8a3b3e 0x8b6a40 0x3ed3406617 0x3ed2cd3c2d
      /data/labs/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x129) [0x55ece9]
      /data/labs/bin/mongod(_ZN5mongo8MongoMMF13finishOpeningEv+0x60) [0x627520]
      /data/labs/bin/mongod(_ZN5mongo8MongoMMF6createESsRyb+0x6c) [0x627e8c]
      /data/labs/bin/mongod(_ZN5mongo13MongoDataFile4openEPKcib+0x13a) [0x773c2a]
      /data/labs/bin/mongod(_ZN5mongo8Database7getFileEiib+0x17b) [0x7677bb]
      /data/labs/bin/mongod(_ZN5mongo8Database12openAllFilesEv+0x22) [0x767e42]
      /data/labs/bin/mongod(_ZN5mongo8DatabaseC1EPKcRbRKSs+0x459) [0x769c29]
      /data/labs/bin/mongod(_ZN5mongo14DatabaseHolder11getOrCreateERKSsS2_Rb+0x5bb) [0x76a43b]
      /data/labs/bin/mongod(_ZN5mongo6Client7Context11_finishInitEb+0x516) [0x762056]
      /data/labs/bin/mongod(_ZN5mongo6Client7ContextC1ERKSsSsPNS_9mongolockEb+0x7e) [0x76286e]
      /data/labs/bin/mongod(_ZN5mongo11execCommandEPNS_7CommandERNS_6ClientEiPKcRNS_7BSONObjERNS_14BSONObjBuilderEb+0x95f) [0x7db1cf]
      /data/labs/bin/mongod(_ZN5mongo12_runCommandsEPKcRNS_7BSONObjERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x831) [0x7dc741]
      /data/labs/bin/mongod(_ZN5mongo11runCommandsEPKcRNS_7BSONObjERNS_5CurOpERNS_10BufBuilderERNS_14BSONObjBuilderEbi+0x35) [0x642c25]
      /data/labs/bin/mongod(ZN5mongo8runQueryERNS_7MessageERNS_12QueryMessageERNS_5CurOpES1+0x2e86) [0x6477c6]
      /data/labs/bin/mongod [0x752225]
      /data/labs/bin/mongod(_ZN5mongo16assembleResponseERNS_7MessageERNS_10DbResponseERKNS_8SockAddrE+0x5b8) [0x757938]
      /data/labs/bin/mongod(_ZN5mongo10connThreadEPNS_13MessagingPortE+0x21e) [0x8a3b3e]
      /data/labs/bin/mongod(thread_proxy+0x80) [0x8b6a40]
      /lib64/libpthread.so.0 [0x3ed3406617]
      /lib64/libc.so.6(clone+0x6d) [0x3ed2cd3c2d]

      More information:

      free -ltm
      total used free shared buffers cached
      Mem: 16056 12479 3576 0 1 10205
      Low: 16056 12479 3576
      High: 0 0 0
      -/+ buffers/cache: 2272 13783
      Swap: 16387 1839 14547
      Total: 32444 14319 18124

      ulimit -a
      core file size (blocks, -c) 0
      data seg size (kbytes, -d) unlimited
      scheduling priority (-e) 0
      file size (blocks, -f) unlimited
      pending signals (-i) 136192
      max locked memory (kbytes, -l) 32
      max memory size (kbytes, -m) unlimited
      open files (-n) 65536
      pipe size (512 bytes, -p) 8
      POSIX message queues (bytes, -q) 819200
      real-time priority (-r) 0
      stack size (kbytes, -s) 10240
      cpu time (seconds, -t) unlimited
      max user processes (-u) 136192
      virtual memory (kbytes, -v) unlimited
      file locks (-x) unlimited

      Attachments

        Activity

          People

            mathias@mongodb.com Mathias Stearn
            blask Sebastian Blask
            Votes:
            1 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: