Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16573

Mongod terminates when no space is available with wiredTiger

    • Type: Icon: Bug Bug
    • Resolution: Duplicate
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 2.8.0-rc2
    • Component/s: Storage
    • Labels:
    • ALL

      The situation where there is insufficient space on the device for the database is handled differently be mmapv1 and wiredTiger. mongod aborts with wiredTiger, but not mmapv1.

      mmapv1:

      2014-12-17T14:45:22.001+0000 I STORAGE  [FileAllocator] allocating new datafile /data/db/test.1, filling with zeroes...
      2014-12-17T14:45:22.002+0000 I STORAGE  [FileAllocator] FileAllocator: posix_fallocate failed: errno:28 No space left on device falling back
      2014-12-17T14:45:22.002+0000 I STORAGE  [FileAllocator] error: failed to allocate new file: /data/db/test.1 size: 134217728 failure creating new datafile; lseek failed for fd 13 with errno: errno:2 No such file or directory.  will try again in 10 seconds
      

      wiredTiger:

      2014-12-17T14:46:31.902+0000 E STORAGE  [initandlisten] WiredTiger (28) [1418827591:902654][14757:0x7fd2d8e29b60], connection: journal/WiredTigerLog.0000000082 write error: failed to write 128 bytes at offset 0: No space left on device
      2014-12-17T14:46:41.939+0000 E STORAGE  [initandlisten] WiredTiger (28) [1418827601:939445][14757:0x7fd2d8e29b60], sweep-server: journal/WiredTigerLog.0000000082 write error: failed to write 128 bytes at offset 128: No space left on device
      2014-12-17T14:46:41.940+0000 I -        [initandlisten] Invariant failure ret UnknownError 28: No space left on device src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp 154
      2014-12-17T14:46:41.959+0000 I CONTROL  [initandlisten]
       0xf0cfa9 0xeb6d41 0xe9e129 0xd2f474 0xd2d647 0xa5b591 0x7da70f 0x7df2f4 0x3356a1ecdd 0x7d8469
      ----- BEGIN BACKTRACE -----
      {"backtrace":[{"b":"400000","o":"B0CFA9"},{"b":"400000","o":"AB6D41"},{"b":"400000","o":"A9E129"},{"b":"400000","o":"92F474"},{"b":"400000","o":"92D647"},{"b":"400000","o":"65B591"},{"b":"400000","o":"3DA70F"},{"b":"400000","o":"3DF2F4"},{"b":"3356A00000","o":"1ECDD"},{"b":"400000","o":"3D8469"}],"processInfo":{ "mongodbVersion" : "2.8.0-rc2", "gitVersion" : "f77869e01a6ed235695a46fad441c0dff15202f6", "uname" : { "sysname" : "Linux", "release" : "2.6.32-358.el6.x86_64", "version" : "#1 SMP Fri Feb 22 00:31:26 UTC 2013", "machine" : "x86_64" }, "somap" : [ { "elfType" : 2, "b" : "400000" }, { "b" : "7FFF6A82A000", "elfType" : 3 }, { "path" : "/lib64/libpthread.so.0", "elfType" : 3 }, { "path" : "/lib64/librt.so.1", "elfType" : 3 }, { "path" : "/lib64/libdl.so.2", "elfType" : 3 }, { "path" : "/usr/lib64/libstdc++.so.6", "elfType" : 3 }, { "path" : "/lib64/libm.so.6", "elfType" : 3 }, { "path" : "/lib64/libgcc_s.so.1", "elfType" : 3 }, { "path" : "/lib64/libc.so.6", "elfType" : 3 }, { "path" : "/lib64/ld-linux-x86-64.so.2", "elfType" : 3 } ] }}
       mongod(_ZN5mongo15printStackTraceERSo+0x29) [0xf0cfa9]
       mongod(_ZN5mongo10logContextEPKc+0xE1) [0xeb6d41]
       mongod(_ZN5mongo17invariantOKFailedEPKcRKNS_6StatusES1_j+0xB9) [0xe9e129]
       mongod(_ZN5mongo18WiredTigerKVEngineC2ERKSsS2_b+0x684) [0xd2f474]
       mongod(+0x92D647) [0xd2d647]
       mongod(_ZN5mongo23GlobalEnvironmentMongoD22setGlobalStorageEngineERKSs+0x131) [0xa5b591]
       mongod(_ZN5mongo13initAndListenEi+0x6EF) [0x7da70f]
       mongod(main+0x134) [0x7df2f4]
       libc.so.6(__libc_start_main+0xFD) [0x3356a1ecdd]
       mongod(+0x3D8469) [0x7d8469]
      -----  END BACKTRACE  -----
      2014-12-17T14:46:41.960+0000 I -        [initandlisten]
      
      ***aborting after invariant() failure
      

            Assignee:
            Unassigned Unassigned
            Reporter:
            jonathan.abrahams Jonathan Abrahams
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: