Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-39266

file:WiredTiger.wt, connection: WiredTiger.turtle: encountered an illegal file format or internal value

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 3.4.16
    • Component/s: WiredTiger
    • Labels:
      None
    • Environment:
      Ubuntu
    • ALL

      Hi!

      There was an unexpectedly reboot on the server. And I don't have backups.

      Tried to upgrade from 3.4.16 to 4.0.5 and start with --repair option, but it doesn't help.

      Thanks in advance!

      Log file output:

      2019-01-29T19:35:17.988+0200 I CONTROL  [main] Automatically disabling TLS 1.0, to force-enable TLS 1.0 specify --sslDisabledProtocols 'none'
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] MongoDB starting : pid=3552 port=27017 dbpath=/var/lib/mongodb 64-bit host=locean
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] db version v4.0.5
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] git version: 3739429dd92b92d1b0ab120911a23d50bf03c412
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.0.2g  1 Mar 2016
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] allocator: tcmalloc
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] modules: none
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] build environment:
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten]     distmod: ubuntu1604
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten]     distarch: x86_64
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten]     target_arch: x86_64
      2019-01-29T19:35:17.994+0200 I CONTROL  [initandlisten] options: { config: "/etc/mongod.conf", net: { bindIp: "127.0.0.1", port: 27017 }, processManagement: { timeZoneInfo: "/usr/share/zoneinfo" }, repair: true$
      2019-01-29T19:35:18.006+0200 I STORAGE  [initandlisten] Detected data files in /var/lib/mongodb created by the 'wiredTiger' storage engine, so setting the active storage engine to 'wiredTiger'.
      2019-01-29T19:35:18.006+0200 I STORAGE  [initandlisten]
      2019-01-29T19:35:18.006+0200 I STORAGE  [initandlisten] ** WARNING: Using the XFS filesystem is strongly recommended with the WiredTiger storage engine
      2019-01-29T19:35:18.006+0200 I STORAGE  [initandlisten] **          See http://dochub.mongodb.org/core/prodnotes-filesystem
      2019-01-29T19:35:18.006+0200 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=256M,session_max=20000,eviction=(threads_min=4,threads_max=4),config_base=false,statistics=(fast),log=(enabled=t$
      2019-01-29T19:35:18.545+0200 E STORAGE  [initandlisten] WiredTiger error (-31803) [1548783318:545023][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, connection: __wt_turtle_read, 336: WiredTiger.turtle: fatal turtle$
      2019-01-29T19:35:18.545+0200 E STORAGE  [initandlisten] WiredTiger error (-31804) [1548783318:545064][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT$
      2019-01-29T19:35:18.548+0200 E STORAGE  [initandlisten] WiredTiger error (-31803) [1548783318:548823][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, connection: __wt_turtle_read, 336: WiredTiger.turtle: fatal turtle$
      2019-01-29T19:35:18.548+0200 E STORAGE  [initandlisten] WiredTiger error (-31804) [1548783318:548860][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT$
      2019-01-29T19:35:18.552+0200 E STORAGE  [initandlisten] WiredTiger error (-31803) [1548783318:552549][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, connection: __wt_turtle_read, 336: WiredTiger.turtle: fatal turtle$
      2019-01-29T19:35:18.552+0200 E STORAGE  [initandlisten] WiredTiger error (-31804) [1548783318:552619][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, connection: __wt_panic, 523: the process must exit and restart: WT$
      2019-01-29T19:35:18.553+0200 W STORAGE  [initandlisten] Failed to start up WiredTiger under any compatibility version.
      2019-01-29T19:35:18.553+0200 F STORAGE  [initandlisten] Reason: -31804: WT_PANIC: WiredTiger library panic
      2019-01-29T19:35:18.553+0200 W STORAGE  [initandlisten] Attempting to salvage WiredTiger metadata
      2019-01-29T19:35:18.573+0200 E STORAGE  [initandlisten] WiredTiger error (-31803) [1548783318:573691][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, WT_SESSION.salvage: __wt_turtle_read, 336: WiredTiger.turtle: fata$
      2019-01-29T19:35:18.573+0200 E STORAGE  [initandlisten] WiredTiger error (-31804) [1548783318:573750][3552:0x7fd4dc5b1a40], file:WiredTiger.wt, WT_SESSION.salvage: __wt_panic, 523: the process must exit and res$
      2019-01-29T19:35:18.574+0200 F STORAGE  [initandlisten] Failed to salvage WiredTiger metadata: -31804: WT_PANIC: WiredTiger library panic
      2019-01-29T19:35:18.574+0200 F -        [initandlisten] Fatal Assertion 50947 at src/mongo/db/storage/wiredtiger/wiredtiger_kv_engine.cpp 653
      2019-01-29T19:35:18.574+0200 F -        [initandlisten]***aborting after fassert() failure

        1. WiredTiger.zip
          14 kB
        2. repair.tar
          130 kB
        3. new_repair.tar
          130 kB

            Assignee:
            daniel.hatcher@mongodb.com Danny Hatcher (Inactive)
            Reporter:
            dmzotov Dmitrii Zotov
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

              Created:
              Updated:
              Resolved: