Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-3101

wt printlog on MongoDB dbpath does not find journal directory on its own

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Works as Designed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The `wt printlog` command has trouble finding all the information it needs on its own. The following logs show:

      1. My shell is in a MongoDB dbpath
      2. Running `wt printlog` and `wt -h <path> printlog` fail
      3. Running `wt -C 'log=(path=journal)' works
      4. Copying files from the `journal` subdirectory into the dbpath also fixes the problem without needing the -C.

      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ ll
      total 660
      drwxrwxr-x 4 dgottlieb dgottlieb  4096 Dec 27 10:50 ./
      drwxrwxr-x 4 dgottlieb dgottlieb  4096 Dec 23 10:51 ../
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Nov 23 10:09 collection-0-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Nov 23 10:08 collection-10-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec  8 13:53 collection-13-434611696041382398.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Nov 23 10:08 collection-2-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec 14 11:13 collection-28-434611696041382398.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Nov 23 10:08 collection-4-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Nov 23 10:08 collection-6-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Nov 23 10:08 collection-8-2255271734864369033.wt
      drwxrwxr-x 2 dgottlieb dgottlieb  4096 Dec 14 11:20 diagnostic.data/
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Oct  7 18:11 index-11-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Nov 23 10:09 index-1-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec  8 13:53 index-14-434611696041382398.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec  8 13:53 index-15-434611696041382398.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec 14 11:13 index-29-434611696041382398.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec 14 11:13 index-30-434611696041382398.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Oct  4 12:53 index-3-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 32768 Oct  4 12:54 index-5-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Oct  4 13:36 index-7-2255271734864369033.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb 16384 Oct  7 18:11 index-9-2255271734864369033.wt
      drwxrwxr-x 2 dgottlieb dgottlieb  4096 Dec 14 11:50 journal/
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec 14 11:50 _mdb_catalog.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb     6 Nov 23 10:08 mongod.lock
      -rw-rw-r-- 1 dgottlieb dgottlieb 36864 Dec 14 11:50 sizeStorer.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb    95 Oct  4 11:28 storage.bson
      -rw-rw-r-- 1 dgottlieb dgottlieb    46 Dec 14 11:13 WiredTiger
      -rw-rw-r-- 1 dgottlieb dgottlieb  4096 Dec 27 10:50 WiredTigerLAS.wt
      -rw-rw-r-- 1 dgottlieb dgottlieb    21 Oct  4 11:28 WiredTiger.lock
      -rw-rw-r-- 1 dgottlieb dgottlieb   953 Dec 27 10:50 WiredTiger.turtle
      -rw-rw-r-- 1 dgottlieb dgottlieb 61440 Dec 27 10:50 WiredTiger.wt
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ ~/xgen/wiredtiger/wt printlog
      [
      lt-wt: printlog failed: Operation not supported
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ echo ~/xgen/wiredtiger/wt -h `pwd` printlog
      /home/dgottlieb/xgen/wiredtiger/wt -h /home/dgottlieb/Downloads/tmp/MongoDBCopy printlog
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ ~/xgen/wiredtiger/wt -h `pwd` printlog
      [
      lt-wt: printlog failed: Operation not supported
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ cp journal/* ./
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ ~/xgen/wiredtiger/wt printlog
      [
        { "lsn" : [6,128],
          "hdr_flags" : "",
          "rec_len" : 128,
          "mem_len" : 128,
          "type" : "checkpoint",
          "ckpt_lsn" : [6,128]
        },
        { "lsn" : [6,256],
          "hdr_flags" : "",
          "rec_len" : 128,
          "mem_len" : 128,
          "type" : "commit",
          "txnid" : 390,
          "ops": [
            { "optype": "row_remove",
              "fileid": "0",
              "key": "file:WiredTigerLAS.wt\u0000"
            }
          ]
        },
        { "lsn" : [6,384],
          "hdr_flags" : "",
          "rec_len" : 128,
          "mem_len" : 128,
          "type" : "file_sync",
          "fileid" : 0,
          "start" : 0
      [1482854543:254211][1755:0x7f37eb0ee740]: log_decompress: Compressed record with no configured compressor: WT_ERROR: non-specific WiredTiger error
      lt-wt: printlog failed: WT_ERROR: non-specific WiredTiger error
        }
      <snip, remove the copy of the journal files>
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ ~/xgen/wiredtiger/wt printlog
      [
      lt-wt: printlog failed: Operation not supported
      dgottlieb@keylime ~/Downloads/tmp/MongoDBCopy$ ~/xgen/wiredtiger/wt -C 'log=(path=journal)' printlog
      [
        { "lsn" : [6,128],
          "hdr_flags" : "",
          "rec_len" : 128,
          "mem_len" : 128,
          "type" : "checkpoint",
          "ckpt_lsn" : [6,128]
        },
        { "lsn" : [6,256],
          "hdr_flags" : "",
          "rec_len" : 128,
          "mem_len" : 128,
          "type" : "commit",
          "txnid" : 390,
          "ops": [
            { "optype": "row_remove",
              "fileid": "0",
              "key": "file:WiredTigerLAS.wt\u0000"
            }
          ]
        },
        { "lsn" : [6,384],
          "hdr_flags" : "",
          "rec_len" : 128,
          "mem_len" : 128,
          "type" : "file_sync",
          "fileid" : 0,
          "start" : 0
      [1482854620:229][1836:0x7fac64a48740]: log_decompress: Compressed record with no configured compressor: WT_ERROR: non-specific WiredTiger error
      lt-wt: printlog failed: WT_ERROR: non-specific WiredTiger error
        }
      

        Attachments

          Activity

            People

            • Assignee:
              keith.bostic Keith Bostic
              Reporter:
              daniel.gottlieb Daniel Gottlieb
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: