[SERVER-17860] WiredTiger corruption without journal option Created: 02/Apr/15  Updated: 08/Apr/15  Resolved: 08/Apr/15

Status: Closed
Project: Core Server
Component/s: Storage, WiredTiger
Affects Version/s: 3.1.0
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Jonathan Abrahams Assignee: Michael Cahill (Inactive)
Resolution: Done Votes: 0
Labels: 32qa
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Tested
Operating System: ALL
Participants:

 Description   

A power cycle test, using wiredTiger as a storage engine, demonstrates that the file structure can become corrupted, if journaling is disabled:

2015-04-02T10:53:54.179-0400 I CONTROL  ***** SERVER RESTARTED *****
2015-04-02T10:53:54.182-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] MongoDB starting : pid=4436 port=27017 dbpath=/data/wiredTiger 64-bit host=WTCrash
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten]
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] ** NOTE: This is a development version (3.1.0) of MongoDB.
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] **       Not recommended for production.
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten]
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten]
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten]
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2015-04-02T10:53:54.323-0400 I CONTROL  [initandlisten]
2015-04-02T10:53:54.324-0400 I CONTROL  [initandlisten] db version v3.1.0
2015-04-02T10:53:54.324-0400 I CONTROL  [initandlisten] git version: 7d15cd965ccb3ad684d8ae4e4f09d5b1e9394552
2015-04-02T10:53:54.324-0400 I CONTROL  [initandlisten] OpenSSL version: OpenSSL 1.0.1f 6 Jan 2014
2015-04-02T10:53:54.324-0400 I CONTROL  [initandlisten] build info: Linux ip-10-225-167-110 3.13.0-24-generic #46-Ubuntu SMP Thu Apr 10 19:11:08 UTC 2014 x86_64 BOOST_LIB_VERSION=1_56
2015-04-02T10:53:54.324-0400 I CONTROL  [initandlisten] allocator: tcmalloc
2015-04-02T10:53:54.324-0400 I CONTROL  [initandlisten] options: { processManagement: { fork: true }, storage: { dbPath: "/data/wiredTiger", engine: "wiredTiger", journal: { enabled: false } }, systemLog: { destination: "file", logAppend: true, path: "/var/log/mongodb/mongod-wiredTiger.log" } }
2015-04-02T10:53:54.470-0400 I NETWORK  [initandlisten] waiting for connections on port 27017
2015-04-02T10:54:01.724-0400 I NETWORK  [initandlisten] connection accepted from 10.4.127.218:60535 #1 (1 connection now open)
2015-04-02T10:54:01.894-0400 I INDEX    [conn1] build index on: test.foo properties: { v: 1, key: { x: 1.0 }, name: "x_1", ns: "test.foo" }
2015-04-02T10:54:01.894-0400 I INDEX    [conn1] 	 building index using bulk method
2015-04-02T10:54:01.895-0400 I INDEX    [conn1] build index done.  scanned 0 total records. 0 secs
2015-04-02T10:54:01.895-0400 I COMMAND  [conn1] command test.$cmd command: createIndexes { createIndexes: "foo", indexes: [ { key: { x: 1.0 }, name: "x_1" } ] } keyUpdates:0 writeConflicts:0 numYields:0 reslen:113 locks:{} 156ms
2015-04-02T10:54:02.876-0400 I NETWORK  [initandlisten] connection accepted from 10.4.127.218:60536 #2 (2 connections now open)
2015-04-02T10:54:29.363-0400 I CONTROL  ***** SERVER RESTARTED *****
2015-04-02T10:54:29.515-0400 W -        [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty.
2015-04-02T10:54:29.515-0400 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
2015-04-02T10:54:29.516-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2015-04-02T10:54:29.565-0400 I STORAGE  [initandlisten] dropping unused ident: collection-0-5777078306202786140
2015-04-02T10:54:29.640-0400 I STORAGE  [initandlisten] dropping unused ident: collection-2-5777078306202786140
2015-04-02T10:54:29.706-0400 I STORAGE  [initandlisten] dropping unused ident: index-1-5777078306202786140
2015-04-02T10:54:29.739-0400 I STORAGE  [initandlisten] dropping unused ident: index-3-5777078306202786140
2015-04-02T10:54:29.865-0400 I STORAGE  [initandlisten] dropping unused ident: index-4-5777078306202786140
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten] MongoDB starting : pid=1449 port=27017 dbpath=/data/wiredTiger 64-bit host=WTCrash
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten]
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten] ** NOTE: This is a development version (3.1.0) of MongoDB.
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten] **       Not recommended for production.
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten]
2015-04-02T10:54:30.155-0400 I CONTROL  [initandlisten]
2015-04-02T10:54:30.155-0400 I CONTROL  [inita2015-04-02T10:55:21.157-0400 I CONTROL  ***** SERVER RESTARTED *****
2015-04-02T10:55:21.250-0400 W -        [initandlisten] Detected unclean shutdown - /data/wiredTiger/mongod.lock is not empty.
2015-04-02T10:55:21.250-0400 W STORAGE  [initandlisten] Recovering data from the last clean checkpoint.
2015-04-02T10:55:21.251-0400 I STORAGE  [initandlisten] wiredtiger_open config: create,cache_size=1G,session_max=20000,eviction=(threads_max=4),statistics=(fast),checkpoint=(wait=60,log_size=2GB),statistics_log=(wait=0),
2015-04-02T10:55:21.329-0400 E STORAGE  [initandlisten] WiredTiger (-31802) [1427986521:329633][1444:0x7f91bc171bc0], file:WiredTiger.wt, connection: WiredTiger.wt read error: failed to read 4096 bytes at offset 36864: WT_ERROR: non-specific WiredTiger error
2015-04-02T10:55:21.330-0400 I -        [initandlisten] Assertion: 28595:-31802: WT_ERROR: non-specific WiredTiger error
2015-04-02T10:55:21.390-0400 I STORAGE  [initandlisten] exception in initAndListen: 28595 -31802: WT_ERROR: non-specific WiredTiger error, terminating
2015-04-02T10:55:21.390-0400 I CONTROL  [initandlisten] dbexit:  rc: 100


Generated at Thu Feb 08 03:45:49 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.