[SERVER-4877] Iinserting on mogod get error "bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database code : 16 13440 n : 16 0" Created: 06/Feb/12  Updated: 11/Mar/12  Resolved: 11/Mar/12

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: 2.1.0
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: jitendra Assignee: Unassigned
Resolution: Done Votes: 1
Labels: sharding
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Run 10 mongod shards, 1 config server,1 mongos with journal option enabled. Inserting on mongodb by mongodb c driver.System restart and try to insert data on mongodb by mongodb c driver it give error in getlasterror
ok : 1 1.000000
singleShard : 2 192.168.50.113:60000
err : 2 bad offset:0 accessing file: /sata1/shard9/00030212.0 -
consider repairing database
code : 16 13440
n : 16 0
connectionId : 16 1

mongod log are below

Fri Feb 3 23:51:03 [conn1] insert 00030212.Database 103ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:03 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData
Fri Feb 3 23:51:03 [conn1] insert 00030212.Database 17ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:03 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData

please give me solution for this problem.

.


Operating System: Linux
Participants:

 Comments   
Comment by Eliot Horowitz (Inactive) [ 06/Feb/12 ]

That wasn't my question.
The question was did you keep the journal but delete the data?
It looks like something like that.

Comment by jitendra [ 06/Feb/12 ]

wipe data is solution for this.this is risky.

Comment by Eliot Horowitz (Inactive) [ 06/Feb/12 ]

Did you wipe the data but leave the journal?

Comment by jitendra [ 06/Feb/12 ]

ya, there was an old journal with an unclean shutdown, after restart first insert give the error.

Comment by Eliot Horowitz (Inactive) [ 06/Feb/12 ]

Looks like there was an old journal with an unclean shutdown.
Are you sure this is new?

Comment by jitendra [ 06/Feb/12 ]

Fri Feb 3 23:40:04 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:40:04 [conn2] insert 00030212.Database 17ms
Fri Feb 3 23:40:04 [conn2] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:04 [conn2] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:04 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:40:04 [conn2] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:04 [conn2] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:04 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:40:04 [conn2] insert 00030212.Database 23ms
Fri Feb 3 23:40:04 [conn2] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:04 [conn2] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:04 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:40:05 [conn2] insert 00030212.Database 19ms
Fri Feb 3 23:40:05 [conn2] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:05 [conn2] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:05 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:40:05 [conn2] insert 00030212.Database 25ms
Fri Feb 3 23:40:05 [conn2] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:05 [conn2] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:05 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:40:06 [conn2] insert 00030212.Database 24ms
Fri Feb 3 23:40:06 [conn2] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:06 [conn2] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:40:06 [conn2] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms

          • SERVER RESTARTED *****

Fri Feb 3 23:45:28 BackgroundJob starting: DataFileSync
Fri Feb 3 23:45:28 isInRangeTest passed
Fri Feb 3 23:45:28 shardKeyTest passed
Fri Feb 3 23:45:28 shardObjTest passed
Fri Feb 3 23:45:28 versionCmpTest passed
Fri Feb 3 23:45:28 versionArrayTest passed
Fri Feb 3 23:45:28 [initandlisten] MongoDB starting : pid=3214 port=60000 dbpath=/sata1/shard9 64-bit host=debian
Fri Feb 3 23:45:28 [initandlisten] db version v2.0.2, pdfile version 4.5
Fri Feb 3 23:45:28 [initandlisten] git version: 514b122d308928517f5841888ceaa4246a7f18e3
Fri Feb 3 23:45:28 [initandlisten] build info: Linux bs-linux64.10gen.cc 2.6.21.7-2.ec2.v1.2.fc8xen #1 SMP Fri Nov 20 17:48:28 EST 2009 x86_64 BOOST_LIB_VERSION=1_41
Fri Feb 3 23:45:28 [initandlisten] options:

{ bind_ip: "-all", dbpath: "/sata1/shard9", journalCommitInterval: 2, logappend: true, logpath: "/usr/local/ct/depend/mongo/logs/mongod_60000.log", port: 60000, quiet: true, shardsvr: true, vvv: true }

Fri Feb 3 23:45:29 [initandlisten] flushing directory /sata1/shard9
Fri Feb 3 23:45:59 [initandlisten] journal dir=/sata1/shard9/journal
Fri Feb 3 23:45:59 [initandlisten] recover begin
Fri Feb 3 23:45:59 [initandlisten] recover lsn: 1176651
Fri Feb 3 23:45:59 [initandlisten] recover /sata1/shard9/journal/j._0
Fri Feb 3 23:45:59 [initandlisten] recover skipping application of section seq:938030 < lsn:1176651
Fri Feb 3 23:46:00 [initandlisten] recover skipping application of section seq:997681 < lsn:1176651
Fri Feb 3 23:46:00 [initandlisten] recover skipping application of section seq:1057351 < lsn:1176651
Fri Feb 3 23:46:00 [initandlisten] recover skipping application of section seq:1117001 < lsn:1176651
Fri Feb 3 23:46:02 [initandlisten] recover cleaning up
Fri Feb 3 23:46:03 [initandlisten] removeJournalFiles
Fri Feb 3 23:46:05 [initandlisten] flushing directory /sata1/shard9/journal
Fri Feb 3 23:46:28 [DataFileSync] flushing mmap took 0ms for 0 files
Fri Feb 3 23:46:38 [initandlisten] removeJournalFiles end
Fri Feb 3 23:46:38 [initandlisten] recover done
Fri Feb 3 23:46:39 [initandlisten] preallocating a journal file /sata1/shard9/journal/prealloc.0
20971520/1073741824 1%
62914560/1073741824 5%
115343360/1073741824 10%
125829120/1073741824 11%
136314880/1073741824 12%
157286400/1073741824 14%
199229440/1073741824 18%
230686720/1073741824 21%
241172480/1073741824 22%
251658240/1073741824 23%
293601280/1073741824 27%
314572800/1073741824 29%
Fri Feb 3 23:47:28 [DataFileSync] flushing mmap took 0ms for 0 files
335544320/1073741824 31%
346030080/1073741824 32%
377487360/1073741824 35%
387973120/1073741824 36%
398458880/1073741824 37%
429916160/1073741824 40%
461373440/1073741824 42%
482344960/1073741824 44%
524288000/1073741824 48%
555745280/1073741824 51%
566231040/1073741824 52%
587202560/1073741824 54%
608174080/1073741824 56%
629145600/1073741824 58%
660602880/1073741824 61%
671088640/1073741824 62%
Fri Feb 3 23:48:28 [DataFileSync] flushing mmap took 0ms for 0 files
692060160/1073741824 64%
723517440/1073741824 67%
744488960/1073741824 69%
765460480/1073741824 71%
796917760/1073741824 74%
817889280/1073741824 76%
849346560/1073741824 79%
859832320/1073741824 80%
870318080/1073741824 81%
901775360/1073741824 83%
933232640/1073741824 86%
964689920/1073741824 89%
985661440/1073741824 91%
1027604480/1073741824 95%
1059061760/1073741824 98%
Fri Feb 3 23:49:28 [DataFileSync] flushing mmap took 0ms for 0 files
Fri Feb 3 23:49:36 [initandlisten] flushing directory /sata1/shard9/journal
Fri Feb 3 23:49:36 [initandlisten] flushing directory /sata1/shard9/journal
Fri Feb 3 23:49:37 [initandlisten] runQuery called local.system.namespaces

{ name: /^local.temp./ }

Fri Feb 3 23:49:37 [initandlisten] Accessing: local for the first time
Fri Feb 3 23:49:37 [initandlisten] query local.system.namespaces reslen:20 0ms
Fri Feb 3 23:49:37 [initandlisten] enter repairDatabases (to check pdfile version #)
Fri Feb 3 23:49:37 [initandlisten] 00250112
Fri Feb 3 23:49:37 [initandlisten] Accessing: 00250112 for the first time
Fri Feb 3 23:49:37 [initandlisten] 00060212
Fri Feb 3 23:49:37 [initandlisten] Accessing: 00060212 for the first time
Fri Feb 3 23:49:37 [initandlisten] 00030212
Fri Feb 3 23:49:37 [initandlisten] Accessing: 00030212 for the first time
Fri Feb 3 23:49:38 [initandlisten] 00280112
Fri Feb 3 23:49:38 [initandlisten] Accessing: 00280112 for the first time
Fri Feb 3 23:49:38 [initandlisten] 00240112
Fri Feb 3 23:49:38 [initandlisten] Accessing: 00240112 for the first time
Fri Feb 3 23:49:38 [initandlisten] Accessing: 00260112 for the first time
Fri Feb 3 23:49:38 [initandlisten] 00020212
Fri Feb 3 23:49:38 [initandlisten] Accessing: 00020212 for the first time
Fri Feb 3 23:49:38 [initandlisten] done repairDatabases
Fri Feb 3 23:49:38 BackgroundJob starting: ClientCursorMonitor
Fri Feb 3 23:49:38 [initandlisten] fd limit hard:1024 soft:1024 max conn: 819
Fri Feb 3 23:49:38 [websvr] fd limit hard:1024 soft:1024 max conn: 819
Fri Feb 3 23:49:38 BackgroundJob starting: snapshot
Fri Feb 3 23:49:38 BackgroundJob starting: PeriodicTask::Runner
Fri Feb 3 23:49:38 [initandlisten] getaddrinfo("-all") failed: No address associated with hostname
Fri Feb 3 23:49:38 [initandlisten] waiting for connections on port 60000
Fri Feb 3 23:49:38 [websvr] getaddrinfo("-all") failed: No address associated with hostname
Fri Feb 3 23:49:38 [websvr] admin web console waiting for connections on port 61000
Fri Feb 3 23:50:28 [DataFileSync] flushing mmap took 0ms for 1 files
Fri Feb 3 23:50:38 [PeriodicTask::Runner] task: WriteBackManager::cleaner took: 0ms
Fri Feb 3 23:50:38 [PeriodicTask::Runner] task: DBConnectionPool-cleaner took: 0ms
Fri Feb 3 23:50:38 [PeriodicTask::Runner] task: DBConnectionPool-cleaner took: 0ms
Fri Feb 3 23:50:59 [conn1] runQuery called admin.$cmd

{ setShardVersion: "", init: true, configdb: "192.168.50.113:30000", serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true }

Fri Feb 3 23:50:59 [conn1] run command admin.$cmd

{ setShardVersion: "", init: true, configdb: "192.168.50.113:30000", serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true }

Fri Feb 3 23:50:59 [conn1] command:

{ setShardVersion: "", init: true, configdb: "192.168.50.113:30000", serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true }

Fri Feb 3 23:50:59 [conn1] entering shard mode for connection
Fri Feb 3 23:50:59 [conn1] adding sharding hook
Fri Feb 3 23:50:59 [conn1] config string : 192.168.50.113:30000
Fri Feb 3 23:50:59 [conn1] command admin.$cmd command:

{ setShardVersion: "", init: true, configdb: "192.168.50.113:30000", serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true }

ntoreturn:1 reslen:51 0ms
Fri Feb 3 23:50:59 [conn1] runQuery called admin.$cmd

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), shard: "shard0008", shardHost: "192.168.50.113:60000" }

Fri Feb 3 23:50:59 [conn2] runQuery called admin.$cmd

{ writebacklisten: ObjectId('4f2c2581300f707ca5d3c4db') }

Fri Feb 3 23:50:59 [conn2] run command admin.$cmd

{ writebacklisten: ObjectId('4f2c2581300f707ca5d3c4db') }

Fri Feb 3 23:50:59 [conn1] run command admin.$cmd

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), shard: "shard0008", shardHost: "192.168.50.113:60000" }

Fri Feb 3 23:50:59 [conn2] command:

{ writebacklisten: ObjectId('4f2c2581300f707ca5d3c4db') }

Fri Feb 3 23:50:59 [conn1] command:

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), shard: "shard0008", shardHost: "192.168.50.113:60000" }

Fri Feb 3 23:50:59 [conn1] command admin.$cmd command:

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), shard: "shard0008", shardHost: "192.168.50.113:60000" }

ntoreturn:1 reslen:162 0ms
Fri Feb 3 23:50:59 [conn1] runQuery called admin.$cmd

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true, shard: "shard0008", shardHost: "192.168.50.113:60000" }

Fri Feb 3 23:50:59 [conn1] run command admin.$cmd

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true, shard: "shard0008", shardHost: "192.168.50.113:60000" }

Fri Feb 3 23:50:59 [conn1] command:

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true, shard: "shard0008", shardHost: "192.168.50.113:60000" }

Fri Feb 3 23:50:59 [conn1] creating new connection to:192.168.50.113:30000
Fri Feb 3 23:50:59 BackgroundJob starting: ConnectBG
Fri Feb 3 23:50:59 [conn1] connected connection!
Fri Feb 3 23:50:59 [conn1] command admin.$cmd command:

{ setShardVersion: "00030212.Database", configdb: "192.168.50.113:30000", version: Timestamp 18000|0, serverID: ObjectId('4f2c2581300f707ca5d3c4db'), authoritative: true, shard: "shard0008", shardHost: "192.168.50.113:60000" }

ntoreturn:1 reslen:57 2ms
Fri Feb 3 23:50:59 [conn1] Accessing: 00030212 for the first time
Fri Feb 3 23:51:00 [conn1] insert 00030212.Database 218ms
Fri Feb 3 23:51:00 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:00 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:00 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:00 [journal] lsn set 48790
Fri Feb 3 23:51:00 [conn1] insert 00030212.Database 40ms
Fri Feb 3 23:51:00 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:00 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:00 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:00 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:01 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:01 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:01 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:01 [conn1] insert 00030212.Database 35ms
Fri Feb 3 23:51:01 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:01 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:01 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:01 [conn1] insert 00030212.Database 29ms
Fri Feb 3 23:51:01 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:01 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:01 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:02 [conn1] insert 00030212.Database 29ms
Fri Feb 3 23:51:02 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:02 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:02 [conn1] insert 00030212.Database 20ms
Fri Feb 3 23:51:02 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:02 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:02 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:67 0ms
Fri Feb 3 23:51:03 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:03 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData
Fri Feb 3 23:51:03 [conn1] insert 00030212.Database 103ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:03 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData
Fri Feb 3 23:51:03 [conn1] insert 00030212.Database 17ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:03 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:03 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData
Fri Feb 3 23:51:03 [conn1] insert 00030212.Database 14ms
Fri Feb 3 23:51:03 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:03 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:04 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:04 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData
Fri Feb 3 23:51:04 [conn1] insert 00030212.Database 38ms
Fri Feb 3 23:51:04 [conn1] runQuery called admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:04 [conn1] run command admin.$cmd

{ getlasterror: 1 }

Fri Feb 3 23:51:04 [conn1] command admin.$cmd command:

{ getlasterror: 1 }

ntoreturn:1 reslen:165 0ms
Fri Feb 3 23:51:04 [conn1] User Assertion: 13440:bad offset:0 accessing file: /sata1/shard9/00030212.0 - consider repairing database
Fri Feb 3 23:51:04 [conn1] 00030212.Database caught assertion _indexRecord 00030212.Database.$_sk_1 _id: BinData

Comment by Scott Hernandez (Inactive) [ 06/Feb/12 ]

Can you attach the logs from the server for the time after it restarted (when your manually pressed the reset button on the computer)?

Comment by jitendra [ 06/Feb/12 ]

This was with new data.I have not disabled journaling on the shard.
I restart manually by press pressing button.

Comment by Scott Hernandez (Inactive) [ 06/Feb/12 ]

Was this only with new data, or did you have old data from before using 2.1.0? Have you disabled journaling on the shards?

How did the system restart? Was it a clean shutdown or some system error?

Generated at Thu Feb 08 03:07:14 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.