[SERVER-2307] Lost Index on collection after mongorestore Created: 30/Dec/10  Updated: 12/Jul/16  Resolved: 04/Jan/11

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 1.6.5
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: xuqing Assignee: Richard Kreuter (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

I have a collection contains about 4000 documents and another collection contains about 310000 documents.on this db,it has about 14 collections,and the max collection contains about 310000 documents.
I use the tool mongodump to back up my database from server and restore to my local machine for this test.
my server is linux,the dump command is:
/usr/local/mongodb/mongodump --out=/home/databak/mongo/201012301639/
my local machine is windows 7,the restore command is:
mongorestore --host=127.0.0.1 --db=myrestoretest --drop G:\Media\myrestoretest

after restore finished.I found that the index on the collection contains about 4000 documents and the other collection contains about 310000 documents lost.


Attachments: PNG File Index on client after restore.png     PNG File Index on server.png     PNG File data size on server.png     PNG File dump files on server.png    
Operating System: ALL
Participants:

 Comments   
Comment by Eliot Horowitz (Inactive) [ 04/Jan/11 ]

great

Comment by xuqing [ 04/Jan/11 ]

I try the 1.7.4 version of mongorestore,This issue was fixed by this version.Here is the restore log:
C:\>mongorestore.exe --host=10.34.40.30 --db=NineOneMultimedia --drop C:\Media\
NineOneMultimedia
connected to: 10.34.40.30
Tue Jan 04 08:54:53 C:/Media/NineOneMultimedia/system.js.bson
Tue Jan 04 08:54:53 going into namespace [NineOneMultimedia.system.js]
Tue Jan 04 08:54:53 dropping
Tue Jan 04 08:54:53 file C:/Media/NineOneMultimedia/system.js.bson empty, skippi
ng
Tue Jan 04 08:54:53 C:/Media/NineOneMultimedia/tAnimation.bson
Tue Jan 04 08:54:53 going into namespace [NineOneMultimedia.tAnimation]
Tue Jan 04 08:54:53 dropping
Tue Jan 04 08:54:54 1894 objects found
Tue Jan 04 08:54:54 C:/Media/NineOneMultimedia/tIP.bson
Tue Jan 04 08:54:54 going into namespace [NineOneMultimedia.tIP]
Tue Jan 04 08:54:54 dropping
Tue Jan 04 08:54:55 25435 objects found
Tue Jan 04 08:54:55 C:/Media/NineOneMultimedia/tLiterary.bson
Tue Jan 04 08:54:55 going into namespace [NineOneMultimedia.tLiterary]
Tue Jan 04 08:54:55 dropping
Tue Jan 04 08:54:55 2311 objects found
Tue Jan 04 08:54:55 C:/Media/NineOneMultimedia/tMaxId.bson
Tue Jan 04 08:54:55 going into namespace [NineOneMultimedia.tMaxId]
Tue Jan 04 08:54:55 dropping
Tue Jan 04 08:54:55 1 objects found
Tue Jan 04 08:54:55 C:/Media/NineOneMultimedia/tMovie.bson
Tue Jan 04 08:54:55 going into namespace [NineOneMultimedia.tMovie]
Tue Jan 04 08:54:55 dropping
Tue Jan 04 08:54:56 4108 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tMovieCloudInfo.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tMovieCloudInfo
]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 6 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tMovieHotInfo.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tMovieHotInfo]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 10 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tSuggestActor.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tSuggestActor]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 6 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tSuggestArea.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tSuggestArea]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 14 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tSuggestCategory.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tSuggestCategor
y]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 59 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tSuggestVideo.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tSuggestVideo]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 25 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tTvInfo.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tTvInfo]
Tue Jan 04 08:54:56 dropping
Tue Jan 04 08:54:56 2010 objects found
Tue Jan 04 08:54:56 C:/Media/NineOneMultimedia/tVideo.bson
Tue Jan 04 08:54:56 going into namespace [NineOneMultimedia.tVideo]
Tue Jan 04 08:54:56 dropping
32399264/187732813 17%
71806007/187732813 38%
111299239/187732813 59%
138152944/187732813 73%
168378040/187732813 89%
Tue Jan 04 08:55:12 316571 objects found
Tue Jan 04 08:55:12 C:/Media/NineOneMultimedia/tVideoSurvey.bson
Tue Jan 04 08:55:12 going into namespace [NineOneMultimedia.tVideoSurvey]
Tue Jan 04 08:55:12 dropping
10918213/52939371 20%
27134413/52939371 51%
42151813/52939371 79%
Tue Jan 04 08:55:23 326790 objects found
Tue Jan 04 08:55:23 C:/Media/NineOneMultimedia/system.indexes.bson
Tue Jan 04 08:55:23 going into namespace [NineOneMultimedia.system.indexes]

Tue Jan 04 08:55:23 dropping
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tAnimation", key:

{ _ id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tVideo", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23

{ name: "_id_", ns: "NineOneMultimedia.tSuggestActor", key: { _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tSuggestCategory", ke
y:

{ _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tSuggestArea", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tMovie", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23

{ name: "_id_", ns: "NineOneMultimedia.tSuggestVideo", key: { _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tLiterary", key:

{ _i d: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tIP", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tVideoSurvey", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tTvInfo", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tMaxId", key:

{ _id: 1 }

}
Tue Jan 04 08:55:23 { name: "id", ns: "NineOneMultimedia.tMovieCloudInfo", key
:

{ _id: 1 }

}
Tue Jan 04 08:55:23

{ name: "_id_", ns: "NineOneMultimedia.tMovieHotInfo", key: { _id: 1 }

}
Tue Jan 04 08:55:23 { name: "sName_1_sIntroduce_1_dtInsert_-1", ns: "NineOneMult
imedia.tAnimation", key:

{ sName: 1, sIntroduce: 1, dtInsert: -1 }

, unique: fals
e, _id: ObjectId('4d1c52009395e109bc000001') }
Tue Jan 04 08:55:23 { name: "sName_1_sIntroduce_1_dtInsert_-1", ns: "NineOneMult
imedia.tVideo", key:

{ sName: 1, sIntroduce: 1, dtInsert: -1 }

, unique: false, _
id: ObjectId('4d1c52879395e109bc000003') }
Tue Jan 04 08:55:29 { name: "sName_1_sIntroduce_1_Starring_1_dtInsert_-1", ns: "
NineOneMultimedia.tMovie", key:

{ sName: 1, sIntroduce: 1, Starring: 1, dtInsert : -1 }

, unique: false, _id: ObjectId('4d1c52af9395e109bc000004') }
Tue Jan 04 08:55:30 { name: "sName_1_sIntroduce_1_dtInsert_-1", ns: "NineOneMult
imedia.tLiterary", key:

{ sName: 1, sIntroduce: 1, dtInsert: -1 }

, unique: false
, _id: ObjectId('4d1c52d09395e109bc000005') }
Tue Jan 04 08:55:30 { name: "sName_1_sIntroduce_1_Starring_1_dtInsert_-1", ns: "
NineOneMultimedia.tTvInfo", key:

{ sName: 1, sIntroduce: 1, Starring: 1, dtInser t: -1 }

, unique: false, _id: ObjectId('4d1c52f29395e109bc000006') }
Tue Jan 04 08:55:30 { name: "iVideoId_1_sAccount_1", ns: "NineOneMultimedia.tSug
gestVideo", key:

{ iVideoId: 1, sAccount: 1 }

, unique: false, _id: ObjectId('4d1
c56da9395e109bc000007') }
Tue Jan 04 08:55:30 20 objects found

C:\>

Comment by Eliot Horowitz (Inactive) [ 02/Jan/11 ]

No, you can use 1.6.5 mongodump

Comment by xuqing [ 02/Jan/11 ]

OK,I'll try the 1.7.4 version of mongorestore,Do I need to dump database with 1.7.4 version of mongodump?

Comment by Eliot Horowitz (Inactive) [ 02/Jan/11 ]

Can you try with mongorestore from 1.7.4 (can use with 1.6.5 server)

Comment by xuqing [ 01/Jan/11 ]

The mongodump log on server:

[root@baibutest2 mongo]# /usr/local/mongodb/mongodump --out=/home/databak/mongo/201101010851
connected to: 127.0.0.1
all dbs
DATABASE: NineOneMultimedia to /home/databak/mongo/201101010851/NineOneMultimedia
NineOneMultimedia.system.indexes to /home/databak/mongo/201101010851/NineOneMultimedia/system.indexes.bson
20 objects
NineOneMultimedia.system.js to /home/databak/mongo/201101010851/NineOneMultimedia/system.js.bson
0 objects
NineOneMultimedia.tAnimation to /home/databak/mongo/201101010851/NineOneMultimedia/tAnimation.bson
1894 objects
NineOneMultimedia.tVideo to /home/databak/mongo/201101010851/NineOneMultimedia/tVideo.bson
316571 objects
NineOneMultimedia.tSuggestActor to /home/databak/mongo/201101010851/NineOneMultimedia/tSuggestActor.bson
6 objects
NineOneMultimedia.tSuggestCategory to /home/databak/mongo/201101010851/NineOneMultimedia/tSuggestCategory.bson
59 objects
NineOneMultimedia.tSuggestArea to /home/databak/mongo/201101010851/NineOneMultimedia/tSuggestArea.bson
14 objects
NineOneMultimedia.tMovie to /home/databak/mongo/201101010851/NineOneMultimedia/tMovie.bson
4108 objects
NineOneMultimedia.tSuggestVideo to /home/databak/mongo/201101010851/NineOneMultimedia/tSuggestVideo.bson
25 objects
NineOneMultimedia.tLiterary to /home/databak/mongo/201101010851/NineOneMultimedia/tLiterary.bson
2311 objects
NineOneMultimedia.tIP to /home/databak/mongo/201101010851/NineOneMultimedia/tIP.bson
25435 objects
NineOneMultimedia.tVideoSurvey to /home/databak/mongo/201101010851/NineOneMultimedia/tVideoSurvey.bson
326790 objects
NineOneMultimedia.tTvInfo to /home/databak/mongo/201101010851/NineOneMultimedia/tTvInfo.bson
2010 objects
NineOneMultimedia.tMaxId to /home/databak/mongo/201101010851/NineOneMultimedia/tMaxId.bson
1 objects
NineOneMultimedia.tMovieCloudInfo to /home/databak/mongo/201101010851/NineOneMultimedia/tMovieCloudInfo.bson
6 objects
NineOneMultimedia.tMovieHotInfo to /home/databak/mongo/201101010851/NineOneMultimedia/tMovieHotInfo.bson
10 objects
[root@baibutest2 mongo]#

The mongorestore logs:
C:\Users\Administrator>mongorestore --host=10.34.40.30 --drop --db=NineOneMultim
edia C:\Media\NineOneMultimedia
connected to: 10.34.40.30
Sat Jan 01 09:03:18 C:/Media/NineOneMultimedia/system.indexes.bson
Sat Jan 01 09:03:18 going into namespace [NineOneMultimedia.system.indexes]

Sat Jan 01 09:03:18 dropping
Sat Jan 01 09:03:18 20 objects found
Sat Jan 01 09:03:18 C:/Media/NineOneMultimedia/system.js.bson
Sat Jan 01 09:03:18 going into namespace [NineOneMultimedia.system.js]
Sat Jan 01 09:03:18 dropping
Sat Jan 01 09:03:28 file C:/Media/NineOneMultimedia/system.js.bson empty, skippi
ng
Sat Jan 01 09:03:28 C:/Media/NineOneMultimedia/tAnimation.bson
Sat Jan 01 09:03:28 going into namespace [NineOneMultimedia.tAnimation]
Sat Jan 01 09:03:28 dropping
Sat Jan 01 09:03:28 1894 objects found
Sat Jan 01 09:03:28 C:/Media/NineOneMultimedia/tIP.bson
Sat Jan 01 09:03:28 going into namespace [NineOneMultimedia.tIP]
Sat Jan 01 09:03:28 dropping
Sat Jan 01 09:03:30 25435 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tLiterary.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tLiterary]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 2311 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tMaxId.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tMaxId]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 1 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tMovie.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tMovie]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 4108 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tMovieCloudInfo.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tMovieCloudInfo
]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 6 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tMovieHotInfo.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tMovieHotInfo]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 10 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tSuggestActor.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tSuggestActor]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 6 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tSuggestArea.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tSuggestArea]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 14 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tSuggestCategory.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tSuggestCategor
y]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 59 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tSuggestVideo.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tSuggestVideo]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 25 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tTvInfo.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tTvInfo]
Sat Jan 01 09:03:30 dropping
Sat Jan 01 09:03:30 2010 objects found
Sat Jan 01 09:03:30 C:/Media/NineOneMultimedia/tVideo.bson
Sat Jan 01 09:03:30 going into namespace [NineOneMultimedia.tVideo]
Sat Jan 01 09:03:30 dropping
46606577/187732813 24%
106119584/187732813 56%
168378040/187732813 89%
Sat Jan 01 09:03:40 316571 objects found
Sat Jan 01 09:03:40 C:/Media/NineOneMultimedia/tVideoSurvey.bson
Sat Jan 01 09:03:40 going into namespace [NineOneMultimedia.tVideoSurvey]
Sat Jan 01 09:03:40 dropping
14773813/52939371 27%
30649813/52939371 57%
47368213/52939371 89%
Sat Jan 01 09:03:49 326790 objects found

C:\Users\Administrator>

Comment by Eliot Horowitz (Inactive) [ 30/Dec/10 ]

Can you send the mongorestore and mongodump logs.

Generated at Thu Feb 08 02:59:34 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.