[SERVER-2636] mongoimport has unstable performance Created: 28/Feb/11  Updated: 15/Aug/12  Resolved: 03/Mar/12

Status: Closed
Project: Core Server
Component/s: Performance
Affects Version/s: 1.6.5, 1.7.5, 1.8.0-rc0
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: Tao Liu Assignee: Unassigned
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

OS: Linux rhel5 64bit.
Mem: 64GB RAM.
CPU: Xeon E5620@2.40GHz


Participants:

 Description   

We setup 8 single servers to run the mongoimport test
import 50,000,000 documents each time.
these documents have been splitted to 32 parts and we run 4 mongoimport instances for each server.

At the beginning, the import speed is quite fast ( about 400 seconds each time ) when the mongod do not allocate the whole 64 GB RAM
But when the mongod has allocated all the RAM , there always have one or two server became take 99%+ CPU and import too slow.
These slow servers seem to randomly so that we can not figure out the reason.

And After 50 times import, we found some of these servers still seem to import very fast but others became too slow.
one import process will take 5000 seconds averagely or even more than 10000 seconds sometimes.

We had ran the same test for 1.6.5,1.7.5 and 1.8.0-rc0, and it's the same results.
We think the unstable performance is quite strange and maybe a problem of mongoimport or mongodb.



 Comments   
Comment by Eliot Horowitz (Inactive) [ 01/Feb/12 ]

Sorry this got lost.
Have you tried with 2.0.2?

Generated at Thu Feb 08 03:00:44 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.