[SERVER-710] MongoDB die under high load Created: 07/Mar/10  Updated: 12/Mar/10  Resolved: 12/Mar/10

Status: Closed
Project: Core Server
Component/s: Stability
Affects Version/s: 1.3.3
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: Tsz Ming Wong Assignee: Eliot Horowitz (Inactive)
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Ubuntu Karmic (9.10), 64bit, deb package => 20100218


Attachments: File mongostat.log    
Participants:

 Description   

MongoDB die after running for a few hours (under intensive insert), have checked the mongodb.log and can't find any thing useful.

Sun Mar 7 20:18:38 insert my_db.g_f2f9887e3a558711d4b5d9e7a9dd914f 681ms
Sun Mar 7 20:18:41 insert my_db.g_f2f9887e3a558711d4b5d9e7a9dd914f 818ms
Sun Mar 7 20:18:43 insert my_db.g_f2f9887e3a558711d4b5d9e7a9dd914f 1165ms
== EOF ==

Please let me know what I can provide in order to trace the problem.

Thanks.



 Comments   
Comment by Eliot Horowitz (Inactive) [ 07/Mar/10 ]

virtual keeps going up but mapped stays the same

Comment by Tsz Ming Wong [ 07/Mar/10 ]

Which line of the log file show you there could be a leak?

My data is too large, I will try to reduce into a simple data set that could reproduce the problem.

Comment by Eliot Horowitz (Inactive) [ 07/Mar/10 ]

looks like there is a leak.
can you send sample objects, indexes, etc...?
if there is a script that inserts, that would be the best

Comment by Tsz Ming Wong [ 07/Mar/10 ]

output from mongostat is attached.

Comment by Eliot Horowitz (Inactive) [ 07/Mar/10 ]

Can you run mongostat continuously until it dies

Comment by Tsz Ming Wong [ 07/Mar/10 ]

You reminded me to look at the /dev/vcs1, thanks, so I found

Out of memory: kill process 1190 (su) score 16575189 or a child
[34716.883395] Killed process 1198 (mongod)
..

My machine has 1GB of memory, the collections has 100K items, and each items has size < 1MB (checked before insert)

I restarted the mongod and my program continue to insert as normal, not sure when will die again.

Comment by Eliot Horowitz (Inactive) [ 07/Mar/10 ]

What do you mean die? Can you look at your system messages to see if there are details
there?

Generated at Thu Feb 08 02:54:56 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.