[SERVER-8521] Lazily clean up temp collections Created: 12/Feb/13 Updated: 11/Jul/16 Resolved: 14/Feb/13 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | 2.4.0-rc0 |
| Fix Version/s: | 2.4.0-rc1 |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Eric Milkie | Assignee: | Eliot Horowitz (Inactive) |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||
| Operating System: | ALL | ||||||||||||||||
| Participants: | |||||||||||||||||
| Description |
|
Cease opening all dbs at startup – this pushes the fd count past 1024 and breaks things when we try to use select() on sockets. Instead, do the temp cleanup lazily at Database open time. |
| Comments |
| Comment by Alvin Richards (Inactive) [ 16/Feb/13 ] |
|
Tested successfully on OS-X with git version: 1bd8b84c64214356f482fa3164d88e664f585243 |
| Comment by Alvin Richards (Inactive) [ 16/Feb/13 ] |
|
Just checked the latest open-vmtools source 9.2.2 and its says the same thing http://sourceforge.net/projects/open-vm-tools/files/open-vm-tools/stable-9.2.x/ Ok, that eliminate the HGFS from the equation, will re-test on vanilla disks. |
| Comment by Eric Milkie [ 16/Feb/13 ] |
|
Weird, that code says it does nothing and just returns "success"! Not the behavior we're seeing here. |
| Comment by Alvin Richards (Inactive) [ 16/Feb/13 ] |
|
Certainly the VMWare Tool 4.x circa 2006 explicitly states no support for fsync, see here http://www.ieo.es/ftp/software/open-vm-tools-4.0.0-162945/modules/linux/vmhgfs/file.c I'll see if I can find any later changes that would include support. |
| Comment by Eric Milkie [ 16/Feb/13 ] |
|
I'm going to file a separate ticket to clean up this error message regarding fsync. I've seen other users run into this issue and the logging could be clearer in this situation. |
| Comment by Eric Milkie [ 16/Feb/13 ] |
|
I don't think you can call fsync on an HGFS (shared VMWare) mount? It might not be supported. Was this working before using that mounted device as a data directory? Did you upgrade VMWare in the interim? |
| Comment by Alvin Richards (Inactive) [ 16/Feb/13 ] |
|
Sorry, full stack is here (cut & paste problem) Sat Feb 16 07:04:41.093 [initandlisten] MongoDB starting : pid=2518 port=27017 dbpath=/mnt/hgfs/data/db/bug/ 64-bit host=alvin-ubuntu910-server64 Sat Feb 16 07:04:41.098 [initandlisten] Assertion: 13651:Couldn't fsync directory '/mnt/hgfs/data/db/bug': errno:22 Invalid argument |
| Comment by Eliot Horowitz (Inactive) [ 16/Feb/13 ] |
|
Can you post stack + git version? |
| Comment by Alvin Richards (Inactive) [ 16/Feb/13 ] |
|
reduces to < 1024 files, same stack trace. |
| Comment by Alvin Richards (Inactive) [ 16/Feb/13 ] |
|
OS-X version not availbale (yet) to re-tried on Linux, but got the following on startup Sat Feb 16 06:07:21.065 [initandlisten] MongoDB starting : pid=2063 port=27017 dbpath=/mnt/hgfs/data/db/bug 64-bit host=alvin-ubuntu910-server64 Sat Feb 16 06:07:21.069 [initandlisten] Assertion: 13651:Couldn't fsync directory '/mnt/hgfs/data/db/bug': errno:22 Invalid argument That directory path and permission are all fine. Checking setup. |
| Comment by Alvin Richards (Inactive) [ 15/Feb/13 ] |
|
Downloads page still has 2013-02-12 build. Waiting for a build with at least git commit 2d71e6ab2d42c3c1cc31d42e579dec8041f6cca4 on OS-X. |
| Comment by auto [ 14/Feb/13 ] |
|
Author: {u'date': u'2013-02-12T23:56:35Z', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}Message: |
| Comment by auto [ 14/Feb/13 ] |
|
Author: {u'date': u'2013-02-12T17:16:35Z', u'name': u'Eliot Horowitz', u'email': u'eliot@10gen.com'}Message: |