Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16062

Segfault in shell on Ordered Bulk Insert/Find-Update with Large amount of docs

XMLWordPrintableJSON

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 2.6.5
    • Component/s: Shell, Write Ops
    • Environment:
      OSX 10.10; iMac (27-inch, Late 2009); 2.8 GHz Intel Core i7; 8 GB 1067 MHz DDR3
    • ALL
    • Hide

      Using an empty collection with no indexes, try:

      > var ordered = db.mars.initializeOrderedBulkOp();
> for (u=0; u < 300; u++) {
...     var id = new ObjectId();
...     for (m=1; m <=12; m++) {
...         ordered.insert({_id:'2014-' + m + '-FACILITY2-' + id.str, admins:[]});
...         for (med=1; med <= 30; med++) {
...             var medID = new ObjectId();
...             for (ad = 1; ad <= 40; ad++) {
...                 ordered.find({_id:"2014-" + m + "-FACILITY2-" + id.str}).update({$push:{"admins":{m:medID, sd:new ISODate(), c:"A", u:ObjectId(), ad: new ISODate(), v:{pulse: 66, bp: "120/80"}}}});
...             }
...         }
...     }
... }
ordered.execute();

      This will attempt to create 4.3 million inserts/updates. This will crash before execute() step before machine runs out of memory.

      Returns:

      #
# Fatal error in CALL_AND_RETRY_2
# Allocation failed - process out of memory
#

2014-11-10T15:58:58.256-0600 mongo got signal 6 (Abort trap: 6), stack trace: 
2014-11-10T15:58:58.258-0600 0x106a8074a 0x1068b18d0 0x7fff8dc9ef1a 0x0 0x7fff8b021b73 0x106cf9519 0x106b68d79 0x106b4b020 0x106b23046 0x106ba9edd 0x106bbfd89 0x106bbf9e6 0x106b705a0 0x106b6ef1e 0x106cc1c89 0x106d3ba62 0x353b7c906362 0x353b7c90d1f1 0x353b7c972999 
 0   mongo                               0x0000000106a8074a _ZN5mongo15printStackTraceERNSt3__113basic_ostreamIcNS0_11char_traitsIcEEEE + 58
 1   mongo                               0x00000001068b18d0 _Z12quitAbruptlyi + 272
 2   libsystem_platform.dylib            0x00007fff8dc9ef1a _sigtramp + 26
 3   ???                                 0x0000000000000000 0x0 + 0
 4   libsystem_c.dylib                   0x00007fff8b021b73 abort + 129
 5   mongo                               0x0000000106cf9519 _ZN2v88internal2OS5AbortEv + 9
 6   mongo                               0x0000000106b68d79 _Z9API_FatalPKcS0_z + 185
 7   mongo                               0x0000000106b4b020 _ZN2v8L24DefaultFatalErrorHandlerEPKcS1_ + 112
 8   mongo                               0x0000000106b23046 _ZN2v88internal2V823FatalProcessOutOfMemoryEPKcb + 566
 9   mongo                               0x0000000106ba9edd _ZN2v88internal7Factory19NewTypeFeedbackInfoEv + 365
 10  mongo                               0x0000000106bbfd89 _ZN2v88internal17FullCodeGenerator24PopulateTypeFeedbackInfoENS0_6HandleINS0_4CodeEEE + 25
 11  mongo                               0x0000000106bbf9e6 _ZN2v88internal17FullCodeGenerator8MakeCodeEPNS0_15CompilationInfoE + 486
 12  mongo                               0x0000000106b705a0 _ZN2v88internalL12GenerateCodeEPNS0_15CompilationInfoE + 240
 13  mongo                               0x0000000106b6ef1e _ZN2v88internal8Compiler11CompileLazyEPNS0_15CompilationInfoE + 398
 14  mongo                               0x0000000106cc1c89 _ZN2v88internal10JSFunction11CompileLazyENS0_6HandleIS1_EENS0_18ClearExceptionFlagE + 377
 15  mongo                               0x0000000106d3ba62 _ZN2v88internal19Runtime_LazyCompileENS0_9ArgumentsEPNS0_7IsolateE + 50
 16  ???                                 0x0000353b7c906362 0x0 + 58529609180002
 17  ???                                 0x0000353b7c90d1f1 0x0 + 58529609208305
 18  ???                                 0x0000353b7c972999 0x0 + 58529609623961
      Show
      Using an empty collection with no indexes, try: > var ordered = db.mars.initializeOrderedBulkOp(); > for (u=0; u < 300; u++) { ... var id = new ObjectId(); ... for (m=1; m <=12; m++) { ... ordered.insert({_id: '2014-' + m + '-FACILITY2-' + id.str, admins:[]}); ... for (med=1; med <= 30; med++) { ... var medID = new ObjectId(); ... for (ad = 1; ad <= 40; ad++) { ... ordered.find({_id: "2014-" + m + "-FACILITY2-" + id.str}).update({$push:{ "admins" :{m:medID, sd: new ISODate(), c: "A" , u:ObjectId(), ad: new ISODate(), v:{pulse: 66, bp: "120/80" }}}}); ... } ... } ... } ... } ordered.execute(); This will attempt to create 4.3 million inserts/updates. This will crash before execute() step before machine runs out of memory. Returns: # # Fatal error in CALL_AND_RETRY_2 # Allocation failed - process out of memory # 2014-11-10T15:58:58.256-0600 mongo got signal 6 (Abort trap: 6), stack trace: 2014-11-10T15:58:58.258-0600 0x106a8074a 0x1068b18d0 0x7fff8dc9ef1a 0x0 0x7fff8b021b73 0x106cf9519 0x106b68d79 0x106b4b020 0x106b23046 0x106ba9edd 0x106bbfd89 0x106bbf9e6 0x106b705a0 0x106b6ef1e 0x106cc1c89 0x106d3ba62 0x353b7c906362 0x353b7c90d1f1 0x353b7c972999 0 mongo 0x0000000106a8074a _ZN5mongo15printStackTraceERNSt3__113basic_ostreamIcNS0_11char_traitsIcEEEE + 58 1 mongo 0x00000001068b18d0 _Z12quitAbruptlyi + 272 2 libsystem_platform.dylib 0x00007fff8dc9ef1a _sigtramp + 26 3 ??? 0x0000000000000000 0x0 + 0 4 libsystem_c.dylib 0x00007fff8b021b73 abort + 129 5 mongo 0x0000000106cf9519 _ZN2v88internal2OS5AbortEv + 9 6 mongo 0x0000000106b68d79 _Z9API_FatalPKcS0_z + 185 7 mongo 0x0000000106b4b020 _ZN2v8L24DefaultFatalErrorHandlerEPKcS1_ + 112 8 mongo 0x0000000106b23046 _ZN2v88internal2V823FatalProcessOutOfMemoryEPKcb + 566 9 mongo 0x0000000106ba9edd _ZN2v88internal7Factory19NewTypeFeedbackInfoEv + 365 10 mongo 0x0000000106bbfd89 _ZN2v88internal17FullCodeGenerator24PopulateTypeFeedbackInfoENS0_6HandleINS0_4CodeEEE + 25 11 mongo 0x0000000106bbf9e6 _ZN2v88internal17FullCodeGenerator8MakeCodeEPNS0_15CompilationInfoE + 486 12 mongo 0x0000000106b705a0 _ZN2v88internalL12GenerateCodeEPNS0_15CompilationInfoE + 240 13 mongo 0x0000000106b6ef1e _ZN2v88internal8Compiler11CompileLazyEPNS0_15CompilationInfoE + 398 14 mongo 0x0000000106cc1c89 _ZN2v88internal10JSFunction11CompileLazyENS0_6HandleIS1_EENS0_18ClearExceptionFlagE + 377 15 mongo 0x0000000106d3ba62 _ZN2v88internal19Runtime_LazyCompileENS0_9ArgumentsEPNS0_7IsolateE + 50 16 ??? 0x0000353b7c906362 0x0 + 58529609180002 17 ??? 0x0000353b7c90d1f1 0x0 + 58529609208305 18 ??? 0x0000353b7c972999 0x0 + 58529609623961

      Using a script to generate large Bulk.insert()/Bulk.updateOne() operations can cause out of memory segfault.

        1. memoryScreencap.png
          35 kB
          Mark Garrett

            Assignee:
            Unassigned Unassigned
            Reporter:
            moderndeveloperllc Mark Garrett
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: