Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-22615

Assertion: 10334:BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO when doing new replicaset member initialsync

    • Type: Icon: Bug Bug
    • Resolution: Done
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 2.4.12
    • Component/s: Storage
    • None
    • ALL
    • Hide

      Primary running. Add new secondary. Start new secondary and primary crashed with logs below.

      Show
      Primary running. Add new secondary. Start new secondary and primary crashed with logs below.
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      We use sharded cluster of MongoDB.
      When i start initialSync of new member os first shard i get an crash and error on primary:
      Assertion: 10334:BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO
      And new secondary get status "SECONDARY" with 12 datafiles instead of 3000+.
      What i need to do next?

      Mon Feb 15 07:00:37.148 [repl writer worker 1] Assertion: 10334:BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO
      0xdea5b1 0xdabd7b 0xdac2bc 0x6ee71f 0x6fb76c 0xacb1cb 0xa96d38 0xa9a6bc 0xa9c8d7 0xa756e8 0xc32823 0xc31f68 0xdb7f81 0xe33239 0x7fabc3a5ab50 0x7fabc2dfda7d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdea5b1]
      /usr/bin/mongod(_ZN5mongo11msgassertedEiPKc+0x9b) [0xdabd7b]
      /usr/bin/mongod() [0xdac2bc]
      /usr/bin/mongod(_ZNK5mongo7BSONObj14_assertInvalidEv+0x5bf) [0x6ee71f]
      /usr/bin/mongod(_ZN5mongo7BSONObjC1EPKc+0x3c) [0x6fb76c]
      /usr/bin/mongod(_ZN5mongo11DataFileMgr12updateRecordEPKcPNS_16NamespaceDetailsEPNS_25NamespaceDetailsTransientEPNS_6RecordERKNS_7DiskLocES2_iRNS_7OpDebugEb+0x6b) [0xacb1cb]
      /usr/bin/mongod() [0xa96d38]
      /usr/bin/mongod(_ZN5mongo14_updateObjectsEbPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEPNS_11RemoveSaverEbRKNS_24QueryPlanSelectionPolicyEb+0x2d1c) [0xa9a6bc]
      /usr/bin/mongod(_ZN5mongo27updateObjectsForReplicationEPKcRKNS_7BSONObjES4_bbbRNS_7OpDebugEbRKNS_24QueryPlanSelectionPolicyE+0xb7) [0xa9c8d7]
      /usr/bin/mongod(_ZN5mongo21applyOperation_inlockERKNS_7BSONObjEbb+0x628) [0xa756e8]
      /usr/bin/mongod(_ZN5mongo7replset8SyncTail9syncApplyERKNS_7BSONObjEb+0x713) [0xc32823]
      /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x48) [0xc31f68]
      /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdb7f81]
      /usr/bin/mongod() [0xe33239]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fabc3a5ab50]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fabc2dfda7d]
      Mon Feb 15 07:00:37.208 [repl writer worker 1] ERROR: writer worker caught exception: BSONObj size: 0 (0x00000000) is invalid. Size must be between 0 and 16793600(16MB) First element: EOO
      on: { ts: Timestamp 1455501634000|47, h: 4868822648138918134, v: 2, op: "i", ns: "grid_fs.fs.chunks", fromMigrate: true, o:
      { _id: ObjectId('51bc7682d5d30701318599d0'), n: 0, data: BinData , files_id: ObjectId('51bc71a5f7c07966503f15f8') }
      }
      Mon Feb 15 07:00:37.208 [repl writer worker 1] Fatal Assertion 16360
      0xdea5b1 0xdaa433 0xc3204c 0xdb7f81 0xe33239 0x7fabc3a5ab50 0x7fabc2dfda7d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdea5b1]
      /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xa3) [0xdaa433]
      /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c) [0xc3204c]
      /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdb7f81]
      /usr/bin/mongod() [0xe33239]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fabc3a5ab50]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fabc2dfda7d]
      Mon Feb 15 07:00:37.210 [repl writer worker 1]
      ***aborting after fassert() failure
      Mon Feb 15 07:00:37.210 Got signal: 6 (Aborted).
      Mon Feb 15 07:00:37.213 Backtrace:
      0xdea5b1 0x6d0f29 0x7fabc2d554f0 0x7fabc2d55475 0x7fabc2d586f0 0xdaa46e 0xc3204c 0xdb7f81 0xe33239 0x7fabc3a5ab50 0x7fabc2dfda7d
      /usr/bin/mongod(_ZN5mongo15printStackTraceERSo+0x21) [0xdea5b1]
      /usr/bin/mongod(_ZN5mongo10abruptQuitEi+0x399) [0x6d0f29]
      /lib/x86_64-linux-gnu/libc.so.6(+0x324f0) [0x7fabc2d554f0]
      /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x35) [0x7fabc2d55475]
      /lib/x86_64-linux-gnu/libc.so.6(abort+0x180) [0x7fabc2d586f0]
      /usr/bin/mongod(_ZN5mongo13fassertFailedEi+0xde) [0xdaa46e]
      /usr/bin/mongod(_ZN5mongo7replset14multiSyncApplyERKSt6vectorINS_7BSONObjESaIS2_EEPNS0_8SyncTailE+0x12c) [0xc3204c]
      /usr/bin/mongod(_ZN5mongo10threadpool6Worker4loopEv+0x281) [0xdb7f81]
      /usr/bin/mongod() [0xe33239]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x6b50) [0x7fabc3a5ab50]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7fabc2dfda7d]
      

            Assignee:
            Unassigned Unassigned
            Reporter:
            metikovvadim Metikov Vadim
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

              Created:
              Updated:
              Resolved:
              None
              None
              None
              None