Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-16307

Bulk insert is slow in sharded with replica set environment

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Incomplete
    • Icon: Major - P3 Major - P3
    • None
    • None
    • Performance
    • None
    • MongoDB 2.4.8 RHEL6
    • Linux

    Description

      We are experiencing poor write performance on a large collection. The collection has 390 millions documents with "avgObjSize" : 842.5387 and 4 indexes. In the test environment, we can insert at 4000 documents per second with similar size of the collection. In the production environment, we can only get 1000/s. We tried the write concern setting with (w: 0) but it didn’t help. Here are more details of the data load:

      App : Java (Spring Batch)
      Bulk insert (1000/batch)
      2 shard servers with 200GB of physical memory and 2TB storage for Mongo
      3 config/query servers and 1 arbiter server

      Attachments

        Activity

          People

            Unassigned Unassigned
            kyee@cobaltgroup.com Kim Yee
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: