Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-2118

Indexing during phase 2 of a Map Reduce execution blocks all db operations

    XMLWordPrintableJSON

Details

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Major - P3 Major - P3
    • None
    • 1.6.2
    • None
    • None
    • Centos 64 bit, Amazon EC2
    • Linux

    Description

      When we are running large Map Reduce jobs, we have noticed that an index building operation seems to happen as phase 2 of 3 phases. When this happens, it seems to prevent the database from being used. That is, the indexing is not happening in the background and also not during insertions into the temporary MR collections.

      See output snippet from the currentOp command. This index building seemed to happen during the execution of a Map/Reduce job after the Map phase ended and before the Reduce phase began.

      {
      "opid" : 853796039,
      "active" : true,
      "lockType" : "write",
      "waitingForLock" : false,
      "secs_running" : 229,
      "op" : "insert",
      "ns" : "sociocast.system.indexes",
      "client" : "0.0.0.0:0",
      "desc" : "conn",
      "msg" : "index: (2/3) btree bottom up 4200477/18418261 22%"
      },

      Attachments

        Activity

          People

            antoine Antoine Girbal
            giri.iyengar Giri Iyengar
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: