Indexing during phase 2 of a Map Reduce execution blocks all db operations

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Cannot Reproduce
    • Priority: Major - P3
    • None
    • Affects Version/s: 1.6.2
    • Component/s: None
    • None
    • Environment:
      Centos 64 bit, Amazon EC2
    • Linux
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      When we are running large Map Reduce jobs, we have noticed that an index building operation seems to happen as phase 2 of 3 phases. When this happens, it seems to prevent the database from being used. That is, the indexing is not happening in the background and also not during insertions into the temporary MR collections.

      See output snippet from the currentOp command. This index building seemed to happen during the execution of a Map/Reduce job after the Map phase ended and before the Reduce phase began.

      {
      "opid" : 853796039,
      "active" : true,
      "lockType" : "write",
      "waitingForLock" : false,
      "secs_running" : 229,
      "op" : "insert",
      "ns" : "sociocast.system.indexes",
      "client" : "0.0.0.0:0",
      "desc" : "conn",
      "msg" : "index: (2/3) btree bottom up 4200477/18418261 22%"
      },

            Assignee:
            Antoine Girbal (Inactive)
            Reporter:
            Giri Iyengar
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: