Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-17518

Overflow sort after upgrade from 2.4.3 to 2.6.8

    • Linux

      We are getting the following error:

      Overflow sort stage buffered data usage of 33554527 bytes exceeds internal limit of 33554432 bytes code:17406

      For the following query:

         MyDBCollection.com.xyz.client query:
         { $query: { net: "TTY", tags: { $in: [ "us_uk", "us_ub" ] } }, $orderby: { _id:-1 } }
      

      Here is the index:

      db.com.xyz.client.getIndexes()
        [
              {
                      "v" : 1,
                      "key" : {
                              "_id" : 1
                      },
                      "ns" : "MyDBCollection.com.xyz.client",
                      "name" : "_id_"
              },
              {
                      "v" : 1,
                      "key" : {
                              "tk" : 1
                      },
                      "ns" : "MyDBCollection.com.xyz.client",
                      "name" : "tk_1"
              },
              {
                      "v" : 1,
                      "key" : {
                              "net" : 1,
                              "tags" : 1
                      },
                      "ns" : "MyDBCollection.com.xyz.client",
                      "name" : "net_1_tags_1"
              }
        ]
      

      We recently upgraded from 2.4.3 to 2.6.8. We run a primary and 3 replicas. No sharding.

      The collection has about 780,000 records.

      Here is the full log:

          2015-03-05T19:12:06.880-0500 [conn15479] query
          MyDBCollection.com.xyz.client query: { $query: { net:
          "TTY", tags: { $in: [ "us_uk", "us_ub" ] } }, $orderby: { _id:
          -1 } } planSummary: IXSCAN { net: 1, tags: 1 }, IXSCAN { net: 1, tags:
          1 } cursorid:984918561948 ntoreturn:1000 ntoskip:0 nscanned:703402
          nscannedObjects:703402 keyUpdates:0 numYields:539 locks(micros)
          r:8380719 nreturned:1000 reslen:81020 5825ms
          2015-03-05T19:12:07.016-0500 [repl writer worker 3] build index on:
          MyDBCollection2.e.a.m.client.kitapp
          properties: { v: 1, key: { _id: 1 }, name: "_id_", ns:
          "MyDBCollection2.e.a.m.client.kitapp" }
          2015-03-05T19:12:07.016-0500 [repl writer worker 3]      added index
          to empty collection
          2015-03-05T19:12:07.018-0500 [repl writer worker 3] build index on:
          MyDBCollection2.e.a.m.client.kitapp
          properties: { v: 1, key: { state: 1 }, name: "state_1", ns:
          "MyDBCollection2.e.a.m.client.kitapp" }
          2015-03-05T19:12:07.018-0500 [repl writer worker 3]      added index
          to empty collection
          2015-03-05T19:12:07.026-0500 [repl writer worker 5] build index on:
          MyDBCollection2.e.a.m.client.kitapp
          properties: { v: 1, key: { updated: 1 }, name: "updated_1", ns:
          "MyDBCollection2.e.a.m.client.kitapp",
          expireAfterSeconds: 604800 }
          2015-03-05T19:12:07.027-0500 [repl writer worker 5]      added index
          to empty collection
          2015-03-05T19:12:07.062-0500 [repl writer worker 10] build index on:
          MyDBCollection2.e.a.m.client.kitextension
          properties: { v: 1, key: { _id: 1 }, name: "_id_", ns:
          "MyDBCollection2.e.a.m.client.kitextension"
          }
          2015-03-05T19:12:07.062-0500 [repl writer worker 10]     added index
          to empty collection
          2015-03-05T19:12:07.064-0500 [repl writer worker 10] build index on:
          MyDBCollection2.e.a.m.client.kitextension
          properties: { v: 1, key: { state: 1 }, name: "state_1", ns:
          "MyDBCollection2.e.a.m.client.kitextension"
          }
          2015-03-05T19:12:07.064-0500 [repl writer worker 10]     added index
          to empty collection
          2015-03-05T19:12:07.069-0500 [repl writer worker 11] build index on:
          MyDBCollection2.e.a.m.client.kitextension
          properties: { v: 1, key: { updated: 1 }, name: "updated_1", ns:
          "MyDBCollection2.e.a.m.client.kitextension",
          expireAfterSeconds: 604800 }
          2015-03-05T19:12:07.069-0500 [repl writer worker 11]     added index
          to empty collection
          2015-03-05T19:12:07.118-0500 [repl writer worker 10] build index on:
          MyDBCollection2.com.a.m.client.kitapp properties: {
          v: 1, key: { _id: 1 }, name: "_id_", ns:
          "MyDBCollection2.com.a.m.client.kitapp" }
          2015-03-05T19:12:07.118-0500 [repl writer worker 10]     added index
          to empty collection
          2015-03-05T19:12:07.119-0500 [repl writer worker 10] build index on:
          MyDBCollection2.com.a.m.client.kitapp properties: {
          v: 1, key: { state: 1 }, name: "state_1", ns:
          "MyDBCollection2.com.a.m.client.kitapp" }
          2015-03-05T19:12:07.120-0500 [repl writer worker 10]     added index
          to empty collection
          2015-03-05T19:12:07.132-0500 [repl writer worker 3] build index on:
          MyDBCollection2.com.a.m.client.kitapp properties: {
          v: 1, key: { updated: 1 }, name: "updated_1", ns:
          "MyDBCollection2.com.a.m.client.kitapp",
          expireAfterSeconds: 604800 }
          2015-03-05T19:12:07.133-0500 [repl writer worker 3]      added index
          to empty collection
          2015-03-05T19:12:07.170-0500 [repl writer worker 3] build index on:
          MyCollection2.com.a.m.client.kitextension
          properties: { v: 1, key: { _id: 1 }, name: "_id_", ns:
          "MyCollection2.com.a.m.client.kitextension" }
          2015-03-05T19:12:07.170-0500 [repl writer worker 3]      added index
          to empty collection
          2015-03-05T19:12:07.170-0500 [repl writer worker 3] build index on:
          MyCollection2.com.a.m.client.kitextension
          properties: { v: 1, key: { state: 1 }, name: "state_1", ns:
          "MyCollection2.com.a.m.client.kitextension" }
          2015-03-05T19:12:07.171-0500 [repl writer worker 3]      added index
          to empty collection
          2015-03-05T19:12:07.175-0500 [repl writer worker 10] build index on:
          MyCollection2.com.a.m.client.kitextension
          properties: { v: 1, key: { updated: 1 }, name: "updated_1", ns:
          "MyCollection2.com.a.m.client.kitextension",
          expireAfterSeconds: 604800 }
          2015-03-05T19:12:07.175-0500 [repl writer worker 10]     added index
          to empty collection
          2015-03-05T19:12:09.376-0500 [conn15501] ERROR: Runner error, stats:
          2015-03-05T19:12:09.498-0500 [conn15501] getmore
          MyDBCollection.com.xyz.client cursorid:984918561948
          ntoreturn:1000 keyUpdates:0 exception: getMore runner error: Overflow
          sort stage buffered data usage of 33554527 bytes exceeds internal
          limit of 33554432 bytes code:17406 numYields:152 locks(micros)
          r:1951439 nreturned:1 reslen:166 1511ms
          2015-03-05T19:12:09.522-0500 [conn15501] killcursors: found 0 of 1
          2015-03-05T19:12:09.522-0500 [conn15501] killcursors  keyUpdates:0
          numYields:0 locks(micros) r:10 17ms
      

            Assignee:
            david.storch@mongodb.com David Storch
            Reporter:
            pmoosman Paul Moosman
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: