Scalability of distinct is sub-optimal

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Won't Fix
    • Priority: Major - P3
    • None
    • Affects Version/s: 2.6.0-rc1
    • Component/s: Concurrency, MMAPv1, Querying
    • Query
    • ALL
    • Hide

      Get mongo-perf at https://github.com/mongodb/mongo , build, and run

      ./benchmark --test command --raw
      

      and wait for the output of Distinct

      {With,Without}

      Index.

      Show
      Get mongo-perf at https://github.com/mongodb/mongo , build, and run ./benchmark --test command --raw and wait for the output of Distinct {With,Without} Index.
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None

      mongo-perf shows distinct doesn't scale very well, and the problem gets evident after 4 threads. This is tested on a recent 12-core Xeon. The problem affects every version of mongo I was able to test on (namely 2.2, 2.4, 2.6). Screenshot attached.

        1. distinct.png
          60 kB
          Davide Italiano

            Assignee:
            Backlog - Query Team (Inactive)
            Reporter:
            Davide Italiano (Inactive)
            Votes:
            2 Vote for this issue
            Watchers:
            8 Start watching this issue

              Created:
              Updated:
              Resolved: