Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-4309

automatically select an index to sort by for MR to increase performance

    XMLWordPrintableJSON

Details

    • Icon: Improvement Improvement
    • Resolution: Unresolved
    • Icon: Major - P3 Major - P3
    • None
    • None
    • MapReduce
    • None
    • Query Optimization

    Description

      In many cases of MR, people emit 1 key and usually have an index on it.
      But few people actually think about sorting, even though it can greatly improve performance.
      We can try to automate this for simple cases:

      • run the map once on a single doc with a special emit method
      • if emitted value is simple, try to match corresponding field in the doc
      • if the field has an index, use that index, otherwise maybe log a line advising index

      Attachments

        Activity

          People

            backlog-query-optimization Backlog - Query Optimization
            antoine Antoine Girbal
            Votes:
            1 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: