[SERVER-9443] Sort + limit (TopK) optimization for new Sorter Created: 23/Apr/13  Updated: 02/Aug/18  Resolved: 20/Aug/13

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 2.5.2

Type: Task Priority: Major - P3
Reporter: Mathias Stearn Assignee: Mathias Stearn
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: File topk.py    
Backwards Compatibility: Fully Compatible
Participants:

 Description   

Will use a simple heap when data fits in RAM. Will use median-counting algorithm simulated by attached python script when it doesn't.



 Comments   
Comment by auto [ 19/Aug/13 ]

Author:

{u'username': u'RedBeard0531', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9443 TopKSorter optimization when spilling to disk
Branch: master
https://github.com/mongodb/mongo/commit/a300d98f535d2a6b915c8e4a7ea9245c00e9de18

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-09T21:07:54Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: Tests for SERVER-9411 and SERVER-9443

Also minor fixes for bugs with multiple calls to more() uncovered by tests.
Branch: master
https://github.com/mongodb/mongo/commit/f96061127a185a7cbb0d1e384960855687ecd8a1

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-07T21:05:48Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9443 Correctly handle initial state in LimitOneSorter
Branch: master
https://github.com/mongodb/mongo/commit/2292e85c93ad9492e0fc7c832cd2c1940fca1f84

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-07T18:29:12Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9443 First part of limit support for new framework

This isn't currently hooked up anywhere. It also doesn't yet
significantly optimize Top-K sorting where the result set doesn't fit
inside of our memory budget.
Branch: master
https://github.com/mongodb/mongo/commit/52f8a9555f4dd71a7787d4a7a1412a9e5e8415a2

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-07T16:44:53Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Make Sorter an interface

Currently there is only one subclass (NoLimitSorter), but 2 more (LimitOneSorter
and TopKSorter) will be added to support limits (SERVER-9443).
Branch: master
https://github.com/mongodb/mongo/commit/439df8fff2e5b3140bf7d32393ce4a18cf5fd876

Generated at Thu Feb 08 03:20:25 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.