[SERVER-9411] Minimal implementation that can replace BSONObjExtSorter and build indexes Created: 19/Apr/13  Updated: 24/May/21  Resolved: 15/May/13

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 2.5.0

Type: Task Priority: Major - P3
Reporter: Mathias Stearn Assignee: Mathias Stearn
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to SERVER-56424 improve index build invariant message... Closed
Participants:

 Comments   
Comment by auto [ 14/May/13 ]

Author:

{u'date': u'2013-05-14T21:57:46Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 SERVER-9679 Work around compiler bug in RHEL6.2
Branch: master
https://github.com/mongodb/mongo/commit/72f93e69ede4fb36fb11d2cb79560e98ff37f4a2

Comment by auto [ 14/May/13 ]

Author:

{u'date': u'2013-05-14T17:28:59Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Fix IO error messages from sorter on windows.
Branch: master
https://github.com/mongodb/mongo/commit/3210cf876673fa9ed3a9e56b1f94cc192fa245b5

Comment by auto [ 14/May/13 ]

Author:

{u'date': u'2013-05-14T17:22:43Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 SERVER-9678 Fix windows failure.

This change just reduces the number of open files by doubling the memory
limit for the failing test. The long-term solution will be to call
_setmaxstdio(2048) at startup on windows.
Branch: master
https://github.com/mongodb/mongo/commit/763c40a81f19c6cd29dfe9c45251abf69e361223

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-13T22:52:43Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 make buildbot happy
Branch: master
https://github.com/mongodb/mongo/commit/a7c21d7416d0c80e35e34baeed6040710de1ebd4

Comment by Ian Whalen (Inactive) [ 13/May/13 ]

looks like http://buildlogs.mongodb.org/Solaris-SmartOS%2064-bit/builds/1007/test/core/test failed on:

ExtSortTests::InterruptAdd std::exception: operation was interrupted in test ExtSortTests::InterruptAdd
ExtSortTests::InterruptSort std::exception: operation was interrupted in test ExtSortTests::InterruptSort

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-13T17:14:08Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 remove stub code to ensure templates compile correctly
Branch: master
https://github.com/mongodb/mongo/commit/a2f1bd875b81802e05575076262fe84c551470ab

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-10T22:57:50Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Optimize sorter file I/O by batching writes to at least 64K.

Reads are also optimized since they use the same batch size as writes.
Branch: master
https://github.com/mongodb/mongo/commit/1114629755f2ef3ea4c98e2109ee261e14e78699

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-09T21:07:54Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: Tests for SERVER-9411 and SERVER-9443

Also minor fixes for bugs with multiple calls to more() uncovered by tests.
Branch: master
https://github.com/mongodb/mongo/commit/f96061127a185a7cbb0d1e384960855687ecd8a1

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-08T18:50:07Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Fluent API for SortOptions
Branch: master
https://github.com/mongodb/mongo/commit/0ac841b08d432215df396080fd2079c084dcb8d0

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-07T20:20:45Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Move Sorter implementations into sorter namespace.

They are internal, not public.
Branch: master
https://github.com/mongodb/mongo/commit/8f6c8eebf6d50b1289df4d0d5a45ddfb22686867

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-07T19:56:32Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 dassert that Sorter's comparator is sane

This should help catch poorly written comparators
Branch: master
https://github.com/mongodb/mongo/commit/94bee44f5a29e75d3023e4e912e33787d9d55f14

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-07T16:44:53Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Make Sorter an interface

Currently there is only one subclass (NoLimitSorter), but 2 more (LimitOneSorter
and TopKSorter) will be added to support limits (SERVER-9443).
Branch: master
https://github.com/mongodb/mongo/commit/439df8fff2e5b3140bf7d32393ce4a18cf5fd876

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-03T22:51:46Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 SortedFileWriter doesn't need SortOptions
Branch: master
https://github.com/mongodb/mongo/commit/acc084a6dc24a4de55c0727cb536aad299338228

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-05-03T21:21:27Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 Comment the public API of the new Sorter
Branch: master
https://github.com/mongodb/mongo/commit/656f118b9e968161c7eabe3a3bc0d31b59568065

Comment by auto [ 13/May/13 ]

Author:

{u'date': u'2013-04-23T20:35:16Z', u'name': u'Mathias Stearn', u'email': u'mathias@10gen.com'}

Message: SERVER-9411 First pass at new Sorter framework

Note that some of this is just scaffolding that will be replaced with
better implementations later. In particular, most of the I/O code will
be replaced.
Branch: master
https://github.com/mongodb/mongo/commit/44d7bce7f7bc775bd8b6c513942fc9eb88baeb59

Generated at Thu Feb 08 03:20:20 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.