[SERVER-4220] refactor getChunkManager() and sharding code to better handle parallel queries. Created: 07/Nov/11  Updated: 11/Jul/16  Resolved: 28/Feb/12

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 2.1.1

Type: Bug Priority: Major - P3
Reporter: Greg Studer Assignee: Greg Studer
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-4711 Don't use masserts when getChunkManag... Closed
is depended on by SERVER-4398 ClusteredCursor reported total time i... Closed
Related
related to SERVER-4605 explain() needs to better handle vers... Closed
is related to SERVER-4215 multiple connections to shards can ra... Closed
is related to SERVER-1546 Moving a chunk to a server that gets ... Closed
is related to SERVER-4177 make multi-shard retrying due to stal... Closed
Operating System: ALL
Participants:

 Description   

This ticket has turned into a more general refactoring of the parallel cursor code, minimizing the use of getChunkManager(), but also includes the original issue:

getChunkManager()'s failure mode is to throw masserts, which is incorrect as changes in sharding are not generally exception cases - this leads to very ugly logs and confusing codepaths. Also, there are various configurable levels of reloading for getChunkManager(), these should be clearer and encapsulated.



 Comments   
Comment by Greg Studer [ 28/Feb/12 ]

This issue is essentially fixed - will open a new ticket to track more specific refactoring.

Comment by auto [ 29/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: SERVER-4220 only require reconnect for pcursor if shard version changes on that shard
Branch: master
https://github.com/mongodb/mongo/commit/594e67254a657966e1913923b34030f29f07fe2f

Comment by auto [ 21/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: SERVER-4220 allow commands with #RANDOM in benchRun for migration tests
Branch: master
https://github.com/mongodb/mongo/commit/ea3ecfdc0908a014c1db5778e1b354fd4ac850e2

Comment by auto [ 15/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: SERVER-4220 buildbot count_slaveok.js explicitly set booleans, don't be clever with cleanup method
Branch: master
https://github.com/mongodb/mongo/commit/1157f5230974645f598a9da99f9b74a6aeab2f88

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: allow commands to be run sharded via ParallelCursor SERVER-4220
Branch: master
https://github.com/mongodb/mongo/commit/b8f86e566213a441fbf2b950a70f8daaf44c6e41

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: SERVER-4220 extend namespacestring to handle commands, use in pcursor
Branch: master
https://github.com/mongodb/mongo/commit/8351843a091cb7c2bce7f84470ee4f15b2c9e2ee

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: allow non-lazy cursors via sharded pcursors SERVER-4220
Branch: master
https://github.com/mongodb/mongo/commit/9c13e0bc611897c2b0a11e11df76605292f825e0

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: SERVER-4220 disable request retries, now handled by pcursor
Branch: master
https://github.com/mongodb/mongo/commit/1973153321caf7483d0ff10913e196fa367d78f5

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: consistent initialization of parallel cursor across shards SERVER-4220
Branch: master
https://github.com/mongodb/mongo/commit/db409afb5ea4dce56c0cd341bf005a3f05b2f106

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: SERVER-4220 add better parallelcursor constructor
Branch: master
https://github.com/mongodb/mongo/commit/d9adbc6082e0a8d7fcf95c3767a06cf1f39f02a6

Comment by auto [ 14/Dec/11 ]

Author:

{u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: add ChunkManager to ShardConnection SERVER-4220
Branch: master
https://github.com/mongodb/mongo/commit/8995853205dbc58df0a37537cd5bdaa61472f393

Comment by auto [ 09/Nov/11 ]

Author:

{u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: add compatibleWith api to chunkmanager SERVER-4220
Branch: master
https://github.com/mongodb/mongo/commit/5b782c8ced503d78f9783d556f92d86941ee5f91

Comment by auto [ 09/Nov/11 ]

Author:

{u'login': u'gregstuder', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: make ns functions usable elsewhere SERVER-4220
Branch: master
https://github.com/mongodb/mongo/commit/885f82daf77bd3d183b0c2ec07893162ede7ba80

Generated at Thu Feb 08 03:05:19 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.