[SERVER-1358] Split or achor "jumbo" chunks Created: 03/Jul/10  Updated: 12/Jul/16  Resolved: 17/Dec/10

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 1.7.4

Type: Improvement Priority: Major - P3
Reporter: Alberto Lerner Assignee: Alberto Lerner
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
is duplicated by SERVER-1986 make splitting smarter so chunks are ... Closed
Participants:

 Description   

We rely on a collection's sharding key having enough distinct values so to split keys across chunks and on autosplitting working the large majority of times.

If, for some reason, a very large chunk forms, we want to detect it.

One point we can do that is when we get all the disklocs during a migrate. If the total size or # of objects is too big we want to fail the migrate and force a split.

If we can't split them, find a way to prevent attempting to move it repeatedly.



 Comments   
Comment by auto [ 18/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1358 (Fix) chunk size accounting was using sum of all chunks on shards
https://github.com/mongodb/mongo/commit/d3d11d686328505c69bddb76e4abcc01443b33a6

Comment by auto [ 17/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1358 don't migrate a chunk larger than max chunk size (but allow explicit override)
https://github.com/mongodb/mongo/commit/a3b3c83f96e0642c0faed97c06e4ada2a74fe584

Comment by auto [ 17/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1358 add a size beyond which a chunk migrate request should not go through
https://github.com/mongodb/mongo/commit/7512156d5a49af0bce17abe483210d56f08caf08

Comment by auto [ 17/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1358 lower maximum default chunk size
https://github.com/mongodb/mongo/commit/08bfb0143eea87c2a1b3478f06cb7578e247a3e9

Comment by auto [ 27/Oct/10 ]

Author:

{'login': 'alerner', 'name': 'Alberto Lerner', 'email': 'alerner@10gen.com'}

Message: don't split after a balance move fails (a lock taken would cause it) and defer splitting jumbos to SERVER-1358
http://github.com/mongodb/mongo/commit/d5985242144afdd8b6ea0d662d3c899a36dd0df5

Generated at Thu Feb 08 02:56:47 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.