[SERVER-1986] make splitting smarter so chunks are more homogenous Created: 22/Oct/10  Updated: 12/Jul/16  Resolved: 19/Dec/10

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 1.7.4

Type: Improvement Priority: Major - P3
Reporter: Eliot Horowitz (Inactive) Assignee: Alberto Lerner
Resolution: Done Votes: 3
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Duplicate
duplicates SERVER-1358 Split or achor "jumbo" chunks Closed
Participants:

 Comments   
Comment by Ofer Fort [ 08/Apr/11 ]

i'd love to try it, but since it is in our production site, i can't take the
risk of an unstable version. will have to wait for 1.7.4 to release.
a question, will it also split chunks that are already in a big size, or is
it only for new chunks?

Comment by auto [ 19/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1986 simpler mechanism for picking up split checks if mongos bounces frequently
https://github.com/mongodb/mongo/commit/bfdf4ba06e770bc22389be1676b292bf9143ce1c

Comment by auto [ 18/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: Revert "SERVER-1986 check if split is needed every so often, even if not much data changed"

This reverts commit 31eadf03e2d00dab56af92570efcb3e12bf984cf.
https://github.com/mongodb/mongo/commit/12764d61a0afb025a49b871ec19dfa1d45d35bc3

Comment by auto [ 18/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: Revert "SERVER-1986 grid can now tell how many mongos's recently pinged"

This reverts commit 6aa403b260a34089bf5df1e00b2ba471fb3453e9.
https://github.com/mongodb/mongo/commit/7e18aeaa8348b0b9b5f5a3eee6d0318a62483487

Comment by auto [ 17/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1986 grid can now tell how many mongos's recently pinged
https://github.com/mongodb/mongo/commit/6aa403b260a34089bf5df1e00b2ba471fb3453e9

Comment by Alberto Lerner [ 17/Dec/10 ]

Just added a bit of documentation about this here:
http://www.mongodb.org/display/DOCS/Sharding+Administration#ShardingAdministration-ChunkSizeConsiderations

Comment by Alberto Lerner [ 17/Dec/10 ]

Ofer,

We added two mechanisms to split much more aggressively here. If you wan to give it try in 1.7.4 (unstable), feedback would be appreciated.

Alberto.

Comment by auto [ 17/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1986 check if split is needed every so often, even if not much data changed
https://github.com/mongodb/mongo/commit/31eadf03e2d00dab56af92570efcb3e12bf984cf

Comment by auto [ 16/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1986 meant 250K not 2.5M
https://github.com/mongodb/mongo/commit/b0bafdf7d4617b936d5ffcbfd3bcbb5727ee1efb

Comment by auto [ 16/Dec/10 ]

Author:

{u'login': u'alerner', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message: SERVER-1986 more reasonable limit for docs in a split chunk
https://github.com/mongodb/mongo/commit/30c1709c2bceea522206761f2ba26ae99071965c

Comment by ofer fort [ 25/Oct/10 ]

This is becoming a real issue for us.
I have a collection that has most of the chunks at about 2M documents, but i have some that are more then 60M, this causes my shards to be very uneven.

Generated at Thu Feb 08 02:58:38 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.