[SERVER-939] Ability to distribute collections in a single db Created: 28/Sep/09  Updated: 26/Oct/23

Status: Blocked
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: None

Type: New Feature Priority: Major - P3
Reporter: Eliot Horowitz (Inactive) Assignee: Backlog - Catalog and Routing
Resolution: Unresolved Votes: 96
Labels: oldshardingemea, pm-1051-legacy-tickets
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-11509 movePrimary should error when databas... Closed
Duplicate
is duplicated by SERVER-15213 MongoS concurrency problem with dropD... Closed
is duplicated by SERVER-5707 Move whole collection to one of shards Closed
Gantt Dependency
Related
related to SERVER-8870 mongos unaware of database move after... Closed
related to SERVER-4621 noBalance flag for a collection Closed
related to SERVER-4773 Could shardcollection implicity enabl... Closed
is related to SERVER-11256 improve handling of empty vs nonexist... Closed
Assigned Teams:
Catalog and Routing
Participants:
Case:

 Description   

The implementation of this feature (without moveCollections) has the following work items:

  • Add new parsing functionality to mongos/mongod for chunk manager logic
  • Build new scatterCollections and createCollection commands
  • Deprecate enableSharding
  • Moderate refactoring of the mongod config reload codebase (d_logic.cpp)

To implement moveCollections some additional work is probably necessary, but we can leverage much of the cloneCollection framework.



 Comments   
Comment by Cris Insignares Cuello [ 06/Jul/23 ]

This was part of Global balancer, PM-2325 that was closed as execution it might result in decreased cluster performance for existing customers

Comment by Asya Kamsky [ 09/Nov/14 ]

crazyzh1984 first of all, document size limit is 16MB and not 4MB.

And you can already distribute collections across shards via tag aware sharding - I have a write-up with some examples here:

http://askasya.com/post/taggedcollectionbalancing

In addition you can store all blog posts in a single collection, just identifying it with a specific author and then shard the collection by author.

Comment by JinYan.Zhang [ 09/Nov/14 ]

Because documents has size limit of 4MB, so we use collections to aggregate records.
For example:There is a blog cloud(SAAS),
we create a collection of mongodb dynamiclly for each author, to store their own blog posts privately.
we may create millions of collections, and we wish to shard on collections level.
As each author has limited number of posts, so all the data of a collection will shard into one single server.

We wish to shard on collections dynamically, a use case:
collections with name ends with 'A' will go to shard1,
collections with name ends with 'B' will go to shard2,
etc

We really expect this feature.
thks

Comment by auto [ 08/Feb/13 ]

Author:

{u'date': u'2013-01-29T16:08:11Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-939 abilitiy to distribute collections in a single db

Port tests from d_chunk_manager_tests.cpp for collection_manager_test.cpp
Branch: master
https://github.com/mongodb/mongo/commit/d305bf71dd0c49909c7c59eb3d8c282f9d966128

Comment by auto [ 22/Jan/13 ]

Author:

{u'date': u'2013-01-22T18:36:24Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Removed unused default parameter from extract function
Branch: master
https://github.com/mongodb/mongo/commit/439ce8c8911e33ec47fd1bec9bb6289baf3edfc0

Comment by auto [ 22/Jan/13 ]

Author:

{u'date': u'2013-01-22T17:33:03Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Made source argument of parseBSON const ref
Branch: master
https://github.com/mongodb/mongo/commit/24b35b78bc6f7b7e964edfa2ae96813a39aac4f7

Comment by auto [ 22/Jan/13 ]

Author:

{u'date': u'2013-01-22T17:26:31Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Change FIELD_VALID to FIELD_SET
Branch: master
https://github.com/mongodb/mongo/commit/f9b9bb1f42814b7aa487d1c589cbee3bbde9ed3b

Comment by auto [ 22/Jan/13 ]

Author:

{u'date': u'2013-01-22T17:23:50Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Made is*Set methods const
Branch: master
https://github.com/mongodb/mongo/commit/aa8e450455f538d3fd631b0b19f4cfba2ddde4ae

Comment by auto [ 18/Jan/13 ]

Author:

{u'date': u'2013-01-18T22:46:27Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-939 abilitiy to distribute collections in a single db

Fixed test failure due to uninitialized flag in the mock cursor.
Branch: master
https://github.com/mongodb/mongo/commit/3dfc22e239d7455608a2ad2bc1197eac78550a23

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T17:04:05Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added defaults to fields to fix field_parser test
Branch: master
https://github.com/mongodb/mongo/commit/5205372fbe4eddc3296c2c155ea0699b661a10e8

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:27Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update ChangelogType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/058b24ef9aae96edfc9d70f7d9cedf284f3d8bb5

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:28Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update ChunkType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/19be6832a2e64bede6c6120c8933e4a97caf9312

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:28Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update CollectionType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/72c63c5853fb5e130c3311192ebaf9046a5db4cb

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:28Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update VersionType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/4d4f0c4fb1708ca5ab95d6efc334e185459c2621

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:29Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update LockpingsType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/588a5937884a07c72af6e40a98cd592eedebc74e

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:29Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update LocksType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/04296d4f271aacfaaa8fc7c822e07dba76ae4a50

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:30Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update MongosType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/810aa6cb78a29b584e44d01ba417399ccc1e481a

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:30Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update SettingsType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/a0aaf99845554ff826cc0caaba6e6b9842475c19

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:30Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update ShardType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/f8d9f5d434e1898e4d14c6215e948abcf4164aeb

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T11:50:31Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update TagsType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/2a12fd677b029f8cff7c12f2baf2b4acffb82def

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-17T12:13:21Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Update DatabaseType with new method of recording field presence and handling defaults
Branch: master
https://github.com/mongodb/mongo/commit/20e12facef46d7d3edd98c5240559eaab57e37c7

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-04T19:46:14Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Store defaults in BSONField and handle defaults in FieldParser extract functions
Branch: master
https://github.com/mongodb/mongo/commit/e0fa2f1eea17be8faeaad2a550c82e833a3eadeb

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2012-12-19T17:26:41Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added information about whether field was set to field_parser
Branch: master
https://github.com/mongodb/mongo/commit/39d2b276b6b5ed4c4671973641d3c89fb0afba3e

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-10T20:11:30Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-939 abilitiy to distribute collections in a single db

Fix memory leak when error is encountered while creating a CollectionManager
Branch: master
https://github.com/mongodb/mongo/commit/e923e7695bc6492d383e1125f12b73ff7c5125c2

Comment by auto [ 17/Jan/13 ]

Author:

{u'date': u'2013-01-10T20:02:37Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-939 abilitiy to distribute collections in a single db

Port tests from d_chunk_manager_tests.cpp for metadata_loader_test.cpp
Branch: master
https://github.com/mongodb/mongo/commit/1e2283a07f07d417f7bcb600b7a8fbd0720f25bd

Comment by auto [ 19/Dec/12 ]

Author:

{u'date': u'2012-12-14T20:05:24Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added errMsg to parseBSON in *Type classes
Branch: master
https://github.com/mongodb/mongo/commit/d2adeeb4a74dac9f41280d42635fa60d2d58a864

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-05T23:40:17Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed ChangelogFields to ChangelogType
Branch: master
https://github.com/mongodb/mongo/commit/7784598c79b6514c1ebd9fab27ecdc878ef7aea4

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-05T22:52:52Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Added type class for documents in config.changelog collection
Branch: master
https://github.com/mongodb/mongo/commit/9631cda23dce21242c1032b4a4c35498b880fe58

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-06T01:32:04Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed LockPingFields to LockpingsType
Branch: master
https://github.com/mongodb/mongo/commit/b1845ec73b8e5fbb23f67639f3319bb010df9f0f

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-06T01:25:57Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Added type class for documents in config.lockpings collection
Branch: master
https://github.com/mongodb/mongo/commit/bd9ae50abf96abe78226d827916e366ce5cc9e51

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-05T21:24:35Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed MongosFields to MongosType
Branch: master
https://github.com/mongodb/mongo/commit/b2e3587f9cad2c681a236da5702280a4295ca153

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-06T20:04:40Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed TagFields to TagsType
Branch: master
https://github.com/mongodb/mongo/commit/b22f069ac1a494baa7d40db52bdcb49e961eb4ad

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-06T19:52:51Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Added type class for documents in config.tags collection
Branch: master
https://github.com/mongodb/mongo/commit/213d731ccc2b82e53e64fe8091484649370cb9d3

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-06T01:04:06Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Changed LockFields to LocksType
Branch: master
https://github.com/mongodb/mongo/commit/f2446eaa5a23641da12f8a63f34fc3183e055906

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-06T01:00:12Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Added type class for documents in config.locks collection
Branch: master
https://github.com/mongodb/mongo/commit/fa70853dca0990371cf1fde0a9f86088aa6be4c0

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-07T02:19:28Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed SettingsFields to SettingsType
Branch: master
https://github.com/mongodb/mongo/commit/5e91da251e332abc79749c8167b3bdc273e95a54

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-07T02:05:38Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Added type class for documents in config.settings collection
Branch: master
https://github.com/mongodb/mongo/commit/bf7614739eb869fafff8f04297b47edb1bfccc0a

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-01T01:34:37Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed DatabaseFields to DatabaseType
Branch: master
https://github.com/mongodb/mongo/commit/99d046d0d95c748b414e42ffd37e225d4b4cb05c

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-02T01:52:01Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Added type class for documents in config.mongos collection
Branch: master
https://github.com/mongodb/mongo/commit/a8b8f95cf7263f0c58c6347fb9f738b490fea5c5

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-12-01T01:08:14Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed CollectionFields to CollectionType
Branch: master
https://github.com/mongodb/mongo/commit/9c07a059fedfe534c890a59d13e0fc6536fd8ee8

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-11-30T19:47:49Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed ShardFields to ShardType
Branch: master
https://github.com/mongodb/mongo/commit/6cd748eccdcea47c6413a144f921cd8ec9dfcff4

Comment by auto [ 18/Dec/12 ]

Author:

{u'date': u'2012-11-30T02:16:08Z', u'name': u'Shaun Verch', u'email': u'shaun.verch@10gen.com'}

Message: SERVER-939 Changed ChunkFields to ChunkType
Branch: master
https://github.com/mongodb/mongo/commit/566cf01bd870036b0dfd4b2babaf414b65de444c

Comment by auto [ 11/Dec/12 ]

Author:

{u'date': u'2012-12-11T19:29:01Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 fixes to database type
Branch: master
https://github.com/mongodb/mongo/commit/d53150750557b974d859da3c56dc0ae847e67cc2

Comment by auto [ 11/Dec/12 ]

Author:

{u'date': u'2012-12-11T19:28:45Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 field parser and BSON enhancements for vectors and maps
Branch: master
https://github.com/mongodb/mongo/commit/9bc4f3efb3455e0bcd41de908f7ec10532255b2d

Comment by auto [ 06/Dec/12 ]

Author:

{u'date': u'2012-12-06T15:43:28Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 temporarily remove scoped dist lock tests, currently incompatible with debug builds
Branch: master
https://github.com/mongodb/mongo/commit/a781f5a0f6ae1ee24cd83b210c779e400bfaac96

Comment by Greg Studer [ 05/Dec/12 ]

Yeah - forgot that debug builds fail immediately on verify. Will work to try and fix.

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-12-03T21:38:28Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 rollback bson element error message change
Branch: master
https://github.com/mongodb/mongo/commit/603b9c6795e4cc0db9ff8f344cb9bf1100ff8b1d

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-12-03T20:50:15Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 minor fixes to test cases for new type_ parsing
Branch: master
https://github.com/mongodb/mongo/commit/d2df0645428251b2d107b8ebe2f6f37b203ec057

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-11-26T19:11:46Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 make scopedDbConnection take ConnectionStrings directly
Branch: master
https://github.com/mongodb/mongo/commit/e857f6608ceafa5dbb4b863ca78193de47694402

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-11-30T21:32:43Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 enhance owned pointer vector and add owned pointer map
Branch: master
https://github.com/mongodb/mongo/commit/ceddaa1ac65b1c06e62a217f4a78086e0a354f23

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-11-26T19:14:35Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 modify config types for config version changes
Branch: master
https://github.com/mongodb/mongo/commit/64408b78c89a65a4a727b57d552b64bf5f7eb803

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-11-26T19:14:51Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 error handling for string*
Branch: master
https://github.com/mongodb/mongo/commit/d26f22eb2e4280f3dc5713ab99da810208c783da

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-11-26T19:09:49Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 toString() for random part of OID
Branch: master
https://github.com/mongodb/mongo/commit/b8185fc4eac2726d0e850698ac100b9686f8755f

Comment by auto [ 03/Dec/12 ]

Author:

{u'date': u'2012-11-26T19:09:25Z', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-939 simplify use of scoped distributed and balancer lock
Branch: master
https://github.com/mongodb/mongo/commit/94fe9334b1d09383d583ab5e56c05a1fb3754753

Comment by auto [ 29/Nov/12 ]

Author:

{u'date': u'2012-11-29T22:05:23Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added shard tags to field constants and document type
Branch: master
https://github.com/mongodb/mongo/commit/40577e84f4fc3e9b2ec7e6db3448ff5cedaa9c6c

Comment by auto [ 29/Nov/12 ]

Author:

{u'date': u'2012-11-26T23:22:02Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added field type constants for config.settings collection
Branch: master
https://github.com/mongodb/mongo/commit/b8bdc320d5bf4ad9ad24eacbb310bddc1e3133ad

Comment by auto [ 29/Nov/12 ]

Author:

{u'date': u'2012-11-29T10:17:59Z', u'email': u'tad@10gen.com', u'name': u'Tad Marshall'}

Message: SERVER-939 fix compile
Branch: master
https://github.com/mongodb/mongo/commit/9c6912e0a70e2ff95bc2a30c4e07dae56205521b

Comment by auto [ 29/Nov/12 ]

Author:

{u'date': u'2012-11-29T10:10:19Z', u'email': u'tad@10gen.com', u'name': u'Tad Marshall'}

Message: SERVER-939 whitespace (indent) for cpplint
Branch: master
https://github.com/mongodb/mongo/commit/8c4d33f505fb0a3374583894a3dccc10a754eb36

Comment by auto [ 29/Nov/12 ]

Author:

{u'date': u'2012-11-29T06:04:38Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Cleaned CollectionManager.
Branch: master
https://github.com/mongodb/mongo/commit/5352721ef242ae2f2531dbfb10b868444129fe80

Comment by auto [ 29/Nov/12 ]

Author:

{u'date': u'2012-11-26T20:15:08Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 new CollectionManager and MetadataLoader classes (not yet hooked).
Branch: master
https://github.com/mongodb/mongo/commit/eb3cf24e3ed24169c45cfa8dcf0e49ead12eeb49

Comment by auto [ 22/Nov/12 ]

Author:

{u'date': u'2012-11-21T19:38:44Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added field type constants for config.changelog collection
Branch: master
https://github.com/mongodb/mongo/commit/319c7f0ced3935dd9d28ed89895112e6504612cd

Comment by auto [ 21/Nov/12 ]

Author:

{u'date': u'2012-11-20T21:07:28Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added field type constants for config.mongos collection
Branch: master
https://github.com/mongodb/mongo/commit/ca6b31d9d2da68bb14ea896d3db8de72fb0bed5d

Comment by auto [ 20/Nov/12 ]

Author:

{u'date': u'2012-11-20T02:57:50Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Introduced type for config.shards collection.
Branch: master
https://github.com/mongodb/mongo/commit/38a48227486caecfe45e4754418e22f804cdbf84

Comment by auto [ 20/Nov/12 ]

Author:

{u'date': u'2012-11-19T20:29:23Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added field type constants for config.lockpings collection
Branch: master
https://github.com/mongodb/mongo/commit/ec38a5b7f242987fdabd27c6acc257b79936ffd7

Comment by auto [ 19/Nov/12 ]

Author:

{u'date': u'2012-11-19T23:49:17Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Introduced types for config.databases and config.chunks collections.
Branch: master
https://github.com/mongodb/mongo/commit/3cc16161de9e097c34f8992bd7376203af86182e

Comment by auto [ 19/Nov/12 ]

Author:

{u'date': u'2012-11-13T19:58:20Z', u'email': u'shaun.verch@10gen.com', u'name': u'Shaun Verch'}

Message: SERVER-939 Added field type constants for config.locks collection
Branch: master
https://github.com/mongodb/mongo/commit/77bf7870d02267ff3dde6ac87c2e7d9ddac92ddd

Comment by auto [ 11/Nov/12 ]

Author:

{u'date': u'2012-11-11T00:10:46Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Changed FieldParser to have the correct BSON ownership semantics.
Branch: master
https://github.com/mongodb/mongo/commit/889fd753e98dfb91970560c798c3b9c15bdb96f2

Comment by auto [ 10/Nov/12 ]

Author:

{u'date': u'2012-11-10T22:23:42Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Corrected bson ownership (fixed unit test)
Branch: master
https://github.com/mongodb/mongo/commit/894cc05556fbf69ee515b3685a60e8a5e6d345aa

Comment by auto [ 10/Nov/12 ]

Author:

{u'date': u'2012-11-10T20:55:37Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Included generic bson header (fix compile)
Branch: master
https://github.com/mongodb/mongo/commit/4c78e38659901dfb3e3ca91b7aa7f4864401ee7d

Comment by auto [ 09/Nov/12 ]

Author:

{u'date': u'2012-11-08T20:33:44Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Introduced type for config.collection docs.
Branch: master
https://github.com/mongodb/mongo/commit/e0efa2671623d2b034c4aee673f070dd8ff15c17

Comment by auto [ 06/Nov/12 ]

Author:

{u'date': u'2012-10-26T21:49:50Z', u'email': u'alerner@10gen.com', u'name': u'Alberto Lerner'}

Message: SERVER-939 Introduced more collection and fields names constants.
Branch: master
https://github.com/mongodb/mongo/commit/0785b7a0a33c56a5915121ec87949304dd55052c

Comment by Alberto Lerner [ 23/Oct/12 ]

Author:

{u'date': u'2012-10-23T12:29:57-07:00', u'name': u'Alberto Lerner', u'email': u'alerner@10gen.com'}

Message:Introduced constants to refer to collection names and fields in the config server.
Branch: master
https://github.com/mongodb/mongo/commit/03f6428015116124d70a61287c89b191fa3c9ab7

Comment by Rakesh Sankar [ 16/Oct/12 ]

This will be a great feature to have and I am eagerly looking forward to it.

Comment by Aravind.H.U [ 18/Sep/12 ]

When can I expect this feature , I am badly in need of this , because I create collections dynamically , and collections get filled with data seamlessly . Please let me know when this feature is going to be implemented

Comment by Ian Whalen (Inactive) [ 31/Jul/12 ]

Ukolov, this will not be in the 2.2 release. We're still finalizing the feature set for the 2.4 release and will definitely take your concerns and votes here into consideration.

Comment by Ukolov Sergey [ 31/Jul/12 ]

Don't you have in plans to implement this in next release? Sorry, but this is very important ticket for me...

Comment by Azat Khuzhin [ 25/Apr/12 ]

@eliot how can I do this? (Simple code would be usefull)

Comment by Eliot Horowitz (Inactive) [ 25/Apr/12 ]

@azat - you can shard a collection, move the only chunk to where you want it and then disable balancing for that collection.

Comment by Azat Khuzhin [ 25/Apr/12 ]

Eliot, how #SERVER-4621 allows set primary server for collection? (related to #SERVER-5707)

Comment by Ukolov Sergey [ 24/Apr/12 ]

any news about this? When do you think it will be implemented? With big amount of unsharded collections SERVER-4621 will be a problem...

Comment by Eliot Horowitz (Inactive) [ 05/Jan/12 ]

With SERVER-4621 - you can shard a collection, mark it as no balancing, and the move the 1 chunk to a different shard - effectively doing what you want.

Comment by MediaMath Mongo [ 04/Jan/12 ]


Even if you can disable balancer on per collection bases, you still need a way to set "primary" for collections which I have been told that it is not possible yet. Has that changed yet?

Comment by Eliot Horowitz (Inactive) [ 04/Jan/12 ]

SERVER-4621 will give the ability to do this with a little manual effort - but at least it will be possible.

Comment by karl seguin [ 19/Aug/11 ]

A particularly useful reason to have this is to be able to use capped collections in a greater number of scenarios. For example, if you want to maintain X logs per server via a capped collection, you need each servers to have its own collection (because you don't want the last 1000 logs in total, you want the last 1000 logs per server.) However, once you do this, you can't shard..and I get sad face. (edit: you can shard, you just need to do it yourself, obviously).

Comment by Eliot Horowitz (Inactive) [ 01/Apr/11 ]

No further information that is attached to the ticket, so its currently in 1.9 planning which as the version says is things we're hoping to get in 1.9

Comment by Remon van Vliet [ 01/Apr/11 ]

Any news on ETA and implementation details? This is becoming a problem for us.

Comment by Alberto Lerner [ 18/Dec/10 ]

http://www.mongodb.org/display/DOCS/Configuring+Sharding#ConfiguringSharding-ShardingaCollection

Comment by Matic [ 18/Dec/10 ]

Thank you for the answers so far. So how can a single collection have documents stored on many shards if it's limited to one shard?

Comment by Alberto Lerner [ 17/Dec/10 ]

If you create a new database, the most available shard at that time will be picked to host that entire database. That is , all its collections would be in that shard. If you create another database, possible another shard will be picked for all the collections of that database.

With this feature, each of the collections could have a different shard.

Comment by Eliot Horowitz (Inactive) [ 17/Dec/10 ]

If you have 1 database, and 1000 collections, all 1000 collections will be on the same shard without this.
If you have 10 databases, and 100 collections per shard, then your databases (and therefore collections) will be distributed across shards.

Comment by Matic [ 17/Dec/10 ]

I don't understand. Could you please explain what scenario is currently unavailable that this feature will make available?

Comment by Eliot Horowitz (Inactive) [ 17/Dec/10 ]

No - currently we distribute databases and objects (in a sharded collection), but not collections themselves.

Comment by Matic [ 17/Dec/10 ]

What exactly does this feature mean? Doesn't MongoDB already support sharding of collections within a database among nodes in a set?

Comment by Eliot Horowitz (Inactive) [ 17/Dec/10 ]

Sorry for continuing to push this, don't want to hack it in a bad way.

Generated at Thu Feb 08 02:55:35 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.