[SERVER-23482] Should the 16Mb limit be configurable? Created: 02/Apr/16  Updated: 06/Dec/22  Resolved: 05/Apr/16

Status: Closed
Project: Core Server
Component/s: Storage
Affects Version/s: None
Fix Version/s: None

Type: Improvement Priority: Major - P3
Reporter: David Banks Assignee: Backlog - Storage Execution Team
Resolution: Won't Fix Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
related to SERVER-5923 Increase max document size to at leas... Closed
Assigned Teams:
Storage Execution
Backwards Compatibility: Fully Compatible
Participants:

 Description   

The 16Mb limit on document size seems very arbitrary indeed, given that Mongo is capable of storing documents with much larger (about 536.7Mb, I think).

Could this value be configurable?

I am not thinking of situation with large binary data, GridFS can handle that but scenarios where there are growing documents (such as the scenario I'm looking at in work).

If a 16Mb hard limit was reached, and the database simply refused to carry on letting the document grow, then this would cause a huge problem.



 Comments   
Comment by David Banks [ 06/Apr/16 ]

Hi Geert,

Thanks for replying and explaining. I was under the impression (fom MongoDB University) that the 16Mb was an arbitary limit, put in place to enforce 'good practice'. Thanks for the explaination.

Comment by Geert Bosch [ 05/Apr/16 ]

David, we do not plan to make this limit configurable in the near term. In order to support much larger documents, such as the 64Mb documents suggested, assumptions such as that we can easily allocate copies of documents for modification will no longer hold. Transactions could grow extremely large (just think of a 64Mb array of elements to index). We would need to significantly throttle the number of concurrent operations, or raise the memory requirements for mongod.

Instead consider breaking up your document in logical pieces, and rejoin those pieces needed with a $lookup aggregation stage when needed.

Regards,
-Geert

Comment by Kelsey Schubert [ 04/Apr/16 ]

Hi banksysan,

Thank you for the improvement request - I am marking this ticket to be considered during the next round of planning. Please continue to watch this ticket for updates.

Kind regards,
Thomas

Generated at Thu Feb 08 04:03:30 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.