[COMPASS-5752] Cannot import document with string number as a key - "Document is larger than the maximum size 16777216" Created: 19/Apr/22  Updated: 29/Oct/23  Resolved: 04/Apr/23

Status: Closed
Project: Compass
Component/s: Import/Export
Affects Version/s: 1.31.1
Fix Version/s: 1.36.2

Type: Bug Priority: Major - P3
Reporter: Tomáš Laubr Assignee: Unassigned
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

Windows 10
Compass 1.31.1


Attachments: File import.json    
Issue Links:
Depends
depends on COMPASS-6424 importJSON() import function and tests Closed
Related
is related to COMPASS-4418 Compass has no good way to import arr... Closed
Epic Link: COMPASS-5576
Documentation Changes: Not Needed

 Description   

Problem Statement/Rationale

Cannot import document with string number as a key:

{"_id":"3f574f2d-99b3-4e90-82ae-79c0392602e5","a":{"b":{"56495341":{}}}}

Steps to Reproduce

  1. In  Compass, go to any existing collection or create a fresh one
  2. Click "Import Data" or ADD DATA -> Import File
  3. Select the file "import.json" and confirm

Expected Results

Document from the file is imported to the collection

Actual Results

Error appears


  • Document is larger than the maximum size 16777216

and no document is imported

Additional Notes

When the document is inserted through ADD DATA -> Insert Document it works as expected



 Comments   
Comment by Tomáš Laubr [ 19/Apr/22 ]

When a big file with many documents contains these "buggy" documents, it seems than Compass Import skips 1000 documents per each "buggy" record.

In my case, 5000 out of 91925 documents were not imported. However it seems only 5 "buggy" documents were present in the file (but I'm not 100% sure). It was actually quite hard to find out, which documents were causing problems.

Generated at Wed Feb 07 22:40:41 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.