[SERVER-51340] MongoDB $accumulator: MongoError: Out of memory Created: 04/Oct/20 Updated: 27/Oct/23 Resolved: 21/Oct/20 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Aggregation Framework |
| Affects Version/s: | 4.4.1 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Major - P3 |
| Reporter: | Asaf Shifer | Assignee: | Dmitry Agranat |
| Resolution: | Works as Designed | Votes: | 0 |
| Labels: | memory, memory-leak | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Environment: |
MongoDB: } Ubuntu: Node.js: package.json: , |
||
| Issue Links: |
|
||||||||
| Operating System: | ALL | ||||||||
| Steps To Reproduce: |
|
||||||||
| Participants: | |||||||||
| Description |
| Comments |
| Comment by Dmitry Agranat [ 21/Oct/20 ] | |||||||||||||||||||||||||||||||||
|
We haven’t heard back from you for some time, so I’m going to mark this ticket as resolved. If this is still an issue for you, please provide additional information and we will reopen the ticket. Regards, | |||||||||||||||||||||||||||||||||
| Comment by Dmitry Agranat [ 05/Oct/20 ] | |||||||||||||||||||||||||||||||||
|
The $group stage has a limit of 100 megabytes of RAM. By default, if the stage exceeds this limit, $group returns an error. To allow for the handling of large datasets, set the allowDiskUse option to true. This flag enables $group operations to write to temporary files. Your 35 documents x 3 MB each = 105 MB, which is larger than the defined limit of 100 MB. From the log snippet you've provided, there is no evidence the allowDiskUse option was used. Would you please archive (tar or zip) the mongod.log files and the $dbpath/diagnostic.data directory so that we could further investigate this (the contents are described here) and upload them to this support uploader location? Files uploaded to this portal are visible only to MongoDB employees and are routinely deleted after some time. Thanks, | |||||||||||||||||||||||||||||||||
| Comment by Asaf Shifer [ 04/Oct/20 ] | |||||||||||||||||||||||||||||||||
|
Found this in the logs:
| |||||||||||||||||||||||||||||||||
| Comment by Asaf Shifer [ 04/Oct/20 ] | |||||||||||||||||||||||||||||||||
|
/etc/mongod.conf:
| |||||||||||||||||||||||||||||||||
| Comment by Asaf Shifer [ 04/Oct/20 ] | |||||||||||||||||||||||||||||||||
|
Changing the hardware to t3.xlarge (16GB RAM) didn't solved it as well | |||||||||||||||||||||||||||||||||
| Comment by Asaf Shifer [ 04/Oct/20 ] | |||||||||||||||||||||||||||||||||
|
The code was changed into a 1-liner, so it looks like the end of the
was commented out, while it was properly closed |