[COMPASS-6630] Compass leaks memory during import Created: 21/Mar/23  Updated: 29/Oct/23  Resolved: 23/Mar/23

Status: Closed
Project: Compass
Component/s: Import/Export
Affects Version/s: None
Fix Version/s: 1.36.2

Type: Bug Priority: Major - P3
Reporter: Le Roux Bodenstein Assignee: Le Roux Bodenstein
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment:

OS:
node.js / npm versions:
Additional info:


Issue Links:
Duplicate
is duplicated by COMPASS-6617 stuck when importing large CSV files,... Closed
Epic Link: COMPASS-5576
Documentation Changes: Not Needed

 Description   

Large files (CSV so far, still checking JSON) being imported eventually crashes Compass once it uses up heap memory.

The same files imported in unit tests in node works fine and does not blow up memory usage, suggesting it is something specific to import running inside the electron render process.

Still investigating, will update the ticket.



 Comments   
Comment by Githook User [ 29/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: feedback-updates
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Comment by Githook User [ 27/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: COMPASS-6540-import-toast
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Comment by Githook User [ 23/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: codemirror-multiline-editor
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Comment by Githook User [ 23/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: github-link
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Comment by Githook User [ 23/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: COMPASS-6427-export-json
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Comment by Githook User [ 22/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: 1.36-releases
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Comment by Githook User [ 22/Mar/23 ]

Author:

{'name': 'Le Roux Bodenstein', 'email': 'lerouxb@gmail.com', 'username': 'lerouxb'}

Message: fix(import): Fix memory leak in listCSVFields() COMPASS-6630 (#4178)
Branch: main
https://github.com/mongodb-js/compass/commit/854ad7504f8c0375ec4080b23a23f74453bf5ef4

Generated at Wed Feb 07 22:43:49 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.