Uploaded image for project: 'Compass '
  1. Compass
  2. COMPASS-6332

Compass export feels really slow

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 1.35.0
    • Affects Version/s: None
    • Component/s: Import/Export
    • None
    • 2
    • Iteration Porpoise
    • Not Needed

      While using import and export locally I realised that export is many times slower than import which made no sense to me.

      I noticed two things:

      1) The progress updates are not happening at 250ms intervals as we specify here, but in fact seem to happen in a tight loop (probably every row?):
      https://github.com/mongodb-js/compass/blob/92270b35885e90f6eb7b153275848f7a2be21278/packages/compass-import-export/src/modules/export.ts#L501-L511

      See https://mongodb.slack.com/archives/G2L10JAV7/p1669366262289589

      2) At least locally in development the dev tools console breaks during export of large collections. You have to close it and reopen it to get it to work again. I logged every time we update the progress and only the first few logs would show up even though the progress keeps updating.

      See https://mongodb.slack.com/archives/G2L10JAV7/p1669369902773209

            Assignee:
            Unassigned Unassigned
            Reporter:
            leroux.bodenstein@mongodb.com Le Roux Bodenstein
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: