Consistent progress support for analyzeCSVFields, importCSV and importJSON, etc

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Done
    • Priority: Major - P3
    • No version
    • Affects Version/s: None
    • Component/s: None
    • None
    • 2
    • Iteration Velvet Crab
    • Not Needed

      For importing CSV I think the progress event worked fine because you could see how many docs have been processed and an earlier step already returned the number of docs when we analysed the file. This is enough to accurately show the progress as designed.

      For importing JSON we don't know how many docs there are in advance.

      So I'll have to augment the progress callback with how many bytes have been processed. Then the progress can be the number of bytes out of the total.Add it to both importCSV() and importJSON() so they can remain compatible.

      ie. you would have the number of docs and number of bytes processed. Total bytes in the file can be read outside the function and for CSV we have the additional advantage that we already have the total number of docs.

      Also check other import/export functions that have a progress callback.

            Assignee:
            Le Roux Bodenstein
            Reporter:
            Le Roux Bodenstein
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

              Created:
              Updated:
              Resolved: