Uploaded image for project: 'MongoDB Database Tools'
  1. MongoDB Database Tools
  2. TOOLS-2888

Add compressor support to mongoimport

    XMLWordPrintable

    Details

    • Type: Investigation
    • Status: Accepted
    • Priority: Major - P3
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 100.7.0
    • Component/s: None
    • Labels:
      None

      Description

      I am doing testing / trying to implement zstd compression as part of https://jira.mongodb.org/browse/CLOUDP-85175

      Trying to load data into an Atlas cluster that has been enabled with the zstd compressor as shown below:

      db._adminCommand({getCmdLineOpts: 1}).parsed.net.compression
      >>> { "compressors" : "snappy,zstd,zlib" }

       

      The mongoimport does not support being able to pass compressor values and gives the following error:

      WARNING: ignoring unsupported URI parameter 'compressors'

      Even though we list official support for the zstd compressor in our URI documentation: https://docs.mongodb.com/manual/reference/connection-string/#compression-options

      So we should add the ability to pass either snappy, zlib, or zstd as a parameter (or comma delimited list) and have the wire protocol leverage that compressor for the over-the-wire compression 

       

        Attachments

        1. image-2021-06-10-21-48-37-284.png
          image-2021-06-10-21-48-37-284.png
          17 kB
        2. image-2021-06-12-16-50-30-118.png
          image-2021-06-12-16-50-30-118.png
          83 kB
        3. image-2021-06-12-16-51-39-777.png
          image-2021-06-12-16-51-39-777.png
          172 kB
        4. image-2021-06-12-16-53-25-940.png
          image-2021-06-12-16-53-25-940.png
          331 kB
        5. image-2021-06-12-16-56-43-874.png
          image-2021-06-12-16-56-43-874.png
          76 kB
        6. image-2021-06-12-17-13-35-373.png
          image-2021-06-12-17-13-35-373.png
          20 kB
        7. image-2021-06-12-17-13-59-793.png
          image-2021-06-12-17-13-59-793.png
          20 kB
        8. image-2021-06-12-17-14-31-639.png
          image-2021-06-12-17-14-31-639.png
          74 kB
        9. image-2021-06-12-17-15-27-945.png
          image-2021-06-12-17-15-27-945.png
          73 kB
        10. image-2021-06-12-17-16-30-357.png
          image-2021-06-12-17-16-30-357.png
          20 kB
        11. image-2021-06-12-17-19-13-375.png
          image-2021-06-12-17-19-13-375.png
          74 kB
        12. image-2021-06-12-17-19-59-270.png
          image-2021-06-12-17-19-59-270.png
          20 kB
        13. image-2021-06-16-10-59-28-622.png
          image-2021-06-16-10-59-28-622.png
          72 kB
        14. image-2021-06-16-10-59-55-545.png
          image-2021-06-16-10-59-55-545.png
          74 kB
        15. image-2021-06-16-11-00-17-725.png
          image-2021-06-16-11-00-17-725.png
          11 kB
        16. image-2021-06-16-11-04-10-525.png
          image-2021-06-16-11-04-10-525.png
          38 kB
        17. image-2021-06-16-11-04-49-602.png
          image-2021-06-16-11-04-49-602.png
          7 kB
        18. image-2021-06-16-11-06-35-830.png
          image-2021-06-16-11-06-35-830.png
          17 kB
        19. image-2021-06-16-11-07-02-498.png
          image-2021-06-16-11-07-02-498.png
          17 kB
        20. image-2021-06-16-11-08-09-000.png
          image-2021-06-16-11-08-09-000.png
          25 kB

          Issue Links

            Activity

              People

              Assignee:
              Unassigned Unassigned
              Reporter:
              bryan.zelle Bryan Zelle
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Dates

                Created:
                Updated: