Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-32595

LZ4 compression in MongoDB

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major - P3
    • Resolution: Won't Fix
    • None
    • None
    • WiredTiger

    Description

      WiredTiger added LZ4 support more than two years ago, but MongoDB does not enable it. Why not? LZ4 has better compression ratio and speed than snappy.

      I confirmed my experimental patch for lz4 works on YCSB benchmarks as well as other compression codecs. In the experiments, the compression ratio of storage size is reduced from 28% to 15% if I change journal and block compressors in WiredTiger from snappy to lz4. I used a YCSB in https://github.com/mongodb-labs/YCSB with compressibility=10.

      Attachments

        Issue Links

          related to

          New Feature - A new feature of the product, which has yet to be developed. SERVER-31555 support zstd for network compression

          • Major - P3 - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. SERVER-17741 LZ4 compressor for mongod

          • Minor - P4 - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Task - A task that needs to be done. WT-1751 Add LZ4 compression to WiredTiger supported

          • Closed

          Activity

            People

              brian.lane@mongodb.com Brian Lane
              t.yoshimura Takeshi Yoshimura
              Votes:
              2 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: