Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-17299

Extraneous memory allocations in snappy hurt WiredTiger performance on Windows

    • Fully Compatible
    • ALL
    • Hide

      I have 50 threads bulk inserting 100 <1k documents as fast as Mongo will take them.

      Using the MMap engine doesn't show this behavior. Right now, after running for ~8 minutes, my cpu is sitting at 23% and the insert rate is at 11k/s.

      I don't know if this is expected or not, but it seems like quite a dramatic drop off.

      Show
      I have 50 threads bulk inserting 100 <1k documents as fast as Mongo will take them. Using the MMap engine doesn't show this behavior. Right now, after running for ~8 minutes, my cpu is sitting at 23% and the insert rate is at 11k/s. I don't know if this is expected or not, but it seems like quite a dramatic drop off.

      WiredTiger starts at an insertion rate of 40k/sec, and slows down to 15k/sec within 2 minutes.

      System memory is not exhausted.

      Specifically the CPU% appears to drop from 100% quite quickly and insert times (for the individual bulk inserts) grows.

      MongoStat doesn't appear to show any specific resource limit, nor do I see anything obvious.

      Using the C# driver 2.0.0-beta2.

      Please see https://groups.google.com/forum/#!topic/mongodb-user/DMa24b2TqKM

        1. mongo1.png
          302 kB
          Nick Judson
        2. mongo2.png
          381 kB
          Nick Judson
        3. mongo3.png
          375 kB
          Nick Judson
        4. mongo4.png
          1.05 MB
          Nick Judson
        5. mongo5.png
          1.05 MB
          Nick Judson
        6. mongo6.png
          1.06 MB
          Nick Judson
        7. mongo7.png
          1.05 MB
          Nick Judson
        8. mongo8.png
          832 kB
          Nick Judson
        9. MongoPerfTest.7z
          8.77 MB
          Nick Judson

            Assignee:
            mark.benvenuto@mongodb.com Mark Benvenuto
            Reporter:
            nickj Nick Judson
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

              Created:
              Updated:
              Resolved: