Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-5897

Insert benchmark in 4.4 after durable history was merged

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 4.4.0-rc7
    • Affects Version/s: None
    • Component/s: None
    • 2
    • Storage - Ra 2020-05-18

      Initial report is here and now I am working on making this useful to others. The Summary section in the report has the full description of the regressions. Some of the conclusions are based on vmstat and iostat data I collect via helper scripts and I hope to figure out how to show that via ftdc.

      The summary is that the insert rate is between 2X to 3X faster with 4.4 prior to the durable history merge compared to 4.4 with the durable history merge. I use the names mo44pre and mo44dh (or mo44dh0315) in the report.

      The workload is the insert benchmark which is open source but is not in DSI. I will provide command lines. The benchmark used 1 client thread and inserted 50M docs. The database fits in RAM, but tests were run with big-cache (database fits in WT) and small-cache (database doesn't fit in WT). The regression was much larger for small cache.

      This might be related to BF-16588 and BF-16496

        1. 44dh.futex0.txt
          18 kB
        2. 44dh.futex1.txt
          89 kB
        3. 44pre.futex0.txt
          21 kB
        4. 44pre.futex1.txt
          27 kB
        5. metrics.mo44dh0315.big
          7.65 MB
        6. metrics.mo44dh0315.small.1
          10.00 MB
        7. metrics.mo44dh0315.small.2
          10.00 MB
        8. metrics.mo44dh0315.small.3
          9.92 MB
        9. metrics.mo44dh0315.small.4
          6.80 MB
        10. metrics.mo44pre.big
          2.17 MB
        11. metrics.mo44pre.small
          6.24 MB
        12. unable.png
          269 kB
        13. window.png
          225 kB

            brian.lane@mongodb.com Brian Lane
            mark.callaghan@mongodb.com Mark Callaghan (Inactive)
            0 Vote for this issue
            12 Start watching this issue