Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-5897

Insert benchmark in 4.4 after durable history was merged

    • Type: Icon: Bug Bug
    • Resolution: Fixed
    • Priority: Icon: Major - P3 Major - P3
    • 4.4.0-rc7
    • Affects Version/s: None
    • Component/s: None
    • 2
    • Storage - Ra 2020-05-18

      Initial report is here and now I am working on making this useful to others. The Summary section in the report has the full description of the regressions. Some of the conclusions are based on vmstat and iostat data I collect via helper scripts and I hope to figure out how to show that via ftdc.

      The summary is that the insert rate is between 2X to 3X faster with 4.4 prior to the durable history merge compared to 4.4 with the durable history merge. I use the names mo44pre and mo44dh (or mo44dh0315) in the report.

      The workload is the insert benchmark which is open source but is not in DSI. I will provide command lines. The benchmark used 1 client thread and inserted 50M docs. The database fits in RAM, but tests were run with big-cache (database fits in WT) and small-cache (database doesn't fit in WT). The regression was much larger for small cache.

      This might be related to BF-16588 and BF-16496

        1. window.png
          window.png
          225 kB
        2. unable.png
          unable.png
          269 kB
        3. metrics.mo44pre.small
          6.24 MB
        4. metrics.mo44pre.big
          2.17 MB
        5. metrics.mo44dh0315.small.4
          6.80 MB
        6. metrics.mo44dh0315.small.3
          9.92 MB
        7. metrics.mo44dh0315.small.2
          10.00 MB
        8. metrics.mo44dh0315.small.1
          10.00 MB
        9. metrics.mo44dh0315.big
          7.65 MB
        10. 44pre.futex1.txt
          27 kB
        11. 44pre.futex0.txt
          21 kB
        12. 44dh.futex1.txt
          89 kB
        13. 44dh.futex0.txt
          18 kB

            Assignee:
            brian.lane@mongodb.com Brian Lane
            Reporter:
            mark.callaghan@mongodb.com Mark Callaghan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

              Created:
              Updated:
              Resolved: