Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6509

Tune eviction walk to find better candidates and hence improve insert benchmark

    • Type: Icon: Bug Bug
    • Resolution: Works as Designed
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 4.4.0-rc12
    • Component/s: None
    • None
    • 8
    • Storage - Ra 2020-07-13, Storage - Ra 2020-07-27, Storage - Ra 2020-08-10

      This reproduces with the insert benchmark and 8 clients on a c3.xlarge host. The cpu-bound test inserts 80m docs and the database is mostly in memory. The io-bound test inserts 320m docs and the database is larger than memory.

      Insert rates for CPU-bound test with 8 clients:

      • average value is 54682 & 24198 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to ~6k/s & ~3k/s for rc11 & rc12 by load end

      Insert rates for IO-bound test with 8 clients:

      • average value is 7973 & 6216 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to 1063/s & 781/s for rc11 & rc12 by load end

      More details are here

        1. 4_2_8_eviction_10_2.5.diff
          5 kB
          Ravi Giri
        2. 4.2.8.png
          1.04 MB
          Ravi Giri
        3. comparisons.png
          229 kB
          Sulabh Mahajan
        4. ftdc.rc11.320m.c6b40.tar
          36.03 MB
          Mark Callaghan
        5. ftdc.rc11.80m.c5b40.tar
          6.64 MB
          Mark Callaghan
        6. ftdc.rc12.320m.c6b40.tar
          45.25 MB
          Mark Callaghan
        7. ftdc.rc12.80m.c5b40.tar
          8.88 MB
          Mark Callaghan
        8. rc11.png
          134 kB
          Sulabh Mahajan
        9. RC13_Commented.png
          178 kB
          Ravi Giri
        10. rc13_vs_4.2.8.png
          62 kB
          Ravi Giri
        11. RC13.png
          206 kB
          Ravi Giri
        12. Screen Shot 2020-07-24 at 11.42.43 pm.png
          342 kB
          Ravi Giri
        13. Screen Shot 2020-07-28 at 7.32.59 pm.png
          160 kB
          Ravi Giri
        14. Screen Shot 2020-07-30 at 11.25.19 am.png
          119 kB
          Ravi Giri
        15. setup_iibench.sh
          3 kB
          Alexander Gorrod
        16. updates_compare_perf.png
          99 kB
          Sulabh Mahajan
        17. updates-in-mem-compare.png
          161 kB
          Sulabh Mahajan
        18. wt6509.png
          38 kB
          Alexander Gorrod

            Assignee:
            ravi.giri@mongodb.com Ravi Giri
            Reporter:
            mark.callaghan@mongodb.com Mark Callaghan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

              Created:
              Updated:
              Resolved: