Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6509

Tune eviction walk to find better candidates and hence improve insert benchmark

    • Type: Icon: Bug Bug
    • Resolution: Works as Designed
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 4.4.0-rc12
    • Component/s: None
    • None
    • 8
    • Storage - Ra 2020-07-13, Storage - Ra 2020-07-27, Storage - Ra 2020-08-10

      This reproduces with the insert benchmark and 8 clients on a c3.xlarge host. The cpu-bound test inserts 80m docs and the database is mostly in memory. The io-bound test inserts 320m docs and the database is larger than memory.

      Insert rates for CPU-bound test with 8 clients:

      • average value is 54682 & 24198 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to ~6k/s & ~3k/s for rc11 & rc12 by load end

      Insert rates for IO-bound test with 8 clients:

      • average value is 7973 & 6216 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to 1063/s & 781/s for rc11 & rc12 by load end

      More details are here

        1. ftdc.rc12.80m.c5b40.tar
          8.88 MB
          Mark Callaghan
        2. ftdc.rc11.80m.c5b40.tar
          6.64 MB
          Mark Callaghan
        3. ftdc.rc12.320m.c6b40.tar
          45.25 MB
          Mark Callaghan
        4. ftdc.rc11.320m.c6b40.tar
          36.03 MB
          Mark Callaghan
        5. wt6509.png
          38 kB
          Alexander Gorrod
        6. setup_iibench.sh
          3 kB
          Alexander Gorrod
        7. updates_compare_perf.png
          99 kB
          Sulabh Mahajan
        8. updates-in-mem-compare.png
          161 kB
          Sulabh Mahajan
        9. rc11.png
          134 kB
          Sulabh Mahajan
        10. comparisons.png
          229 kB
          Sulabh Mahajan
        11. RC13.png
          206 kB
          Ravi Giri
        12. RC13_Commented.png
          178 kB
          Ravi Giri
        13. 4.2.8.png
          1.04 MB
          Ravi Giri
        14. rc13_vs_4.2.8.png
          62 kB
          Ravi Giri
        15. Screen Shot 2020-07-24 at 11.42.43 pm.png
          342 kB
          Ravi Giri
        16. Screen Shot 2020-07-28 at 7.32.59 pm.png
          160 kB
          Ravi Giri
        17. 4_2_8_eviction_10_2.5.diff
          5 kB
          Ravi Giri
        18. Screen Shot 2020-07-30 at 11.25.19 am.png
          119 kB
          Ravi Giri

            Assignee:
            ravi.giri@mongodb.com Ravi Giri
            Reporter:
            mark.callaghan@mongodb.com Mark Callaghan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

              Created:
              Updated:
              Resolved: