Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6509

Tune eviction walk to find better candidates and hence improve insert benchmark

    • Type: Icon: Bug Bug
    • Resolution: Works as Designed
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: 4.4.0-rc12
    • Component/s: None
    • None
    • 8
    • Storage - Ra 2020-07-13, Storage - Ra 2020-07-27, Storage - Ra 2020-08-10

      This reproduces with the insert benchmark and 8 clients on a c3.xlarge host. The cpu-bound test inserts 80m docs and the database is mostly in memory. The io-bound test inserts 320m docs and the database is larger than memory.

      Insert rates for CPU-bound test with 8 clients:

      • average value is 54682 & 24198 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to ~6k/s & ~3k/s for rc11 & rc12 by load end

      Insert rates for IO-bound test with 8 clients:

      • average value is 7973 & 6216 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to 1063/s & 781/s for rc11 & rc12 by load end

      More details are here

        1. wt6509.png
          wt6509.png
          38 kB
        2. updates-in-mem-compare.png
          updates-in-mem-compare.png
          161 kB
        3. updates_compare_perf.png
          updates_compare_perf.png
          99 kB
        4. setup_iibench.sh
          3 kB
        5. Screen Shot 2020-07-30 at 11.25.19 am.png
          Screen Shot 2020-07-30 at 11.25.19 am.png
          119 kB
        6. Screen Shot 2020-07-28 at 7.32.59 pm.png
          Screen Shot 2020-07-28 at 7.32.59 pm.png
          160 kB
        7. Screen Shot 2020-07-24 at 11.42.43 pm.png
          Screen Shot 2020-07-24 at 11.42.43 pm.png
          342 kB
        8. RC13.png
          RC13.png
          206 kB
        9. rc13_vs_4.2.8.png
          rc13_vs_4.2.8.png
          62 kB
        10. RC13_Commented.png
          RC13_Commented.png
          178 kB
        11. RC13_20_minute.zip
          1.03 MB
        12. rc11.png
          rc11.png
          134 kB
        13. ftdc.rc12.80m.c5b40.tar
          8.88 MB
        14. ftdc.rc12.320m.c6b40.tar
          45.25 MB
        15. ftdc.rc11.80m.c5b40.tar
          6.64 MB
        16. ftdc.rc11.320m.c6b40.tar
          36.03 MB
        17. comparisons.png
          comparisons.png
          229 kB
        18. 4.2.8.png
          4.2.8.png
          1.04 MB
        19. 4.2.8_20_minute.zip
          752 kB
        20. 4_2_8_eviction_10_2.5.zip
          452 kB
        21. 4_2_8_eviction_10_2.5.diff
          5 kB

            Assignee:
            ravi.giri@mongodb.com Ravi Giri
            Reporter:
            mark.callaghan@mongodb.com Mark Callaghan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

              Created:
              Updated:
              Resolved: