Tune eviction walk to find better candidates and hence improve insert benchmark

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Works as Designed
    • Priority: Major - P3
    • None
    • Affects Version/s: 4.4.0-rc12
    • Component/s: None
    • None
    • 51,717.762
    • Storage - Ra 2020-07-13, Storage - Ra 2020-07-27, Storage - Ra 2020-08-10
    • 8

      This reproduces with the insert benchmark and 8 clients on a c3.xlarge host. The cpu-bound test inserts 80m docs and the database is mostly in memory. The io-bound test inserts 320m docs and the database is larger than memory.

      Insert rates for CPU-bound test with 8 clients:

      • average value is 54682 & 24198 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to ~6k/s & ~3k/s for rc11 & rc12 by load end

      Insert rates for IO-bound test with 8 clients:

      • average value is 7973 & 6216 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to 1063/s & 781/s for rc11 & rc12 by load end

      More details are here

        1. wt6509.png
          38 kB
          Alexander Gorrod
        2. updates-in-mem-compare.png
          161 kB
          Sulabh Mahajan
        3. updates_compare_perf.png
          99 kB
          Sulabh Mahajan
        4. setup_iibench.sh
          3 kB
          Alexander Gorrod
        5. Screen Shot 2020-07-30 at 11.25.19 am.png
          119 kB
          Ravi Giri
        6. Screen Shot 2020-07-28 at 7.32.59 pm.png
          160 kB
          Ravi Giri
        7. Screen Shot 2020-07-24 at 11.42.43 pm.png
          342 kB
          Ravi Giri
        8. RC13.png
          206 kB
          Ravi Giri
        9. rc13_vs_4.2.8.png
          62 kB
          Ravi Giri
        10. RC13_Commented.png
          178 kB
          Ravi Giri
        11. rc11.png
          134 kB
          Sulabh Mahajan
        12. ftdc.rc12.80m.c5b40.tar
          8.88 MB
          Mark Callaghan
        13. ftdc.rc12.320m.c6b40.tar
          45.25 MB
          Mark Callaghan
        14. ftdc.rc11.80m.c5b40.tar
          6.64 MB
          Mark Callaghan
        15. ftdc.rc11.320m.c6b40.tar
          36.03 MB
          Mark Callaghan
        16. comparisons.png
          229 kB
          Sulabh Mahajan
        17. 4.2.8.png
          1.04 MB
          Ravi Giri
        18. 4_2_8_eviction_10_2.5.diff
          5 kB
          Ravi Giri

            Assignee:
            Ravi Giri
            Reporter:
            Mark Callaghan (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            16 Start watching this issue

              Created:
              Updated:
              Resolved: