Uploaded image for project: 'WiredTiger'
  1. WiredTiger
  2. WT-6509

Tune eviction walk to find better candidates and hence improve insert benchmark

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Works as Designed
    • Affects Version/s: 4.4.0-rc12
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None
    • Story Points:
      8
    • Sprint:
      Storage - Ra 2020-07-13, Storage - Ra 2020-07-27, Storage - Ra 2020-08-10

      Description

      This reproduces with the insert benchmark and 8 clients on a c3.xlarge host. The cpu-bound test inserts 80m docs and the database is mostly in memory. The io-bound test inserts 320m docs and the database is larger than memory.

      Insert rates for CPU-bound test with 8 clients:

      • average value is 54682 & 24198 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to ~6k/s & ~3k/s for rc11 & rc12 by load end

      Insert rates for IO-bound test with 8 clients:

      • average value is 7973 & 6216 for rc11 & rc12
      • per-client rate starts at ~20k/second, drops to 1063/s & 781/s for rc11 & rc12 by load end

      More details are here

        Attachments

        1. 4_2_8_eviction_10_2.5.diff
          5 kB
        2. 4_2_8_eviction_10_2.5.zip
          452 kB
        3. 4.2.8_20_minute.zip
          752 kB
        4. 4.2.8.png
          4.2.8.png
          1.04 MB
        5. comparisons.png
          comparisons.png
          229 kB
        6. ftdc.rc11.320m.c6b40.tar
          36.03 MB
        7. ftdc.rc11.80m.c5b40.tar
          6.64 MB
        8. ftdc.rc12.320m.c6b40.tar
          45.25 MB
        9. ftdc.rc12.80m.c5b40.tar
          8.88 MB
        10. rc11.png
          rc11.png
          134 kB
        11. RC13_20_minute.zip
          1.03 MB
        12. RC13_Commented.png
          RC13_Commented.png
          178 kB
        13. rc13_vs_4.2.8.png
          rc13_vs_4.2.8.png
          62 kB
        14. RC13.png
          RC13.png
          206 kB
        15. Screen Shot 2020-07-24 at 11.42.43 pm.png
          Screen Shot 2020-07-24 at 11.42.43 pm.png
          342 kB
        16. Screen Shot 2020-07-28 at 7.32.59 pm.png
          Screen Shot 2020-07-28 at 7.32.59 pm.png
          160 kB
        17. Screen Shot 2020-07-30 at 11.25.19 am.png
          Screen Shot 2020-07-30 at 11.25.19 am.png
          119 kB
        18. setup_iibench.sh
          3 kB
        19. updates_compare_perf.png
          updates_compare_perf.png
          99 kB
        20. updates-in-mem-compare.png
          updates-in-mem-compare.png
          161 kB
        21. wt6509.png
          wt6509.png
          38 kB

          Activity

            People

            Assignee:
            ravi.giri Ravi Giri
            Reporter:
            mark.callaghan Mark Callaghan
            Votes:
            0 Vote for this issue
            Watchers:
            17 Start watching this issue

              Dates

              Created:
              Updated:
              Resolved: