Bulk insert flush — performance benchmarking: throughput and flush overhead

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Btree
    • None
    • Storage Engines, Storage Engines - Transactions
    • 0.001
    • None
    • None

      Performance benchmark phase T8b (~5 days). Throughput and flush overhead benchmarking.

      Test coverage:

      • Benchmark bulk insert flush throughput at 1M, 10M, 100M rows
      • Compare against: regular cursor insert, existing WiredTiger bulk loader, bulk insert with flush disabled
      • Measure flush overhead: extra latency per flush, write amplification (bytes flushed / bytes inserted)
      • Measure checkpoint impact: does periodic flush reduce checkpoint duration vs one giant flush at end?
      • Report: rows/sec, MB/sec, flush count, flush latency p50/p99, peak RSS

      Depends on: WT-17215 (T4)
      Can run in parallel with: T8a (WT-17221)

            Assignee:
            Shoufu Du
            Reporter:
            Shoufu Du
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: