Ensure correctness of ChunkWritesTracker metrics

XMLWordPrintableJSON

    • Type: Bug
    • Resolution: Won't Fix
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Sharding EMEA
    • ALL
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      ChunkWritesTracker objects are instantiated on shards to track the number of bytes that are being written on every owned chunk; the metric is then used to trigger the chunk splitter when a sufficient number (threshold probably to review) of bytes have been written to a chunk.

      Currently, the bytesWritten counter:

      Objective of this ticket is correcting the metrics in order to avoid scheduling chunk splitting tasks too much or too early. Currently, the two main problems we can incur under some conditions are:

      • Unnecessary load on the CPU (a lot of noop split tasks).
      • Eagerness to split (in case of the new auto-splitter, continuously try to splitt a chunk so that when it gets exactly at 133% maxChunkSize it is split right away in two chunks of 67% maxChunkSize).

            Assignee:
            [DO NOT USE] Backlog - Sharding EMEA
            Reporter:
            Pierlauro Sciarelli
            Votes:
            2 Vote for this issue
            Watchers:
            12 Start watching this issue

              Created:
              Updated:
              Resolved: