Control CE sample size directly, with one knob

    • Type: Improvement
    • Resolution: Unresolved
    • Priority: Critical - P2
    • None
    • Affects Version/s: None
    • Component/s: None
    • None
    • Query Optimization
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Currently two knobs: samplingConfidenceInterval and samplingMarginOfError are used to control the CE sample size. This is confusing to everyone involved: engineers, testers, support team, and customers.

      It also gives a false sense of confidence in the results of sampling CE. For example, the default values: "confidence interval = 95%" and "MoE = 5%" are based on certain statistical assumptions that are not always met in practice. 

            Assignee:
            Unassigned
            Reporter:
            Steve Tarzia
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: