-
Type:
Improvement
-
Resolution: Unresolved
-
Priority:
Critical - P2
-
None
-
Affects Version/s: None
-
Component/s: None
-
None
-
Query Optimization
-
None
-
None
-
None
-
None
-
None
-
None
-
None
Currently two knobs: samplingConfidenceInterval and samplingMarginOfError are used to control the CE sample size. This is confusing to everyone involved: engineers, testers, support team, and customers.
It also gives a false sense of confidence in the results of sampling CE. For example, the default values: "confidence interval = 95%" and "MoE = 5%" are based on certain statistical assumptions that are not always met in practice.