Consider changing analyze shard key monotonic check function

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Cluster Scalability
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      We currently use a Pearson correlation coefficient to check if an index is monotonic. This works well if the index is linearly increasing or decreasing, but it does not give the best data around monotonicity as the less linear the index is the closer to 0 the correlation coefficient will be.

      Consider updating to use Spearman rank correlation coefficient instead. This will strictly check monotonicity regardless if the function is linear or not.

            Assignee:
            Unassigned
            Reporter:
            Ben Gawel
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: