[SERVER-52739] Numerical stability issue in StdDev functions Created: 10/Nov/20  Updated: 29/Oct/23  Resolved: 17/Nov/20

Status: Closed
Project: Core Server
Component/s: Querying
Affects Version/s: None
Fix Version/s: 4.9.0

Type: Bug Priority: Major - P3
Reporter: Svilen Mihaylov (Inactive) Assignee: Svilen Mihaylov (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Operating System: ALL
Sprint: Query 2020-11-30
Participants:

 Description   

When computing a standard deviation of a large number of repeating values, there is a precision loss. The result is not  as it is mathematically correct, but a small number (e.g. order of 10^-10).

 



 Comments   
Comment by Githook User [ 17/Nov/20 ]

Author:

{'name': 'Svilen Mihaylov', 'email': 'svilen.mihaylov@mongodb.com', 'username': 'smihaylov-mongodb'}

Message: SERVER-52739: Numerical stability issue in StdDev functions
Branch: master
https://github.com/mongodb/mongo/commit/e6da74aad445a0fd941778c53f9f04ee3c095fac

Comment by Svilen Mihaylov (Inactive) [ 10/Nov/20 ]

https://mongodbcr.appspot.com/681560001/

Generated at Thu Feb 08 05:28:52 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.