[SERVER-79864] TTL deleter does not correctly handle time series collections with extended range dates Created: 08/Aug/23  Updated: 28/Nov/23  Resolved: 15/Nov/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: 7.0.0, 5.0.19, 6.0.8
Fix Version/s: 7.3.0-rc0, 7.2.0-rc2, 7.0.5, 6.0.13, 5.0.24

Type: Bug Priority: Major - P3
Reporter: Dan Larkin-York Assignee: Gregory Noma
Resolution: Fixed Votes: 0
Labels: former-storex-namer
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
is depended on by SERVER-76560 Time series collections not always ho... Closed
Documented
is documented by DOCS-16500 Investigate changes in SERVER-79864: ... Closed
Assigned Teams:
Storage Execution
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v7.2, v7.0, v6.0, v5.0
Sprint: Execution Team 2023-11-13, Execution Team 2023-11-27
Participants:

 Description   

Our issues with extended-range dates was first surfaced via SERVER-66469, and addressed by a series of follow-up tickets. The end state is correct, but slow query behavior when these dates are present. However, we did not properly address the impact of extended-range dates on TTL behavior, which still uses the bucket _id (OID) for sorting and filtering.

Until we introduce a new bucket _id format that can represent the full date range in properly sorted order, we should disable TTL deletion for time series collections with extended range dates.



 Comments   
Comment by Githook User [ 28/Nov/23 ]

Author:

{'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}

Message: SERVER-79864 Disable TTL on time-series colls requiring extended range

(cherry picked from commit aa87caf6b24095a6e907d76c9b27fc44a63ed7d3)
Branch: v5.0
https://github.com/mongodb/mongo/commit/3abcddde8adf3cb1ce023ada40003342dab48057

Comment by Githook User [ 28/Nov/23 ]

Author:

{'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}

Message: SERVER-79864 Disable TTL on time-series colls requiring extended range

(cherry picked from commit aa87caf6b24095a6e907d76c9b27fc44a63ed7d3)
Branch: v6.0
https://github.com/mongodb/mongo/commit/490fbe7db9811971cb0f7535c7ff29b7de7f3e3e

Comment by Githook User [ 28/Nov/23 ]

Author:

{'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}

Message: SERVER-79864 Disable TTL on time-series colls requiring extended range

(cherry picked from commit aa87caf6b24095a6e907d76c9b27fc44a63ed7d3)
Branch: v7.0
https://github.com/mongodb/mongo/commit/383e04048896b61404acf891dfeebeec0b30ff35

Comment by Githook User [ 27/Nov/23 ]

Author:

{'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}

Message: SERVER-79864 Disable TTL on time-series colls requiring extended range

(cherry picked from commit aa87caf6b24095a6e907d76c9b27fc44a63ed7d3)
Branch: v7.2
https://github.com/mongodb/mongo/commit/fc635e4611993796da99932070fafbc0bf363768

Comment by Githook User [ 14/Nov/23 ]

Author:

{'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}

Message: SERVER-79864 Disable TTL on time-series colls requiring extended range
Branch: master
https://github.com/mongodb/mongo/commit/aa87caf6b24095a6e907d76c9b27fc44a63ed7d3

Generated at Thu Feb 08 06:42:07 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.