[SERVER-66469] Filtering timeseries with date-field does not include results from before 1970 - MongoDB Jira

XML

Word

Printable

JSON

Backwards Compatibility:
Fully Compatible
Operating System:
ALL
Backport Requested:

v6.0, v5.0
Steps To Reproduce:
Hide

Create a time-series collection

Insert records before and after epoch

Query for documents with filter: { $timeField: { $lt: "arbitrary date > 1970" }
}

Results will only include documents after epoch

If you query with { $timeField:
{ $lt: "arbitrary date < 1970" }
}, the documents missing from the previous set will suddenly show up.
Show
Create a time-series collection Insert records before and after epoch Query for documents with filter: { $timeField: { $lt: "arbitrary date > 1970" } } Results will only include documents after epoch If you query with { $timeField: { $lt: "arbitrary date < 1970" } }, the documents missing from the previous set will suddenly show up.
Sprint:
QO 2022-09-19, QO 2022-10-03

db['test-array-ts'].countDocuments({

  date: { $lt: ISODate('1970-01-01T18:31:22.000+00:00') }

})

result: 149

db['test-array-ts'].countDocuments({

  date: { $lt: ISODate('1965-01-01T18:31:22.000+00:00') }

})

result: 1989943

depends on

SERVER-66794 Add an in-memory flag for TS collections having dates outside years 1970-2038

is depended on by

SERVER-73641 Timeseries filtering can miss extended-range events when sharded

is documented by

DOCS-15650 [Server] Investigate changes in SERVER-66469: Filtering timeseries with date-field does not include results from before 1970

is related to

SERVER-69952 Filtering on dates outside of the 32 bit epoch range returns wrong results

related to

SERVER-66727 Time-series bucket can be created that violates max time-span

SERVER-67825 Investigate where time-series functionality relies on control summary timestamps

(1 related to)