[SERVER-74642] Log additional information about the oplog entry that generated a document or index key when printing metadata Created: 06/Mar/23  Updated: 29/Oct/23  Resolved: 08/Mar/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.0.0-rc0, 5.0.16, 6.0.6, 6.3.0-rc2

Type: Improvement Priority: Major - P3
Reporter: Dan Larkin-York Assignee: Benety Goh
Resolution: Fixed Votes: 0
Labels: validation-logging
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Depends
depends on SERVER-61203 Add record metadata and history in va... Closed
depends on SERVER-66012 Use a WiredTiger version cursor to pr... Closed
Problem/Incident
causes SERVER-80789 Make AutoGetOplog behave consistently... Closed
Related
related to SERVER-80556 Log additional information about the ... Backlog
related to SERVER-74699 additional test coverage for printing... Backlog
related to SERVER-80809 Make _logOplogEntriesForInvalidResult... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v6.3, v6.0, v5.0
Sprint: Execution Team 2023-03-20
Participants:

 Description   

When we print metadata for a record or index entry, we have the have the timestamp that last touched that value (stored in the startDurableTs variable). We would like to surface some additional information about the write, namely some data about the oplog entry associated with that timestamp, if the entry is still available.

If redaction works correctly with oplog entries, then we can likely just log the full entry; however, redaction generally expects a user document, not an oplog entry, so it may not work as expected. If that's the case, we should instead determine which information is safe to log, such as the entry type, and possibly the "shape" of the operation.



 Comments   
Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 validate fetches and logs oplog entries for corrupted records

(cherry picked from commit bb2e76b99df5c766260d4e47f54f5445a63853cf)
Branch: v6.3
https://github.com/mongodb/mongo/commit/0c6cc277345584054b3b50a507f629ba4b937e9d

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 KeyStringIndexConsistency::addDocKey() accepts ValidateResults

(cherry picked from commit 6174b2264ea9f184347b757045416181ebfe7d09)
Branch: v6.3
https://github.com/mongodb/mongo/commit/38bf4fb1db89f7753c29cdddc817b4fba2d11e53

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 WiredTigerRecordStore::printRecordMetadata() saves timestamps

(cherry picked from commit 0c581b504fe1fde434ad4f0c5793751d86a373f8)
Branch: v6.3
https://github.com/mongodb/mongo/commit/877bb0f2a62f2641925504997b019c3c80a63d6c

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 RecordStore::printRecordMetadata() accepts recordTimestamps

(cherry picked from commit afc92009ae97b27497e140f98592efb202fa14a5)
Branch: v6.3
https://github.com/mongodb/mongo/commit/00988012c4caae7e28daa59710084b5531eb1c35

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 validate fetches and logs oplog entries for corrupted records

(cherry picked from commit bb2e76b99df5c766260d4e47f54f5445a63853cf)
Branch: v6.0
https://github.com/mongodb/mongo/commit/26ee1be7c9f1d5464f619adc4352cf456c2e0a9c

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 KeyStringIndexConsistency::addDocKey() accepts ValidateResults
Branch: v6.0
https://github.com/mongodb/mongo/commit/80e5796544bad13902eade2fea531241a13c5256

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 WiredTigerRecordStore::printRecordMetadata() saves timestamps

(cherry picked from commit 0c581b504fe1fde434ad4f0c5793751d86a373f8)
Branch: v6.0
https://github.com/mongodb/mongo/commit/d268ee11ed5c58318ef2127ad86c44eb618a1beb

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 RecordStore::printRecordMetadata() accepts recordTimestamps

(cherry picked from commit afc92009ae97b27497e140f98592efb202fa14a5)
Branch: v6.0
https://github.com/mongodb/mongo/commit/e5f12d871e8713e0d326f2524d0617f630900a9a

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 validate fetches and logs oplog entries for corrupted records

(cherry picked from commit bb2e76b99df5c766260d4e47f54f5445a63853cf)
Branch: v5.0
https://github.com/mongodb/mongo/commit/bc451106f4be1c9f0f2265debb5a08354359d243

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 IndexConsistency::addDocKey() accepts ValidateResults

(cherry picked from commit 6174b2264ea9f184347b757045416181ebfe7d09)
Branch: v5.0
https://github.com/mongodb/mongo/commit/21ee95cae8df7a845e6047228e52aa496449a90e

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 WiredTigerRecordStore::printRecordMetadata() saves timestamps

(cherry picked from commit 0c581b504fe1fde434ad4f0c5793751d86a373f8)
Branch: v5.0
https://github.com/mongodb/mongo/commit/04f41a3497f02501de58e6acacd2684c466cca04

Comment by Githook User [ 16/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 RecordStore::printRecordMetadata() accepts recordTimestamps

(cherry picked from commit afc92009ae97b27497e140f98592efb202fa14a5)
Branch: v5.0
https://github.com/mongodb/mongo/commit/915cc2b1973aaf81542b53f5991c94f778e9a15c

Comment by Githook User [ 08/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 validate fetches and logs oplog entries for corrupted records
Branch: master
https://github.com/mongodb/mongo/commit/bb2e76b99df5c766260d4e47f54f5445a63853cf

Comment by Benety Goh [ 08/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 KeyStringIndexConsistency::addDocKey() accepts ValidateResults
Branch: master
https://github.com/mongodb/mongo/commit/6174b2264ea9f184347b757045416181ebfe7d09

(commit message referenced SERVER-72642 incorrectly)

Comment by Githook User [ 08/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 WiredTigerRecordStore::printRecordMetadata() saves timestamps
Branch: master
https://github.com/mongodb/mongo/commit/0c581b504fe1fde434ad4f0c5793751d86a373f8

Comment by Githook User [ 08/Mar/23 ]

Author:

{'name': 'Benety Goh', 'email': 'benety@mongodb.com', 'username': 'benety'}

Message: SERVER-74642 RecordStore::printRecordMetadata() accepts recordTimestamps
Branch: master
https://github.com/mongodb/mongo/commit/afc92009ae97b27497e140f98592efb202fa14a5

Generated at Thu Feb 08 06:28:03 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.