Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-30356

Improve error reporting for validation

    XMLWordPrintable

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major - P3
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.6.13, 4.0.10, 4.1.11
    • Component/s: Storage
    • Labels:
    • Backwards Compatibility:
      Fully Compatible
    • Backport Requested:
      v4.0, v3.6
    • Sprint:
      Storage 2017-08-21, Storage NYC 2019-04-22, Storage NYC 2019-05-06

      Description

      After the first phase of validation detects potential errors, we will log a message informing users that the second phase of the validation is going to be run.

      The second phase of validation will consist of tracking all the KeyStrings that were hashed to erroneous buckets during the first phase. We will keep track of the document keys KeyString of the erroneous buckets and only remove them once a corresponding KeyString from an index entry is seen.

      This allows us to see which document keys are missing index entries and which index entries are missing document keys once the second phase is finished going through the data.
      We'll limit reporting the number of errors to be the maximum size of a document. The KeyStrings will have to be transformed back into BSON format with appropriate messages entailing what went wrong with them.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              gregory.wlodarek Gregory Wlodarek
              Reporter:
              gregory.wlodarek Gregory Wlodarek
              Participants:
              Votes:
              3 Vote for this issue
              Watchers:
              11 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved: