Uploaded image for project: 'Spark Connector'
  1. Spark Connector
  2. SPARK-408

[mongo-spark] Revise `startAtOperation` timestamp documentation

    • Type: Icon: Task Task
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
      None

      Hi Team,

      Customer was referencing this github doc to configure changestream to start from the beginning.

      Using `startAtOperation` option, this doc mentions the use of timestamp (`0`) allows you to to start at the beginning of the oplog which isn't guarantee to work once the oplog rolls over for the first time. Once the oplog rolls over, it cannot report those events that have fallen off, so it will error. If you specify a timestamp that is still inside the oplog, then it can return all the events according to your request without missing anything

      Further discussion in this slack thread

      Support Case - 01181040

      Requested Action.

      • Looking to update this doc to mention this caveat or to remove it.
         

       

            Assignee:
            prakul.agarwal@mongodb.com Prakul Agarwal
            Reporter:
            raymond.chan@mongodb.com Raymond Chan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated: