Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-35282

Reading from unreplicated collections in a transaction has undefined behavior

    • Type: Icon: Bug Bug
    • Resolution: Gone away
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: Replication
    • Labels:
      None
    • ALL
    • v4.0
    • Repl 2018-06-18
    • 0

      Consider a replica set primary with top of oplog = logical clock = commit point = T. A writer that creates an unreplicated collection (in a KVStorageEngine such as WT) takes the following steps:

      1. Acquire locks
      2. Create collection in the _mdb_catalog
      3. Commits the transaction
      4. Runs onCommit handlers, setting the min visible on the collection to T.
      5. Releases locks

      A reader starting a new transaction and acquiring a collection takes the following steps:

      1. Open a transaction with read timestamp of T.
      2. Acquire locks (I believe these are quickly interrupted if there's lock contention).
      3. Note the minVisible on the collection = T which is satisfied via the transaction read timestamp of T.

      If the reader opens the transaction (R1) before the writer commits (W3) and acquires locks (R2) after the writer releases (W4), the reader will observe the in-memory catalog believing the collection exists, but the storage engine will not (due to the concurrent transactions). In debug builds, this typically manifests as a crash when trying to access any index.

      It's unclear how this can manifest with arbitrary queries/sorts/aggregations being performed with the query code consuming this state where the in-memory catalog is inconsistent with the storage engine's recovery unit snapshot.

            Assignee:
            spencer@mongodb.com Spencer Brody (Inactive)
            Reporter:
            daniel.gottlieb@mongodb.com Daniel Gottlieb (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: