Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-32198

Missing collection metadata on the shard implies both UNSHARDED and "metadata not loaded yet"

    XMLWordPrintableJSON

Details

    • Sharding
    • Fully Compatible
    • ALL
    • Sharding 2018-01-01, Sharding 2017-12-18, Sharding 2018-02-12, Sharding 2018-02-26, Sharding 2018-06-18, Sharding 2018-07-02, Sharding 2018-07-16, Sharding 2018-07-30, Sharding 2018-08-13, Sharding 2018-08-27, Sharding 2018-09-10

    Description

      This ticket was created as an overflow of SERVER-31056. Please refer to the comments there for more context.

      If after a migration commit on the config server, a donor shard fails to refresh its metadata, we clear the MetadataManager's metadata. We do this so that the next time the metadata is needed, a refresh will be triggered.

      However, if a request comes in with an UNSHARDED shardVersion, it will see empty metadata and the request will be allowed to go through without triggering a refresh.

      The linked SERVER-24960 contains test cases to validate the fix.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. SERVER-38794 CollectionOptions can be lost in createCollection if a write conflict exception is thrown

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-38953 Missing early return in merge_chunks_command.cpp

          • Major - P3 - Major loss of function.
          • Closed
          depends on

          Bug - A problem which impairs or prevents the functions of the product. SERVER-32367 AutoGetCollectionOrView and its related classes perform shard version checking on a view

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-35773 MetadataManager directly calls into the CatalogCache

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-46679 Transaction test fails with Stale Shard Version error on 4.5

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-47233 WriteOp can be left in pending state, leading to erroneous NoProgressMade write error from mongos

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-31056 Remove all usages of the default constructor of ScopedCollectionMetadata outside of MetadataManager

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-35497 Remove usages of OldClient(Write)Context from the MigrationDestinationManager

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-35516 Get rid of OldClientWriteContext

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-35691 Make all code paths returning StaleConfig error go through the StaleConfigInfo serializer

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-45599 Backport the changes to CollectionShardingState done as part of SERVER-32198 to 4.0

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-45778 Rename getOrphanFilter to getOwnershipFilter and change the return type

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-45779 Throw Stale Shard Version when collection is unknown on getOwnershipFilter

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-45780 Rename getCurrentMetadata to getCollectionDescription and change the return type

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-45781 Throw Stale Shard Version when collection is unknown on getCollectionDescription

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-45904 Create a standalone collection sharding state factory

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-46272 Make callers of keyBelongsToMe() to not go through collection metadata

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-46703 Make a variant of checkShardVersionOrThrow which doesn't treat UNKNOWN shard version as UNSHARDED

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47104 Make upsert stage use OwnershipFilter instead of CollectionDescription

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47412 Make the database cloner ensure collections are actually unsharded before cloning

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47413 Some transaction tests are not being retried on Transient Error

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47419 Find a better way of setting the shardId when throwing on getCollectionDescription

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47474 CheckShardingIndex: Convert usages of checkShardVersionOrThrow_DEPRECATED to checkShardVersionOrThrow

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47521 Remove getCollectionDescription_DEPRECATED function

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47555 Remove checkShardVersionOrThrow_DEPRECATED function

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47701 Ensure the steps for upgrading Replica Set to a Sharded Cluster do not incur any application downtime

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47982 Change the shard version update procedure of the migration source manager

          • Major - P3 - Major loss of function.
          • Closed

          Task - A task that needs to be done. SERVER-47987 Remove forceShardFilteringMetadataRefresh function

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-36054 Get rid of ScopedCollectionMetadata's operator bool

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-36164 Decouple ScopedCollectionMetadata from MetadataManager

          • Major - P3 - Major loss of function.
          • Closed
          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. SERVER-32459 mongos incorrectly assumed collection was unsharded

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-35932 Mongos saved docs in wrong shard

          • Critical - P2 - Crashes, loss of data, severe memory leak.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-24960 Shard may not realize that collection is already sharded after restart

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-32075 Load sharding metadata from disk on mongod startup

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-42658 secondary don't refresh its routing table when transition to primary.

          • Major - P3 - Major loss of function.
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. SERVER-44052 Inconsistencies in sharded collections

          • Major - P3 - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SERVER-32075 Load sharding metadata from disk on mongod startup

          • Major - P3 - Major loss of function.
          • Closed
          related to

          Task - A task that needs to be done. SERVER-52991 Complete TODO listed in SERVER-32198

          • Major - P3 - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. SERVER-49228 Remove kickback to mongos requirement for cluster view read when view is backed by unsharded collection

          • Major - P3 - Major loss of function.
          • Closed
          mentioned in

          Page Loading...

          Activity

            People

              backlog-server-sharding Backlog - Sharding Team
              kaloian.manassiev@mongodb.com Kaloian Manassiev
              Votes:
              4 Vote for this issue
              Watchers:
              30 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: