Add partitioning strategy based on ObjectID format details

XMLWordPrintableJSON

    • Type: Task
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.2.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • Atlas Streams
    • Fully Compatible
    • None
    • 3
    • TBD
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • 0

      Add a partitioning strategy based on ObjectID format as described in the TD

      This strategy will use the timestamp of the ObjectID to get the time range of the collection's minId and maxId. It will then create partitions that are equal time-sized.

      So say that we want to create two partitions and the collection min and max timestamps (from the min and max IDs) are tsMin and tsMax.

      Then first create a dummy ObjectID where the time component is tsMin + (tsMax-tsMin)/2 .

      Then find max id in the collection that is less than the above dummy ID. Use this to create the two partitions. This ensures that we use existing docs as the partition boundaries and so will work well with the other strategies we have (bucketAuto/random)

              Assignee:
              Nathan Frank
              Reporter:
              Mayuresh Kulkarni
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: