Support storedSource in vector search indexes and returnStoredSource in $vectorSearch queries

XMLWordPrintableJSON

    • Type: Epic
    • Resolution: Unresolved
    • Priority: Major - P3
    • None
    • Component/s: AI/ML
    • None
    • Vector Search Stored Source Support
    • Database Experience
    • None
    • Hide

      Summary of necessary driver changes

      •  

      Commits for syncing spec/prose tests
      (and/or refer to an existing language POC if needed)

      •  

      Context for other referenced/linked tickets

      •  
      Show
      Summary of necessary driver changes   Commits for syncing spec/prose tests (and/or refer to an existing language POC if needed)   Context for other referenced/linked tickets  
    • To Do
    • 0
    • 0
    • 0
    • 100
    • None
    • None
    • None
    • Needed
    • $i18n.getText("admin.common.words.hide")
      Key Status/Resolution FixVersion
      CDRIVER-6130 Execution Blocked
      CXX-3375 Execution Blocked
      CSHARP-5764 Execution Blocked
      GODRIVER-3681 Execution Blocked
      JAVA-5989 Execution Blocked
      NODE-7246 Execution Blocked
      PYTHON-5620 Execution Blocked
      PHPLIB-1735 Backlog
      RUBY-3719 Execution Blocked
      RUST-2297 Execution Blocked
      $i18n.getText("admin.common.words.show")
      #scriptField, #scriptField *{ border: 1px solid black; } #scriptField{ border-collapse: collapse; } #scriptField td { text-align: center; /* Center-align text in table cells */ } #scriptField td.key { text-align: left; /* Left-align text in the Key column */ } #scriptField a { text-decoration: none; /* Remove underlines from links */ border: none; /* Remove border from links */ } /* Add green background color to cells with FixVersion */ #scriptField td.hasFixVersion { background-color: #00FF00; /* Green color code */ } #scriptField td.willNotDo { background-color: #FF0000; /* Red color code */ } /* Center-align the first row headers */ #scriptField th { text-align: center; } Key Status/Resolution FixVersion CDRIVER-6130 Execution Blocked CXX-3375 Execution Blocked CSHARP-5764 Execution Blocked GODRIVER-3681 Execution Blocked JAVA-5989 Execution Blocked NODE-7246 Execution Blocked PYTHON-5620 Execution Blocked PHPLIB-1735 Backlog RUBY-3719 Execution Blocked RUST-2297 Execution Blocked
    • None
    • None
    • None
    • None
    • None
    • None

      Summary

      What is the problem or use case, what are we trying to achieve?

      We are releasing storedSource for vector search (detail) on 11/17 and need to add driver support for both index time and query time changes.

      Motivation

      Allow users to dramatically accelerate queries by avoiding ID lookup on the mongod side. More detail on motivation can be found here

      Who is the affected end user?

      Who are the stakeholders?

      Latency-sensitive $vectorSearch users using all drivers

      How does this affect the end user?

      Are they blocked? Are they annoyed? Are they confused?

      They are annoyed because of slower than necessary response times

      How likely is it that this problem or use case will occur?

      Main path? Edge case?

      No known edge cases

      If the problem does occur, what are the consequences and how severe are they?

      Minor annoyance at a log message? Performance concern? Outage/unavailability? Failover can't complete?

      Is this issue urgent?

      Does this ticket have a required timeline? What is it?

      Yes, mongot is shipping with this feature anticipated 11/17 (always liable to change)

      Is this ticket required by a downstream team?

      Needed by e.g. Atlas, Shell, Compass?

      Yes

      Is this ticket only for tests?

      Is this ticket have any functional impact, or is it just test improvements?

      No

      Cast of Characters

      Engineering Lead: shawn.yarbrough@mongodb.com
      Document Author:
      POCers:
      Product Owner: henry.weller@mongodb.com
      Program Manager:
      Stakeholders:

      Channels & Docs

      Slack Channel: #vector-stored-source

      Scope Document

      [Technical Design Document|some.url]

      [Parent Epic|CLOUDP-299389]

            Assignee:
            Unassigned
            Reporter:
            Henry Weller
            None
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              None
              None
              None
              None
              None
              None