MongoDB Vector Search now supports vector search against nested embeddings and arrays of embeddings.

XMLWordPrintableJSON

    • Type: Epic
    • Resolution: Unresolved
    • Priority: Critical - P2
    • None
    • Component/s: AI/ML
    • None
    • Vector Search over Nested Embeddings and Arrays of Embeddings
    • Database Experience
    • None
    • Hide

      Summary of necessary driver changes

      •  

      Commits for syncing spec/prose tests
      (and/or refer to an existing language POC if needed)

      •  

      Context for other referenced/linked tickets

      •  
      Show
      Summary of necessary driver changes   Commits for syncing spec/prose tests (and/or refer to an existing language POC if needed)   Context for other referenced/linked tickets  
    • To Do
    • 0
    • 0
    • 0
    • 100
    • None
    • None
    • None
    • Builder Changes Needed
    • $i18n.getText("admin.common.words.hide")
      Key Status/Resolution FixVersion
      CSHARP-5762 Execution Blocked
      JAVA-5987 Execution Blocked
      PHPLIB-1733 Backlog
      $i18n.getText("admin.common.words.show")
      #scriptField, #scriptField *{ border: 1px solid black; } #scriptField{ border-collapse: collapse; } #scriptField td { text-align: center; /* Center-align text in table cells */ } #scriptField td.key { text-align: left; /* Left-align text in the Key column */ } #scriptField a { text-decoration: none; /* Remove underlines from links */ border: none; /* Remove border from links */ } /* Add green background color to cells with FixVersion */ #scriptField td.hasFixVersion { background-color: #00FF00; /* Green color code */ } #scriptField td.willNotDo { background-color: #FF0000; /* Red color code */ } /* Center-align the first row headers */ #scriptField th { text-align: center; } Key Status/Resolution FixVersion CSHARP-5762 Execution Blocked JAVA-5987 Execution Blocked PHPLIB-1733 Backlog
    • None
    • None
    • None
    • None
    • None
    • None

      Summary

      What is the problem or use case, what are we trying to achieve?

      We are releasing support for performing $vectorSearch queries against nested embeddings and arrays of embeddings (detail) on 1/19 and need to add driver support for both index time and query time changes.

      Motivation

      Customers will be able to more flexibly model their data for various vector search use cases, and easily hydrate their existing collections with vectors without significantly changing their data model and query pattern.

      Who is the affected end user?

      Who are the stakeholders?

      $vectorSearch (and eventually $search.vectorSearch customers) looking to query nested data models.

      How does this affect the end user?

      Are they blocked? Are they annoyed? Are they confused?

      They have to unwind nested documents to root level, which is annoying and requires parent metadata duplication.

      How likely is it that this problem or use case will occur?

      Main path? Edge case?

      No known edge cases

      If the problem does occur, what are the consequences and how severe are they?

      Minor annoyance at a log message? Performance concern? Outage/unavailability? Failover can't complete?

      Is this issue urgent?

      Does this ticket have a required timeline? What is it?

      Yes, mongot is shipping with this feature anticipated 12/15 (always liable to change) for phase 1 support defined here

      Is this ticket required by a downstream team?

      Needed by e.g. Atlas, Shell, Compass?

      Yes

      Is this ticket only for tests?

      Is this ticket have any functional impact, or is it just test improvements?

      No

      Cast of Characters

      Engineering Lead: chunbin.lin@mongodb.com
      Document Author:
      POCers:
      Product Owner: henry.weller@mongodb.com
      Program Manager:
      Stakeholders:

      Channels & Docs

      Slack Channel: #vector-search-nested-embeddings (ask henry to be added)

      Scope Document

      Technical Design Document

      [Parent Epic|CLOUDP-260588]

            Assignee:
            Unassigned
            Reporter:
            Henry Weller
            None
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              None
              None
              None
              None
              None
              None