Uploaded image for project: 'Core Server'
  1. Core Server
  2. SERVER-83615

Treat maxValidateMemoryUsageMB as an absolute limit

    • Type: Icon: Bug Bug
    • Resolution: Unresolved
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • Labels:
    • Storage Execution
    • Execution Team 2024-05-13

      Right now, we allow double maxValidateMemoryUsageMB during the second phase of validation. It appears like we use double the memory limit but we actually double count the number of index keys in the first phase. We can update the comment to make this more clear. If a user sets maxValidateMemoryUsage to their max available memory like in atlas, validation can OOM because our limit calculation undercounts actual memory usage/ignores other metadata for each key. We should respect maxValidateMemoryUsageMB as the memory limit and consider doubling the server default.

      We want to consider accounting for other metadata that is stored along with each key during validation when calculating the estimated memory usage.

            Assignee:
            erin.liang@mongodb.com Erin Liang
            Reporter:
            shinyee.tan@mongodb.com Shin Yee Tan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated: