Reduce memory consumption of 2nd-phase validate

XMLWordPrintableJSON

    • Type: Improvement
    • Resolution: Fixed
    • Priority: Major - P3
    • 8.1.0-rc0
    • Affects Version/s: None
    • Component/s: None
    • None
    • Storage Engines - Server Integration
    • Fully Compatible
    • GregsList - 2024-09-03, PopcornChicken - 2024-09-17, MorningKaraoke 2024-10-01, BananaDuck - 2024-10-15, CookieFloss - 29/10/24, Party@Gregs - 2024-11-12, TeamTummy - 2024-11-26
    • None
    • 3
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      Proposal:

       - Where we eagerly calculate the key:value for missing/extra, delay calculation until we know we're going to report that.

       - Only store the minimal amount of information for doing the above.

       

      This is kindof a time-space tradeoff, because we're swapping one sequential table read for a bunch of lookups, but thats probably a good tradeoff given that we know we run out of memory, and the number of things we report is very small (compared to the total size of the collection)

              Assignee:
              Nic Hollingum
              Reporter:
              Nic Hollingum
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: