Uploaded image for project: 'Realm Core'
  1. Realm Core
  2. RCORE-2158

Implement trimming of interned strings

    • Type: Icon: Task Task
    • Resolution: Won't Fix
    • Priority: Icon: Major - P3 Major - P3
    • None
    • Affects Version/s: None
    • Component/s: None
    • None

      See design document.

       

      The success of interning and compressing needs to be monitored.

       

      Trimming has to be done incrementally - no "stop the world" garbage collection.

       

      Suggestion: When trimming is needed set up a second string-interner. Use the sign of StringIDs to distinguish between interners, allowing two interners to coexist.

      Incrementally re-intern all properties of a column, then discard the old string interner.

       

      Since trimming will take place after ingesting data, we can likely optimize compression by training the compressor on available data before interning.

            Assignee:
            nicola.cabiddu@mongodb.com Nicola Cabiddu
            Reporter:
            finn.schiermer-andersen@mongodb.com Finn Andersen (Inactive)
            AD Sync Client
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: