Currently, LRUKeyValue (used by each partition in the telemetry store to cache entries) memory budget tracker only considers the memory used by the value in the <key, value> pair saved to LRUKeyValue KVList. The memory budget tracker needs to be updates to track all the memory used by LRUKeyValue: the key, the value, the map that associates keys to their position in KVList. This ticket will account for the memory used by the key and the value. A subsequent ticket address tracking the memory used by KVMap.

Without this change, entries are only evicted when the amount of memory allocated to a partition is too small to accommodate even a single entry or when 20k queries are run with small cache size and default partition number (1024)**. Thus, in order to record number of entries evict, we need to evict some. And in order to evict, we need to record the amount of memory being used accurately.

• • for the purposes of this ticket, a unit test will be written to change the number of partitions in order to create a small cache with few partitions that has a small bar for evicting entries.