Recomputing this each time we plan is expensive (and it shows, especially for point queries). We can compute it once up front.