Currently, the check is done on each input, which isn't really necessary as all our memory usage is a "best effort" estimation and the limits are usually in terms of MB while the changes in usage are likely to be in bytes.

If asking for memory usage shows up in profiles, consider:

1. doing it less frequently
2. reporting the memory stats from the "incorporate" calls (and do whatever optimizations possible on the side of the algorithm implementation)