[SERVER-81894] Streams: Limit in-memory source operator message buffer by bytes and document size Created: 05/Oct/23 Updated: 29/Oct/23 Resolved: 11/Oct/23 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Aadesh Patel (Inactive) | Assignee: | Aadesh Patel (Inactive) |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | neweng | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Assigned Teams: |
Atlas Streams
|
| Backwards Compatibility: | Fully Compatible |
| Sprint: | Sprint 33 |
| Participants: |
| Description |
|
The in-memory source operator can have messages injected into it via `testOnlyInsert`, but we don't enforce any limits on how many messages can be buffered. We want to limit the buffered messages by byte size and number of documents, such that once we hit those limits, all subsequent inserts should be blocking until the buffered messages are processed by the executor loop. |