[SERVER-53657] $group's executionStats should report the spilled data file size Created: 08/Jan/21  Updated: 29/Oct/23  Resolved: 06/Dec/22

Status: Closed
Project: Core Server
Component/s: Aggregation Framework
Affects Version/s: 4.9.0
Fix Version/s: 6.2.0-rc0, 6.3.0-rc0

Type: Bug Priority: Major - P3
Reporter: Rishab Joshi (Inactive) Assignee: Ivan Fefer
Resolution: Fixed Votes: 0
Labels: auto-reverted, query-offsite
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-71832 Report group spill stats in serverStatus Closed
is depended on by COMPASS-6217 Investigate changes in SERVER-53657: ... Closed
Documented
is documented by DOCS-15697 Investigate changes in SERVER-53657: ... Closed
Problem/Incident
Related
is related to SERVER-70493 [SBE] $group's executionStats should ... Closed
Backwards Compatibility: Fully Compatible
Operating System: ALL
Sprint: QE 2022-10-17, QE 2022-10-31, QE 2022-11-14
Participants:
Linked BF Score: 164

 Description   

$group's executionStats should expose a stats "spillFileSizeBytes". This stat should report the maximum files size bytes that was written to disk in bytes. This stat will help in better planning/recommendation on disk usage and maybe I/O capacity planning.



 Comments   
Comment by Githook User [ 06/Dec/22 ]

Author:

{'name': 'Ivan Fefer', 'email': 'ivan.fefer@mongodb.com', 'username': 'Fefer-Ivan'}

Message: SERVER-53657 Add spill file size to execution stats for $group
Branch: master
https://github.com/mongodb/mongo/commit/288dd4cd6645f1336e0972324e0ad10226c0ba6b

Comment by xgen-buildbaron-user [ 21/Oct/22 ]

Ticket re-opened due to revert. aggregation began a consistent failure of jstests/aggregation/spill_to_disk.js

Comment by Githook User [ 21/Oct/22 ]

Author:

{'name': 'auto-revert-processor', 'email': 'dev-prod-dag@mongodb.com'}

Message: Revert "SERVER-53657 Add 'spillFileSizeBytes' and 'numBytesSpilledEstimate' to $group execution stats explain output"

This reverts commit 7cda7dd4df551cb5ff95b0a913b6dbb812320def.
Branch: master
https://github.com/mongodb/mongo/commit/fab997bf60ede64f7e5ca78b15a9ad2661e88e6a

Comment by Githook User [ 20/Oct/22 ]

Author:

{'name': 'Mihai Andrei', 'email': 'mihai.andrei@10gen.com', 'username': 'mtandrei'}

Message: SERVER-53657 Add 'spillFileSizeBytes' and 'numBytesSpilledEstimate' to $group execution stats explain output
Branch: master
https://github.com/mongodb/mongo/commit/7cda7dd4df551cb5ff95b0a913b6dbb812320def

Comment by Rushan Chen [ 12/Sep/22 ]

There is another ticket tracking the sort spills.

Generated at Thu Feb 08 05:31:31 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.