[SERVER-54791] Excessive file descriptor usage during index build with external sort Created: 25/Feb/21 Updated: 29/Oct/23 Resolved: 28/Jul/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Index Maintenance |
| Affects Version/s: | 4.2.12 |
| Fix Version/s: | 5.0.3, 4.4.10, 5.1.0-rc0 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Dmitry Agranat | Assignee: | Gregory Noma |
| Resolution: | Fixed | Votes: | 6 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||||||||||||||||||
| Backport Requested: |
v5.0, v4.4, v4.2
|
||||||||||||||||||||||||||||||||||||
| Sprint: | Execution Team 2021-07-12, Execution Team 2021-07-26, Execution Team 2021-08-09 | ||||||||||||||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||||||||||||||
| Case: | (copied to CRM) | ||||||||||||||||||||||||||||||||||||
| Linked BF Score: | 151 | ||||||||||||||||||||||||||||||||||||
| Description |
|
During the index build phase with the external sort, file descriptor usage can be in thousands or even tens of thousands. This might be problematic for workloads that already consume a significant number of file descriptors or OS's where increasing the equivalent to file descriptors might be a problem. |
| Comments |
| Comment by Githook User [ 23/Sep/21 ] |
|
Author: {'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}Message: |
| Comment by Githook User [ 04/Aug/21 ] |
|
Author: {'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}Message: (cherry picked from commit 6e57f295d4fcf932f58cb402a056001c75fde9d2) |
| Comment by Githook User [ 28/Jul/21 ] |
|
Author: {'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}Message: |
| Comment by Githook User [ 28/Jul/21 ] |
|
Author: {'name': 'Gregory Noma', 'email': 'gregory.noma@gmail.com', 'username': 'gregorynoma'}Message: |