[SERVER-56307] The chunk migration "convergence algorithm" is very primitive Created: 23/Apr/21 Updated: 29/Oct/23 Resolved: 18/Jun/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | None |
| Affects Version/s: | None |
| Fix Version/s: | 4.2.15, 4.4.7, 4.0.26, 5.0.0-rc3, 5.1.0-rc0 |
| Type: | Improvement | Priority: | Major - P3 |
| Reporter: | Kaloian Manassiev | Assignee: | Paolo Polato |
| Resolution: | Fixed | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||||||||||||||||||||||
| Backwards Compatibility: | Fully Compatible | ||||||||||||||||||||||||||||||||||||||||
| Backport Requested: |
v5.0, v4.4, v4.2, v4.0
|
||||||||||||||||||||||||||||||||||||||||
| Sprint: | Sharding EMEA 2021-05-17 | ||||||||||||||||||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||||||||||||||||||
| Linked BF Score: | 172 | ||||||||||||||||||||||||||||||||||||||||
| Description |
|
The chunk migration "convergence algorithm" is the logic which the donor and participant implement in order for the donor to decide when to enter the critical section and block writes. The current implementation relies on the recipient being capable of catching up on every modification occurred during the migration and reaching the STEADY state to allow the donor to enter the critical section. It has been detected that under situations of heavy load such condition may be never met, as the rate of incoming modifications is bigger than what can be transferred to the recipient. Potetial fixes are: (1) The donor sends to the recipient some measure of how much mods are left, so it can enter the steady state based on some delta, rather than zero. (2) The donor decides to enter the critical section not based on whether the recipient has decided to enter steady-state (which includes a wait for majority) |
| Comments |
| Comment by Githook User [ 23/Jul/21 ] |
|
Author: {'name': 'andf-mongodb', 'email': 'andrew.feierabend@mongodb.com', 'username': 'andf-mongodb'}Message: DOCSP-16424 remove |
| Comment by Githook User [ 23/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 49209fc34e19bbb15405b0927e38ff3e7d9e9dc5) |
| Comment by Githook User [ 23/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 49209fc34e19bbb15405b0927e38ff3e7d9e9dc5) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit d40fb7099961fa73de106f390bb9396676bac0bc) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 7d0aee4c7dec9380c3ef8be20c31b1334b27cd20) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 44bdd2c38fd5c80881e15f40e2da6cacf5f35eb4) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 49209fc34e19bbb15405b0927e38ff3e7d9e9dc5) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 3394ccd20ee2a77f3526c481799943c7418bff00) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit 49209fc34e19bbb15405b0927e38ff3e7d9e9dc5) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit d40fb7099961fa73de106f390bb9396676bac0bc) |
| Comment by Githook User [ 21/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit f32a3d08fb7128de3c1b43b8478a5e4626101b89) |
| Comment by Githook User [ 18/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 16/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 15/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: Revert " This reverts commit 3394ccd20ee2a77f3526c481799943c7418bff00. |
| Comment by Jonathan Streets (Inactive) [ 15/Jun/21 ] |
|
removed 5.0.0-rc2 and 4.4.7 fixVersions to reflect the reverts. |
| Comment by Githook User [ 15/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: Revert " This reverts commit 44bdd2c38fd5c80881e15f40e2da6cacf5f35eb4. |
| Comment by Githook User [ 15/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: Revert " This reverts commit 7d0aee4c7dec9380c3ef8be20c31b1334b27cd20. |
| Comment by Githook User [ 15/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: Revert " This reverts commit 388d5c4ae92e3f63b1fcc8181702167a9b1f6c5e. |
| Comment by Githook User [ 15/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: Revert " This reverts commit f32a3d08fb7128de3c1b43b8478a5e4626101b89. |
| Comment by Githook User [ 14/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: (cherry picked from commit d40fb7099961fa73de106f390bb9396676bac0bc) |
| Comment by Githook User [ 14/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 04/Jun/21 ] |
|
Author: {'name': 'andf-mongodb', 'email': 'andrew.feierabend@mongodb.com', 'username': 'andf-mongodb'}Message: DOCSP-16424 remove |
| Comment by Githook User [ 04/Jun/21 ] |
|
Author: {'name': 'andf-mongodb', 'email': 'andrew.feierabend@mongodb.com', 'username': 'andf-mongodb'}Message: DOCSP-16424 remove |
| Comment by Githook User [ 04/Jun/21 ] |
|
Author: {'name': 'andf-mongodb', 'email': 'andrew.feierabend@mongodb.com', 'username': 'andf-mongodb'}Message: DOCSP-16424 remove |
| Comment by Githook User [ 04/Jun/21 ] |
|
Author: {'name': 'andf-mongodb', 'email': 'andrew.feierabend@mongodb.com', 'username': 'andf-mongodb'}Message: DOCSP-16424 remove |
| Comment by Githook User [ 04/Jun/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: Revert " This reverts commit 40e1693cb180fd17ec6fa0e1b32acc21769c0b85. |
| Comment by Githook User [ 21/May/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 21/May/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 20/May/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 12/May/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |
| Comment by Githook User [ 12/May/21 ] |
|
Author: {'name': 'Paolo Polato', 'email': 'paolo.polato@mongodb.com', 'username': 'ppolato'}Message: |