[SERVER-49507] Reduce memory consumption in startup repair when rebuilding unique indexes with a large number of duplicate records Created: 14/Jul/20  Updated: 29/Oct/23  Resolved: 05/Aug/20

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 4.7.0, 4.4.2

Type: Improvement Priority: Major - P3
Reporter: Fausto Leyva (Inactive) Assignee: Fausto Leyva (Inactive)
Resolution: Fixed Votes: 0
Labels: KP44
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Related
related to SERVER-51593 Index build bulk builder does not han... Backlog
related to SERVER-39562 Repair should handle duplicate unique... Closed
Backwards Compatibility: Fully Compatible
Sprint: Execution Team 2020-07-27, Execution Team 2020-08-10
Participants:
Case:
Linked BF Score: 40

 Description   

Currently, dumpInsertsFromBulk populates a set of RecordIds (in memory) which contain duplicate unique keys.

 

The duplicate record ids are iterated through, moved to a lost_and_found collection and deleted. 



 Comments   
Comment by Githook User [ 08/Oct/20 ]

Author:

{'name': 'Faustoleyva54', 'email': 'fausto.leyva@mongodb.com', 'username': 'Faustoleyva54'}

Message: SERVER-39562 Repair should handle duplicate unique index keys

(cherry picked from commit 80f11e6ae0708e8c8da49208ef2cf71cdd06877c)

SERVER-49507 Reduce memory consumption in startup repair when rebuilding unique indexes with a large number of duplicate records

(cherry picked from commit e25d43ca2b5e99e6484cb0e13ca5f9e2d014ac30)
Branch: v4.4
https://github.com/mongodb/mongo/commit/69b7023414b5a1160de0f0e4a068e4bd8ff288e9

Comment by Githook User [ 05/Aug/20 ]

Author:

{'name': 'Faustoleyva54', 'email': 'fausto.leyva@mongodb.com', 'username': 'Faustoleyva54'}

Message: SERVER-49507 Reduce memory consumption in startup repair when rebuilding unique indexes with a large number of duplicate records
Branch: master
https://github.com/mongodb/mongo/commit/e25d43ca2b5e99e6484cb0e13ca5f9e2d014ac30

Comment by Fausto Leyva (Inactive) [ 30/Jul/20 ]

https://mongodbcr.appspot.com/636730001/

Comment by Louis Williams [ 16/Jul/20 ]

bruce.lucas, yes this is a follow-up to work that has yet to be committed in SERVER-39562. It is a similar problem, but the hope is that SERVER-48067 will make this easier to solve.

Comment by Bruce Lucas (Inactive) [ 16/Jul/20 ]

Is this different from SERVER-48067?

Generated at Thu Feb 08 05:20:06 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.