[SERVER-7376] migrate deletion not aggressive enough and tied to migrate moves Created: 17/Oct/12  Updated: 11/Jul/16  Resolved: 11/Dec/12

Status: Closed
Project: Core Server
Component/s: Sharding
Affects Version/s: None
Fix Version/s: 2.2.1, 2.2.3, 2.3.2

Type: Bug Priority: Major - P3
Reporter: Greg Studer Assignee: Randolph Tan
Resolution: Done Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
Related
related to SERVER-7406 async delete needs to better manage c... Closed
Operating System: ALL
Participants:

 Description   

When moving lots of data on a heavily loaded system, the non-aggressive nature of migration deletes means that we're limited by the (deliberately slowed) rate of deletion.

One option is to decouple migration deletions from migrations, which should be safe, but needs consideration.



 Comments   
Comment by auto [ 17/Dec/12 ]

Author:

{u'date': u'2012-12-17T20:22:08Z', u'name': u'Randolph Tan', u'email': u'randolph@10gen.com'}

Message: SERVER-7376 migrate deletion not aggressive enough and tied to migrate moves
Branch: master
https://github.com/mongodb/mongo/commit/22865ea27fb097162d5de942ce0fd2baf83bf788

Comment by auto [ 14/Dec/12 ]

Author:

{u'date': u'2012-12-14T19:14:19Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-7376 migrate deletion not aggressive enough and tied to migrate moves

Fix more tests that were missed last time. This also fixes tests where receiver shard would refuse to moveChunk because there is a ongoing migration doc cleanup.
Branch: master
https://github.com/mongodb/mongo/commit/177a7aaace930ce1fd186a4a03fc3604377e43eb

Comment by auto [ 11/Dec/12 ]

Author:

{u'date': u'2012-12-11T22:19:38Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-7376 migrate deletion not aggressive enough and tied to migrate moves

Fix slowNightly/balance_repl.js
Branch: master
https://github.com/mongodb/mongo/commit/38cab7a6a9375e391a08098739cf08b59203cae0

Comment by auto [ 11/Dec/12 ]

Author:

{u'date': u'2012-12-10T21:28:37Z', u'email': u'randolph@10gen.com', u'name': u'Randolph Tan'}

Message: SERVER-7376 migrate deletion not aggressive enough and tied to migrate moves

Put back dfb8e2604409e2879ea975c4c49ba6ffde90d795 and fixed tests.
Branch: master
https://github.com/mongodb/mongo/commit/93cda0b81d954f1c0184bb15691105d90b9cb0c3

Comment by Greg Studer [ 19/Oct/12 ]

Partial fix pushed to 2.3.0 and 2.2.1, fully async fix will require more a significant regression test audit.

Comment by auto [ 18/Oct/12 ]

Author:

{u'date': u'2012-10-18T07:52:15-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 make migration not wait for deletes, no change to default delete behavior
Branch: v2.2
https://github.com/mongodb/mongo/commit/2d0c3f0cae0d6d0a9f32e0a8ac19e389bf8d0f54

Comment by auto [ 18/Oct/12 ]

Author:

{u'date': u'2012-10-18T07:52:15-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 make migration not wait for deletes, no change to default delete behavior
Branch: master
https://github.com/mongodb/mongo/commit/47629aa786c916f0b988839128c21c535ae9fcfb

Comment by auto [ 18/Oct/12 ]

Author:

{u'date': u'2012-10-18T06:45:11-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: Revert "SERVER-7376 make all migration cleanup async unless explicitly specified otherwise"

This reverts commit dfb8e2604409e2879ea975c4c49ba6ffde90d795.
Branch: v2.2
https://github.com/mongodb/mongo/commit/6f7c02d28f7ab7d88ca02c6279e2f5dabd05c034

Comment by auto [ 18/Oct/12 ]

Author:

{u'date': u'2012-10-18T06:38:15-07:00', u'name': u'Greg Studer', u'email': u'greg@10gen.com'}

Message: Revert "SERVER-7376 make all migration cleanup async unless explicitly specified otherwise"

This reverts commit bb65b80897797e3dc1fe96076fb6c13f6d7260c5.
Branch: master
https://github.com/mongodb/mongo/commit/b09f06fa07755c96ca8ee0f10f8cffeb2bde4a91

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-17T13:03:53-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 make all migration cleanup async unless explicitly specified otherwise
Branch: v2.2
https://github.com/mongodb/mongo/commit/dfb8e2604409e2879ea975c4c49ba6ffde90d795

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-17T10:08:24-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 test fixes for 2.2
Branch: v2.2
https://github.com/mongodb/mongo/commit/83d73563c47df15373b95e4d4428e323d6005b55

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-17T13:03:53-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 make all migration cleanup async unless explicitly specified otherwise
Branch: master
https://github.com/mongodb/mongo/commit/bb65b80897797e3dc1fe96076fb6c13f6d7260c5

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-17T11:52:06-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 test fixes for 2.3+ for slow migration cleanup
Branch: master
https://github.com/mongodb/mongo/commit/eb5bf5b804ee4f20ab5c9e5a77674fe051889f76

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-17T10:08:24-07:00', u'email': u'greg@10gen.com', u'name': u'Greg Studer'}

Message: SERVER-7376 test fixes for 2.2
Branch: master
https://github.com/mongodb/mongo/commit/34107e2d9785dfbc2665a30a724bf68049f87309

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-16T22:39:18-07:00', u'email': u'greg@10gen.com', u'name': u'gregs'}

Message: SERVER-7376 better logging in moveChunk, don't swallow error reported to mongos
Branch: v2.2
https://github.com/mongodb/mongo/commit/b73c4888f7cedb7b22eb211a08685576c3691eb6

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-16T22:36:49-07:00', u'name': u'gregs', u'email': u'greg@10gen.com'}

Message: SERVER-7376 more logging around removeRange
Branch: v2.2
https://github.com/mongodb/mongo/commit/4689b378b37d5aec8a197a78437b18de1bdfdcf3

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-16T22:39:18-07:00', u'email': u'greg@10gen.com', u'name': u'gregs'}

Message: SERVER-7376 better logging in moveChunk, don't swallow error reported to mongos
Branch: master
https://github.com/mongodb/mongo/commit/69e16e6ff80c653a65488d230fd48924629d6e03

Comment by auto [ 17/Oct/12 ]

Author:

{u'date': u'2012-10-16T22:36:49-07:00', u'email': u'greg@10gen.com', u'name': u'gregs'}

Message: SERVER-7376 more logging around removeRange
Branch: master
https://github.com/mongodb/mongo/commit/70f39c63f5e0023a77690c4de71a8720a5b0ea1b

Generated at Thu Feb 08 03:14:21 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.