[SERVER-11694] Balancer not working Created: 14/Nov/13 Updated: 10/Dec/14 Resolved: 19/Mar/14 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Sharding |
| Affects Version/s: | 2.4.1 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Blocker - P1 |
| Reporter: | Dharshan Rangegowda | Assignee: | Unassigned |
| Resolution: | Done | Votes: | 0 |
| Labels: | None | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Operating System: | ALL |
| Participants: |
| Description |
|
I have a two shard setup (shard0, shard1) on AWS. I went ahead and added a new shard (shard2). However the balancer is not able to move chunks to the new shards I see a bunch of errors in the log - "migration already in progress" , max: { target_pid: -4611686018427387902 }, shard , max: { target_pid: -4611686018427387902 }, shard: "Shard-0" max: { target_pid: -5776441268022973039 }) Shard-0:Shard-0/SG-m1largetest2-1522.servers.mongodirector.com:27017,SG-m1largetest2-1523.servers.mongodirector.co Thu Nov 14 00:29:50.508 [Balancer] balancer move failed: { ok: 0.0, errmsg: "migration already in progress" }from: Shard-0 to: Shard-2 chunk: min: { target _pid: -6914850372026113762 }max: { target_pid: -5776441268022973039 }Thu Nov 14 00:29:50.508 [Balancer] moving chunk ns: chat.chats_development moving ( ns:chat.chats_developmentshard: Shard-0:Shard-0/SG-m1largetest2-1522.serv max: { targe t_pid: -4611686018427387902 }) Shard-0:Shard-0/SG-m1largetest2-1522.servers.mongodirector.com:27017,SG-m1largetest2-1523.servers.mongodirector.com:27017 -> S Thu Nov 14 00:29:50.614 [Balancer] balancer move failed: { ok: 0.0, errmsg: "migration already in progress" }from: Shard-0 to: Shard-2 chunk: min: { target _pid: MinKey }max: { target_pid: -4611686018427387902 }Thu Nov 14 00:29:50.614 [Balancer] moving chunk ns: chat.chats_staging moving ( ns:chat.chats_stagingshard: Shard-0:Shard-0/SG-m1largetest2-1522.servers.mong max: { target_pid: - 4611686018427387902 }) Shard-0:Shard-0/SG-m1largetest2-1522.servers.mongodirector.com:27017,SG-m1largetest2-1523.servers.mongodirector.com:27017 -> Shard-2:S Thu Nov 14 00:29:50.719 [Balancer] balancer move failed: { ok: 0.0, errmsg: "migration already in progress" }from: Shard-0 to: Shard-2 chunk: min: { target _pid: MinKey }max: { target_pid: -4611686018427387902 }Here is the output of locks collection { "_id" : "chat.chats_production", "process" : "ip-10-83-63-165:27017:1384280537:396106300", "state" : 2, "ts" : ObjectId("5283de1fd365b49a9f02596d"), "when" : ISODate("2013-11-13T20:16:31.1 " } " } " } |
| Comments |
| Comment by Stennie Steneker (Inactive) [ 19/Mar/14 ] |
|
Hi Dharshan, I'm going to close this issue due to inactivity. I would also note that the SERVER project is intended for reporting bugs or feature suggestions for the MongoDB server. For MongoDB-related support discussion please post on the mongodb-users group (http://groups.google.com/group/mongodb-user) or ask specific questions on Stack Overflow / ServerFault. Thanks, |
| Comment by Stennie Steneker (Inactive) [ 16/Dec/13 ] |
|
Hi Dharshan, Are you still experiencing this issue with your balancer? If so, in order to progress investigation on this issue we will need the further information requested:
Thanks, |
| Comment by Eliot Horowitz (Inactive) [ 25/Nov/13 ] |
|
Can you login onto each primary and send the output of db.currentOp() Also, if you could send the mongod logs from the original shard, that would be great. |