[SERVER-44436] IndexBuildsCoordinatorMongod should always delegate index build to thread pool Created: 05/Nov/19  Updated: 29/Oct/23  Resolved: 08/Nov/19

Status: Closed
Project: Core Server
Component/s: Storage
Affects Version/s: None
Fix Version/s: 4.3.1

Type: Improvement Priority: Major - P3
Reporter: Benety Goh Assignee: Benety Goh
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
is depended on by SERVER-43692 enable two phase index builds by default Closed
Related
is related to SERVER-39335 IndexBuildsCoordinator::_runIndexBuil... Closed
is related to SERVER-43697 Create helper functions for building ... Closed
Backwards Compatibility: Fully Compatible
Sprint: Execution Team 2019-11-18
Participants:

 Description   

SERVER-39335 allowed callers of IndexBuildsCoordinator::startIndexBuild() to bypass the thread pool and invoke the index building functions directly. This was necessary to support synchronous index builds during replica set transitions that used DBDirectClient.createIndexes(). Removing this bypass functionality will improve our ability to reason about the environment and context of index builds managed by the IndexBuildsCoordinator.

 

Currently, the two known callers that call into the IndexBuildsCoordinator synchronously are generateSystemIndexesForExistingCollection() and ShardingCatalogManager::initializeConfigDatabaseIfNeeded().



 Comments   
Comment by Mchl Grdlv [ 04/Jan/21 ]

I have installed in synology docker Rocket.chat and mongo. Everything works well.
But the container generates messages every second.
This puts a strain on the disk system.
I ask for advice and correct this error. As a last resort, how can I disable writing these messages to disk?

"2021-01-04 08:49:57,stdout,"{\"t\":

{\"$date\":\"2021-01-04T11:49:57.752+03:00\"}

,\"s\":\"I\", \"c\":\"STORAGE\", \"id\":3856202, \"ctx\":\"IndexBuildsCoordinatorMongod-2\",\"msg\":\"'voteCommitIndexBuild' command failed.\",\"attr\":{\"indexBuildUUID\":{\"uuid\":{\"$uuid\":\"d90def3b-4dc1-4cce-aa19-53c3f7eb094e\"}},\"responseStatus\":{\"operationTime\":{\"$timestamp\":{\"t\":1609750196,\"i\":1}},\"ok\":0.0,\"errmsg\":\"command voteCommitIndexBuild requires authentication\",\"code\":13,\"codeName\":\"Unauthorized\",\"$clusterTime\":{\"clusterTime\":{\"$timestamp\":{\"t\":1609750196,\"i\":1}},\"signature\":{\"hash\":{\"$binary\":{\"base64\":\"RtULaapbdm/5ooRgGl6jfYeyu4k=\",\"subType\":\"0\"}},\"keyId\":6890507829308817412}}}}}
"2021-01-04 08:49:57,stdout,"{\"t\":

{\"$date\":\"2021-01-04T11:49:57.649+03:00\"}

,\"s\":\"I\", \"c\":\"STORAGE\", \"id\":3856202, \"ctx\":\"IndexBuildsCoordinatorMongod-1\",\"msg\":\"'voteCommitIndexBuild' command failed.\",\"attr\":{\"indexBuildUUID\":{\"uuid\":{\"$uuid\":\"5038dec8-d17f-49a7-afe8-896d37876686\"}},\"responseStatus\":{\"operationTime\":{\"$timestamp\":{\"t\":1609750196,\"i\":1}},\"ok\":0.0,\"errmsg\":\"command voteCommitIndexBuild requires authentication\",\"code\":13,\"codeName\":\"Unauthorized\",\"$clusterTime\":{\"clusterTime\":{\"$timestamp\":{\"t\":1609750196,\"i\":1}},\"signature\":{\"hash\":{\"$binary\":{\"base64\":\"RtULaapbdm/5ooRgGl6jfYeyu4k=\",\"subType\":\"0\"}},\"keyId\":6890507829308817412}}}}}
"2021-01-04 08:49:57,stdout,"{\"t\":

{\"$date\":\"2021-01-04T11:49:57.648+03:00\"}

,\"s\":\"I\", \"c\":\"STORAGE\", \"id\":3856202, \"ctx\":\"IndexBuildsCoordinatorMongod-0\",\"msg\":\"'voteCommitIndexBuild' command failed.\",\"attr\":{\"indexBuildUUID\":{\"uuid\":{\"$uuid\":\"7b61f52d-9904-4dc8-9b06-aedb8fcadfad\"}},\"responseStatus\":{\"operationTime\":{\"$timestamp\":{\"t\":1609750196,\"i\":1}},\"ok\":0.0,\"errmsg\":\"command voteCommitIndexBuild requires authentication\",\"code\":13,\"codeName\":\"Unauthorized\",\"$clusterTime\":{\"clusterTime\":{\"$timestamp\":{\"t\":1609750196,\"i\":1}},\"signature\":{\"hash\":{\"$binary\":{\"base64\":\"RtULaapbdm/5ooRgGl6jfYeyu4k=\",\"subType\":\"0\"}},\"keyId\":6890507829308817412}}}}}
"2021-01-04 08:49:56,stdout,"{\"t\":

{\"$date\":\"2021-01-04T11:49:56.751+03:00\"}

,\"s\":\"I\", \"c\":\"STORAGE\", \"id\":3856202, \"ctx\":\"IndexBuildsCoordinatorMongod-2\",\"msg\":\"'voteCommitIndexBuild' command failed.\",\"attr\":{\"indexBuildUUID\":{\"uuid\":{\"$uuid\":\"d90def3b-4dc1-4cce-aa19-53c3f7eb094e\"}},\"responseStatus\":{\"operationTime\":{\"$timestamp\":{\"t\":1609750186,\"i\":2}},\"ok\":0.0,\"errmsg\":\"command voteCommitIndexBuild requires authentication\",\"code\":13,\"codeName\":\"Unauthorized\",\"$clusterTime\":{\"clusterTime\":{\"$timestamp\":{\"t\":1609750186,\"i\":2}},\"signature\":{\"hash\":{\"$binary\":{\"base64\":\"2TFFt43KcKYAPhR+rXwog/vqyOI=\",\"subType\":\"0\"}},\"keyId\":6890507829308817412}}}}}
"2021-01-04 08:49:56,stdout,"{\"t\":

{\"$date\":\"2021-01-04T11:49:56.647+03:00\"}

,\"s\":\"I\", \"c\":\"STORAGE\", \"id\":3856202, \"ctx\":\"IndexBuildsCoordinatorMongod-1\",\"msg\":\"'voteCommitIndexBuild' command failed.\",\"attr\":{\"indexBuildUUID\":{\"uuid\":{\"$uuid\":\"5038dec8-d17f-49a7-afe8-896d37876686\"}},\"responseStatus\":{\"operationTime\":{\"$timestamp\":{\"t\":1609750186,\"i\":2}},\"ok\":0.0,\"errmsg\":\"command voteCommitIndexBuild requires authentication\",\"code\":13,\"codeName\":\"Unauthorized\",\"$clusterTime\":{\"clusterTime\":{\"$timestamp\":{\"t\":1609750186,\"i\":2}},\"signature\":{\"hash\":{\"$binary\":{\"base64\":\"2TFFt43KcKYAPhR+rXwog/vqyOI=\",\"subType\":\"0\"}},\"keyId\":6890507829308817412}}}}}
"2021-01-04 08:49:56,stdout,"{\"t\":

{\"$date\":\"2021-01-04T11:49:56.645+03:00\"}

,\"s\":\"I\", \"c\":\"STORAGE\", \"id\":3856202, \"ctx\":\"IndexBuildsCoordinatorMongod-0\",\"msg\":\"'voteCommitIndexBuild' command failed.\",\"attr\":{\"indexBuildUUID\":{\"uuid\":{\"$uuid\":\"7b61f52d-9904-4dc8-9b06-aedb8fcadfad\"}},\"responseStatus\":{\"operationTime\":{\"$timestamp\":{\"t\":1609750186,\"i\":2}},\"ok\":0.0,\"errmsg\":\"command voteCommitIndexBuild requires authentication\",\"code\":13,\"codeName\":\"Unauthorized\",\"$clusterTime\":{\"clusterTime\":{\"$timestamp\":{\"t\":1609750186,\"i\":2}},\"signature\":{\"hash\":{\"$binary\":{\"base64\":\"2TFFt43KcKYAPhR+rXwog/vqyOI=\",\"subType\":\"0\"}},\"keyId\":6890507829308817412}}}}}

Comment by Githook User [ 07/Nov/19 ]

Author:

{'name': 'Benety Goh', 'username': 'benety', 'email': 'benety@mongodb.com'}

Message: SERVER-44436 IndexBuildsCoordinatorMongod always uses thread pool to run index build
Branch: master
https://github.com/mongodb/mongo/commit/15485ce91b20c2eaf8ec7bc4c74e26fc58ebaf86

Generated at Thu Feb 08 05:05:59 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.