[SERVER-81238] random_DDL_setFCV_operations FSM workload tries operation during movePrimary Created: 20/Sep/23  Updated: 29/Oct/23  Resolved: 03/Oct/23

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 7.1.1, 7.2.0-rc0

Type: Bug Priority: Major - P3
Reporter: Matt Broadstone Assignee: Pol Pinol
Resolution: Fixed Votes: 0
Labels: shardingemea-investigation
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Backports
Related
related to SERVER-81007 FSM workloads no longer fail when $co... Closed
Assigned Teams:
Sharding EMEA
Backwards Compatibility: Fully Compatible
Operating System: ALL
Backport Requested:
v7.1
Sprint: Sharding EMEA 2023-10-02, Sharding EMEA 2023-10-16
Participants:

 Description   

After fixing FSM error reporting in SERVER-81007, the random_DDL_setFCV_operations workload began failing with the following error(s):

[fsm_workload_test:random_DDL_setFCV_operations] uncaught exception: Error: 1 thread with tids [9] threw
[fsm_workload_test:random_DDL_setFCV_operations] 
[fsm_workload_test:random_DDL_setFCV_operations]         Foreground jstests/concurrency/fsm_workloads/random_DDL_setFCV_operations.js
[fsm_workload_test:random_DDL_setFCV_operations]         Error: command failed: {
[fsm_workload_test:random_DDL_setFCV_operations]         	"ok" : 0,
[fsm_workload_test:random_DDL_setFCV_operations]         	"errmsg" : "movePrimary is in progress for namespace random_DDL_setFCV_operations_DB_1.sharded_coll_0",
[fsm_workload_test:random_DDL_setFCV_operations]         	"code" : 319,
[fsm_workload_test:random_DDL_setFCV_operations]         	"codeName" : "MovePrimaryInProgress",
[fsm_workload_test:random_DDL_setFCV_operations]         	"$clusterTime" : {
[fsm_workload_test:random_DDL_setFCV_operations]         		"clusterTime" : Timestamp(1695123733, 295),
[fsm_workload_test:random_DDL_setFCV_operations]         		"signature" : {
[fsm_workload_test:random_DDL_setFCV_operations]         			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
[fsm_workload_test:random_DDL_setFCV_operations]         			"keyId" : NumberLong(0)
[fsm_workload_test:random_DDL_setFCV_operations]         		}
[fsm_workload_test:random_DDL_setFCV_operations]         	},
[fsm_workload_test:random_DDL_setFCV_operations]         	"operationTime" : Timestamp(1695123733, 294)
[fsm_workload_test:random_DDL_setFCV_operations]         } with original command request: {
[fsm_workload_test:random_DDL_setFCV_operations]         	"setFeatureCompatibilityVersion" : "7.2",
[fsm_workload_test:random_DDL_setFCV_operations]         	"confirm" : true,
[fsm_workload_test:random_DDL_setFCV_operations]         	"lsid" : {
[fsm_workload_test:random_DDL_setFCV_operations]         		"id" : UUID("f3128eb8-130f-4e60-8e97-dec18a81f7e0")
[fsm_workload_test:random_DDL_setFCV_operations]         	},
[fsm_workload_test:random_DDL_setFCV_operations]         	"$clusterTime" : {
[fsm_workload_test:random_DDL_setFCV_operations]         		"clusterTime" : Timestamp(1695123733, 184),
[fsm_workload_test:random_DDL_setFCV_operations]         		"signature" : {
[fsm_workload_test:random_DDL_setFCV_operations]         			"hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
[fsm_workload_test:random_DDL_setFCV_operations]         			"keyId" : NumberLong(0)
[fsm_workload_test:random_DDL_setFCV_operations]         		}
[fsm_workload_test:random_DDL_setFCV_operations]         	}
[fsm_workload_test:random_DDL_setFCV_operations]         } on connection: connection to localhost:20007
[fsm_workload_test:random_DDL_setFCV_operations] 
[fsm_workload_test:random_DDL_setFCV_operations]         _getErrorWithCode@src/mongo/shell/utils.js:24:13
[fsm_workload_test:random_DDL_setFCV_operations]         quietlyDoAssert@/data/mci/b07c436005e263d808ca9545b69ab6e9/src/jstests/concurrency/fsm_libs/assert.js:57:18
[fsm_workload_test:random_DDL_setFCV_operations]         _assertCommandWorked@src/mongo/shell/assert.js:748:25
[fsm_workload_test:random_DDL_setFCV_operations]         assert.commandWorked@src/mongo/shell/assert.js:842:16
[fsm_workload_test:random_DDL_setFCV_operations]         wrapAssertFn@/data/mci/b07c436005e263d808ca9545b69ab6e9/src/jstests/concurrency/fsm_libs/assert.js:70:22
[fsm_workload_test:random_DDL_setFCV_operations]         assertWithLevel/</assertWithLevel[fn]@/data/mci/b07c436005e263d808ca9545b69ab6e9/src/jstests/concurrency/fsm_libs/assert.js:111:20
[fsm_workload_test:random_DDL_setFCV_operations]         $config</$config.states.setFCV@/data/mci/b07c436005e263d808ca9545b69ab6e9/src/jstests/concurrency/fsm_workloads/random_DDL_setFCV_operations.js:27:26
[fsm_workload_test:random_DDL_setFCV_operations]         runFSM@/data/mci/b07c436005e263d808ca9545b69ab6e9/src/jstests/concurrency/fsm_libs/fsm.js:157:20
[fsm_workload_test:random_DDL_setFCV_operations]         @eval:8:19
[fsm_workload_test:random_DDL_setFCV_operations]         main@/data/mci/b07c436005e263d808ca9545b69ab6e9/src/jstests/concurrency/fsm_libs/worker_thread.js:229:23

(full log)



 Comments   
Comment by Githook User [ 17/Oct/23 ]

Author:

{'name': 'Pol Pinol Castuera', 'email': 'pol.pinol@mongodb.com', 'username': 'PolPinol'}

Message: SERVER-81238 Make local collMod not assert on movePrimary in progress

(cherry picked from commit ee29248bdbe6a4b0e84d2e58b479d11e1f60b948)
Branch: v7.1
https://github.com/mongodb/mongo/commit/87b932b1741878ba095b4436482a7ff4253b27db

Comment by Githook User [ 02/Oct/23 ]

Author:

{'name': 'Pol Pinol Castuera', 'email': 'pol.pinol@mongodb.com', 'username': 'PolPinol'}

Message: SERVER-81238 Make local collMod not assert on movePrimary in progress
Branch: master
https://github.com/mongodb/mongo/commit/ee29248bdbe6a4b0e84d2e58b479d11e1f60b948

Generated at Thu Feb 08 06:45:55 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.