[GODRIVER-2229] Fix frequently failing unified spec tests Created: 12/Nov/21  Updated: 21/Feb/23  Resolved: 21/Feb/23

Status: Closed
Project: Go Driver
Component/s: Testing
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Unknown
Reporter: Matt Dale Assignee: Preston Vasquez
Resolution: Cannot Reproduce Votes: 0
Labels: greenerbuild
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Quarter: FY24Q1
Documentation Changes Summary:

1. What would you like to communicate to the user about this feature?
2. Would you like the user to see examples of the syntax and/or executable code and its output?
3. Which versions of the driver/connector does this apply to?


 Description   

Recent failures:

Variant Task Test Reason Lobster
5.0 Ubuntu 18.04 test-replicaset-noauth-nossl TestUnifiedSpecs/transactions/legacy/error-labels.json/DuplicateKey_errors_do_not_contain_transient_label unified_spec_test.go:301: error running operation "insertMany" at index 1: expected error message "(snapshotunavailable) unable to read from a snapshot due to pending collection catalog changes; please retry the operation. snapshot timestamp is timestamp(1636671018, 48). collection minimum is timestamp(1636671018, 50)" to contain "e11000" link
5.0 Ubuntu 18.04 test-replicaset-auth-nossl TestUnifiedSpec/crud/unified/aggregate-write-readPreference.json/Aggregate_with_$out_includes_read_preference_for_5.0+_server unified_spec_runner.go:130: error running operation "aggregate" at index 0: error verification failed: expected no error, but got (CommandFailed) PlanExecutor error during aggregation :: caused by :: indexes of target collection db0.coll1 changed during processing. link
5.0 Ubuntu 18.04 test-replicaset-noauth-nossl TestUnifiedSpecs/transactions/legacy/error-labels.json/add_UnknownTransactionCommitResult_label_to_writeConcernError_WriteConcernFailed_with_wtimeout unified_spec_test.go:301: error running operation "insertOne" at index 1: did not expect error but got (SnapshotUnavailable) Unable to read from a snapshot due to pending collection catalog changes; please retry the operation. Snapshot timestamp is Timestamp(1636653950, 6). Collection minimum is Timestamp(1636653950, 8) link
4.0 Ubuntu 18.04 test-sharded-auth-nossl TestCausalConsistencyExamples write exception: write errors: [no progress was made executing batch write op in test.items after 5 rounds (0 ops completed in 6 rounds total)] link
latest Ubuntu 18.04 test-sharded-auth-ssl-zlib-compression TestUnifiedSpec/sessions/unified/snapshot-sessions.json/countDocuments_operation_with_snapshot unified_spec_runner.go:130: error running operation "countDocuments" at index 0: result verification failed: comparison error at top-level: expected numeric value 2, got 0 link


 Comments   
Comment by Preston Vasquez [ 21/Feb/23 ]

I cannot reproduce any of the failures locally and none of the failure happen in the waterfall for the defined variant and task in the last 3 months.

Comment by Preston Vasquez [ 21/Feb/23 ]

There does not appear to be a waterfall (master) failure for the following Variant/Task/Test combinations in the past 3 months, see link for filters:

 

Variant Task Test Link
5.0 Ubuntu 18.04 test-replicaset-noauth-nossl TestUnifiedSpecs/transactions/legacy/error-labels.json/DuplicateKey_errors_do_not_contain_transient_label link
5.0 Ubuntu 18.04 test-replicaset-auth-nossl TestUnifiedSpec/crud/unified/aggregate-write-readPreference.json/Aggregate_with_$out_includes_read_preference_for_5.0+_server link
5.0 Ubuntu 18.04 test-replicaset-noauth-nossl TestUnifiedSpecs/transactions/legacy/error-labels.json/add_UnknownTransactionCommitResult_label_to_writeConcernError_WriteConcernFailed_with_wtimeout link
4.0 Ubuntu 18.04 test-sharded-auth-nossl TestCausalConsistencyExamples link
Generated at Thu Feb 08 08:38:06 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.