[SERVER-49227] Set up new test suites for SBE testing Created: 01/Jul/20  Updated: 29/Oct/23  Resolved: 28/Sep/20

Status: Closed
Project: Core Server
Component/s: Querying
Affects Version/s: None
Fix Version/s: 4.7.0

Type: Task Priority: Major - P3
Reporter: Anton Korshunov Assignee: Justin Seyster
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Issue split
split to SERVER-51203 More find subsystem tests for better ... Closed
Backwards Compatibility: Fully Compatible
Sprint: Query 2020-08-24, Query 2020-09-07, Query 2020-09-21, Query 2020-10-05
Participants:

 Description   

We need to create two new suites and enable them in Evergreen to test the SBE engine. The suite are:

  • core_sbe
  • aggregation_sbe

They should be configured to run mongod with --setParameter internalQueryEnableSlotBasedExecutionEngine=true.

Given that the SBE engine is in the early stage of the development, it may not support all feature used in these suites. Hence, all tests must be excluded by default and only those which pass should be explicitly included. We will enable more tests as we go on and resolve a particular group of failures and implement an unsupported feature.



 Comments   
Comment by Justin Seyster [ 28/Sep/20 ]

Because this ticket includes commits that are already in a release, I'm closing it out and filingĀ SERVER-51203 for the remaining follow-on work.

Comment by Githook User [ 19/Aug/20 ]

Author:

{'name': 'Justin Seyster', 'email': 'justin.seyster@mongodb.com', 'username': 'jseyster'}

Message: SERVER-49227 Add aggregation_slot_based_execution suite
Branch: master
https://github.com/mongodb/mongo/commit/14dc7f9b363d7fe9010d7ae5189e7a1132722cf2

Comment by Githook User [ 18/Aug/20 ]

Author:

{'name': 'Justin Seyster', 'email': 'justin.seyster@mongodb.com', 'username': 'jseyster'}

Message: SERVER-49227 Tag tests to be excluded from aggregation_slot_based_execution
Branch: master
https://github.com/mongodb/mongo/commit/cdec685db910da9ba9c5b16b386da181cee8ff36

Comment by Githook User [ 14/Aug/20 ]

Author:

{'name': 'Justin Seyster', 'email': 'justin.seyster@mongodb.com', 'username': 'jseyster'}

Message: SERVER-49227 Add jsCore_slot_based_execution suite
Branch: master
https://github.com/mongodb/mongo/commit/a629d56622ffb64025150fc674212267d2b5cf84

Comment by Githook User [ 14/Aug/20 ]

Author:

{'name': 'Justin Seyster', 'email': 'justin.seyster@mongodb.com', 'username': 'jseyster'}

Message: SERVER-49227 Tag tests to be excluded from jsCore_slot_based_execution
Branch: master
https://github.com/mongodb/mongo/commit/d80312792b116f68bb3dd19d92e6c8f84c48f177

Comment by Justin Seyster [ 05/Aug/20 ]

I am in the process of integrating the first part of this ticket: the "core_sbe" suite. Because about half of the tests pass as-is, we decided to move from an opt-in approach for tests to an opt-out approach. The new suite will run all jsCore tests that are not tagged with a new "sbe_incompatible" tag.

Comment by Justin Seyster [ 09/Jul/20 ]

david.storch Yes! I am part way through compiling a list of passing tests and categorizing the reasons for failing tests.

Comment by David Storch [ 09/Jul/20 ]

justin.seyster can you confirm that you have already started on this one?

Generated at Thu Feb 08 05:19:17 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.