[SERVER-53036] [SBE] Investigate why several sys-perf benchmarks fail Created: 23/Nov/20 Updated: 27/Oct/23 Resolved: 11/May/21 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Querying |
| Affects Version/s: | None |
| Fix Version/s: | None |
| Type: | Task | Priority: | Major - P3 |
| Reporter: | Drew Paroski | Assignee: | Backlog - Query Execution |
| Resolution: | Gone away | Votes: | 0 |
| Labels: | post-rc0, qexec-team, sbe-post-rc0 | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Issue Links: |
|
||||||||||||||||||||||||
| Assigned Teams: |
Query Execution
|
||||||||||||||||||||||||
| Sprint: | Query Execution 2021-05-31 | ||||||||||||||||||||||||
| Participants: | |||||||||||||||||||||||||
| Description |
|
In December 2020 / January 2021, I made a diff that made SBE mode enabled by default and then I tried running all of the sys-perf benchmarks. Diff:
sys-perf Evergreen run: https://spruce.mongodb.com/version/5fb8666657e85a0819d36b59/tasks Under SBE mode, for the "industry_benchmarks", "industry_benchmarks_wmajority", "linkbench", and "ycsb_60GB" tasks, the loading phase succeeds ("ycsb_load" or "linkbench_load"), but then the subsequent phase fails ("ycsb_100read", "ycsb_95read5update_w_majority", or "linkbench_request"). In the main Evergreen log for each of these tasks, I see the following error:
When I looked at the "mongod.log" file for the phase that failed ("ycsb_100read", "ycsb_95read5update_w_majority", or "linkbench_request"), it appears that mongod was encountering an error during startup, and then the mongod would give up and shutdown. Here is a snippet from the "mongod.log" file:
The goal of this task is to investigate and understand precisely why mongod is hitting the "not master or secondary; cannot currently read from this replSet member" error during startup for these benchmarks, to develop a repro that can be done on a developer's local machine, and to open a new task (or update this task) with these findings. Below are links to the Evergreen runs for each of the failing benchmarks: industry_benchmarks: https://spruce.mongodb.com/task/sys_perf_linux_1_node_replSet_industry_benchmarks_patch_73d1a6f368b04161dce7c0afbcea23efb52e2070_5fb8666657e85a0819d36b59_20_11_21_01_00_30/ industry_benchmarks_wmajority: https://spruce.mongodb.com/task/sys_perf_linux_1_node_replSet_industry_benchmarks_wmajority_patch_73d1a6f368b04161dce7c0afbcea23efb52e2070_5fb8666657e85a0819d36b59_20_11_21_01_00_30/
|