[SERVER-45458] Test mapReduce performance without $_internalJsEmit Created: 09/Jan/20  Updated: 27/Oct/23  Resolved: 28/Feb/20

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: None

Type: Task Priority: Major - P3
Reporter: David Percy Assignee: Eric Cox (Inactive)
Resolution: Works as Designed Votes: 0
Labels: qopt-team
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Depends
depends on SERVER-45453 Change name and usage of $_internalJs... Closed
Sprint: Query 2020-01-27, Query 2020-02-10, Query 2020-02-24, Query 2020-03-09
Participants:

 Description   

Compare legacy mapReduce performance (on 4.2) to equivalent aggregation pipeline which uses a normal $project stage rather than one with $_internalJsEmit (replica set only).

 



 Comments   
Comment by Eric Cox (Inactive) [ 28/Feb/20 ]

It looks like we have a consistent ~8.x speed improvement for the various $out replacement strategies

Test  Threads  Throughput Pass?
mr_word_count_results_reduce 1 16075.757543 true
mr_word_count_results_reduce_pipeline 1 123411.08231 true
mr_word_count_results_merge 1 15927.523397 true
mr_word_count_results_merge_pipeline 1 122155.80565 true
mr_word_count_results_replace 1 16164.420171 true
mr_word_count_results_replace_pipeline 1 122419.99853 true

Evergreen run is here.

https://evergreen.mongodb.com/task/sys_perf_linux_standalone_map_reduce_workloads_patch_ac7c4b8079b8927bab3fbabf179a5be125c9c4bf_5e58983f1e2d175521d8aa92_20_02_28_04_34_50##%257B%2522compare%2522%253A%255B%257B%2522hash%2522%253A%2522ac7c4b8079b8927bab3fbabf179a5be125c9c4bf%2522%257D%255D%257D

 

 

Comment by David Percy [ 11/Feb/20 ]

A good starting point would probably be one of these benchmarks: https://jira.mongodb.org/browse/SERVER-42695?focusedCommentId=2602350&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-2602350

Generated at Thu Feb 08 05:08:51 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.