[SERVER-16064] WT Performance Regression for update of hot document on 2014-11-10 builds Created: 10/Nov/14 Updated: 23/Mar/15 Resolved: 13/Nov/14 |
|
| Status: | Closed |
| Project: | Core Server |
| Component/s: | Performance |
| Affects Version/s: | 2.8.0-rc0 |
| Fix Version/s: | None |
| Type: | Bug | Priority: | Critical - P2 |
| Reporter: | David Daly | Assignee: | Unassigned |
| Resolution: | Done | Votes: | 0 |
| Labels: | 28qa | ||
| Remaining Estimate: | Not Specified | ||
| Time Spent: | Not Specified | ||
| Original Estimate: | Not Specified | ||
| Operating System: | ALL |
| Steps To Reproduce: | Mongo-sim table_scan workload. States 12 and 15. In Comments. |
| Participants: |
| Description |
|
Mongo-sim based microbenchmarks that update a hot document (i.e., all updating same document) show significant performance degradation today. 10 threads trying to update the same document. Throughput for the two tests |
| Comments |
| Comment by David Daly [ 13/Nov/14 ] |
|
Closing this one since the performance regression was relative to a incorrect behavior. |
| Comment by David Daly [ 13/Nov/14 ] |
|
asya, it looks like you are right. I tried out before and after the changset for |
| Comment by Asya Kamsky [ 11/Nov/14 ] |
|
Couldn't this be due to incorrect behavior on conflict on write fixed in |
| Comment by David Daly [ 11/Nov/14 ] |
|
Updated results show a big improvement with version 92d967 for some of the mongo-perf simple_mms_update particularly single threaded, but still trailing at 10 threads. Update.MmsIncDeepDistinctPath2 and Update.MmsIncDeepDistinctPath3 show the biggest remaining mulithreaded drop. MongoDB shell version: 2.7.9-pre- load('util/utils.js') load('testcases/simple_update_mms.js') mongoPerfRunTests([1, 2, 10], 1, 1, 5, 1, '', 'sanity', 'localhost', '27017', '2014-11-11 09:13:04.439825', 0, {"writeCmdMode": "true", "writeConcernW": 0, "safeGLE": "false", "writeConcernJ": "false"}, {"server_git_hash": "92d967e8cd4d32f3b3348c89320f238df47a1454", "server_storage_engine": "mmapv1", "harness": {"git_hash": "unknown", "client": {"git_hash": "92d967e8cd4d32f3b3348c89320f238df47a1454", "version": "2.7.9-pre-", "name": "mongo shell"}, "name": "mongo-perf", "version": "unknown"}, "server_version": "2.7.9-pre-"}); Update.MmsIncShallow1 |
| Comment by Chung-yen Chang [ 11/Nov/14 ] |
|
I reviewed the mongo-perf data from the last couple weeks and the interesting about the MMS related tests that David reported above is that the performance of those operations saw a big bump from Nov. 02 to Nov. 03. The between Nov. 06 and Nov. 07, we had this drop and the performance for those are basically back to the same level as before the big jump on the 3rd. Could this be something checked in around the 3rd got reverted? |
| Comment by David Daly [ 11/Nov/14 ] |
|
Can be reproduced with mongo-perf simple_update_mms.js tests. Results from Friday build: load('util/utils.js') load('testcases/simple_update_mms.js') mongoPerfRunTests([1, 2, 10], 1, 1, 5, 1, '', 'sanity', 'localhost', '27017', '2014-11-10 20:26:34.117036', 0, {"writeCmdMode": "true", "writeConcernW": 0, "safeGLE": "false", "writeConcernJ": "false"}, {"server_git_hash": "e1fa60e4d8b3f525575b4602b208f2a1ef353735", "server_storage_engine": "wiredtiger", "harness": {"git_hash": "unknown", "client": {"git_hash": "e1fa60e4d8b3f525575b4602b208f2a1ef353735", "version": "2.7.9-pre-", "name": "mongo shell"}, "name": "mongo-perf", "version": "unknown"}, "server_version": "2.7.9-pre-"}); Update.MmsIncShallow1 Today's builds: load('util/utils.js') load('testcases/simple_update_mms.js') mongoPerfRunTests([1, 2, 10], 1, 1, 5, 1, '', 'sanity', 'localhost', '27017', '2014-11-10 20:30:12.102994', 0, {"writeCmdMode": "true", "writeConcernW": 0, "safeGLE": "false", "writeConcernJ": "false"}, {"server_git_hash": "4ab029e3e68ea5f7aa89b90a47fd814d17b142bf", "server_storage_engine": "wiredtiger", "harness": {"git_hash": "unknown", "client": {"git_hash": "4ab029e3e68ea5f7aa89b90a47fd814d17b142bf", "version": "2.7.9-pre-", "name": "mongo shell"}, "name": "mongo-perf", "version": "unknown"}, "server_version": "2.7.9-pre-"}); Update.MmsIncShallow1 MongoDB shell version: 2.7.9-pre- load('util/utils.js') load('testcases/simple_update_mms.js') mongoPerfRunTests([1, 2, 10], 1, 1, 5, 1, '', 'sanity', 'localhost', '27017', '2014-11-10 20:35:48.689789', 0, {"writeCmdMode": "true", "writeConcernW": 0, "safeGLE": "false", "writeConcernJ": "false"}, {"server_git_hash": "c686f5a1949339ba9390e6efc01ef8421867c692", "server_storage_engine": "wiredtiger", "harness": {"git_hash": "unknown", "client": {"git_hash": "c686f5a1949339ba9390e6efc01ef8421867c692", "version": "2.7.9-pre-", "name": "mongo shell"}, "name": "mongo-perf", "version": "unknown"}, "server_version": "2.7.9-pre-"}); Update.MmsIncShallow1 |
| Comment by David Daly [ 10/Nov/14 ] |
|
May be related to |