[SERVER-36069] Vendor mongoebench-compatible JSON config files from mongodb/mongo-perf into src/third_party Created: 11/Jul/18  Updated: 29/Oct/23  Resolved: 09/Aug/18

Status: Closed
Project: Core Server
Component/s: Testing Infrastructure
Affects Version/s: None
Fix Version/s: 4.0.3, 4.1.2

Type: Task Priority: Major - P3
Reporter: Max Hirschhorn Assignee: Max Hirschhorn
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Text File adb.log     Text File mongoebench_config_files_git_numstat.txt    
Issue Links:
Backports
Depends
is depended on by SERVER-36076 Create new resmoke.py test suite for ... Closed
Backwards Compatibility: Fully Compatible
Backport Requested:
v4.0
Sprint: TIG 2018-07-30, TIG 2018-08-13
Participants:
Story Points: 3

 Description   

The JSON config files should live in a directory called src/third_party/mongo-perf/mongoebench/. It should be possible to rerun the vendoring script and automatically update them to pick up on new and modified mongo-perf test cases. We'll likely want to filter out test cases which rely on capped collections or server-side JavaScript.



 Comments   
Comment by Githook User [ 22/Sep/18 ]

Author:

{'name': 'Max Hirschhorn', 'email': 'max.hirschhorn@mongodb.com', 'username': 'visemet'}

Message: SERVER-36069 Create script to vendor mongo-perf test cases.

The JavaScript test cases are converted into mongoebench-compatible JSON
config files by using the benchrun.py script's
--generateMongoeBenchConfigFiles command line option.

(cherry picked from commit 34f4a07baf2e164f604ce53fd092b7dc1792e9db)
Branch: v4.0
https://github.com/mongodb/mongo/commit/189dd0a7a0a15efb98d5a0349964ac4ca92e06bb

Comment by Jonathan Abrahams [ 07/Aug/18 ]

max.hirschhorn My test script failed to produce a result file, due a bug in the script, so all is fine now!

Comment by Githook User [ 06/Aug/18 ]

Author:

{'name': 'Max Hirschhorn', 'email': 'max.hirschhorn@mongodb.com', 'username': 'visemet'}

Message: SERVER-36069 Create script to vendor mongo-perf test cases.

The JavaScript test cases are converted into mongoebench-compatible JSON
config files by using the benchrun.py script's
--generateMongoeBenchConfigFiles command line option.
Branch: master
https://github.com/mongodb/mongo/commit/34f4a07baf2e164f604ce53fd092b7dc1792e9db

Comment by Max Hirschhorn [ 06/Aug/18 ]

jonathan.abrahams, I didn't see any log output in the attached adb.log file saying "createCollection: Geo_geoJSON...". Could you confirm that the log output is the entirety of what you collected when running mongoebench on the Android device?

Comment by Jonathan Abrahams [ 02/Aug/18 ]

Tests which failed to generate a results file:

  • geo_geo_json_near_sphere_2dsphere_find.json
  • geo_geo_json_near_sphere_2dsphere_find_one.json
  • geo_geo_json_near_sphere_2dsphere_with_filter_find30.json
  • geo_geo_json_within_2dsphere_centersphere.json
Comment by Jonathan Abrahams [ 02/Aug/18 ]

max.hirschhorn I've attached adb.log which has failures from running mongoebench on an Android device.

Comment by Jonathan Abrahams [ 01/Aug/18 ]

The following tests fail when run under mongoebench:

  • queries_identity_view_int_id_find_one.json

    ./mongoebench queries_identity_view_int_id_find_one.json --output=mongoebench.queries_identity_view_int_id_find_one.1.0.json --dbpath=/data/db/mongoebench --time=5.0
    ...
    2018-08-01T11:24:26.339-0400 I QUERY    [thread1] assertion CommandNotSupportedOnView: Namespace test0.Queries_IdentityView_IntIdFindOne0 is a view, not a collection ns:test0.Queries_IdentityView_IntIdFindOne0 query:{ _id: 26 }
    

  • queries_identity_view_int_non_id_find_one.json

    ./mongoebench queries_identity_view_int_non_id_find_one.json --output=mongoebench.queries_identity_view_int_id_find_one.1.0.json --dbpath=/data/db/mongoebench --time=5.0
    ...
    2018-08-01T11:25:23.475-0400 I QUERY    [thread1] assertion CommandNotSupportedOnView: Namespace test0.Queries_IdentityView_IntNonIdFindOne0 is a view, not a collection ns:test0.Queries_IdentityView_IntNonIdFindOne0 query:{ _id: 14 }

Generated at Thu Feb 08 04:41:56 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.