[SERVER-21080] 12-14% Performance Regression on mongo-perf misc tests (Commands.CountsIntIDRange, Commands.DistinctWithoutIndex, Commands.DistinctWithoutIndexAndQuery, Mixed.FindOneUpdateIntId-50-50) Created: 08/Oct/15  Updated: 06/Dec/22  Resolved: 31/Jul/19

Status: Closed
Project: Core Server
Component/s: Performance
Affects Version/s: None
Fix Version/s: None

Type: Bug Priority: Major - P3
Reporter: David Daly Assignee: Backlog - Query Team (Inactive)
Resolution: Won't Do Votes: 0
Labels: mpreg, query-44-grooming
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Issue Links:
Related
is related to SERVER-20609 Performance Regression from 3.0.6 for... Closed
Assigned Teams:
Query
Operating System: ALL
Steps To Reproduce:

Shell reproductions

Commands.CountsIntIDRange

var setup = function( collection ) {
                  collection.drop();
                  var docs = [];
                  for ( var i = 0; i < 4800; i++ ) {
                      docs.push( { _id : i } );
                  }
                  collection.insert(docs);
                  collection.getDB().getLastError();
 }
 use test0
 setup(db.Commands_CountsIntIDRange0)
 benchRun({"ops":[{"op":"command","ns":"test0","command":{"count":"Commands_CountsIntIDRange0","query":{"_id":{"$gt":10,"$lt":100}}},"safe":false,"w":0,"j":false,"writeCmd":true}],"seconds":30,"host":"127.0.0.1:27017","parallel":8})

Commands.DistinctWithoutIndex

var setup = function( collection ) {
            collection.drop();
            var docs = [];
            for ( var i = 0; i < 4800; i++ ) {
                docs.push( { x : 1 } );
                docs.push( { x : 2 } );
                docs.push( { x : 3 } );
            }
            collection.insert(docs);
            collection.getDB().getLastError();
        };
use test0
setup(db.Commands_DistinctWithoutIndex0)
benchRun({"ops":[{"op":"command","tags":["distinct","command","core"],"ns":"test0","command":{"distinct":"Commands_DistinctWithoutIndex0","key":"x"},"safe":false,"w":0,"j":false,"writeCmd":true}],"seconds":30,"host":"127.0.0.1:27017","parallel":8})

Mixed.FindOneUpdateIntId-50-50

var setup =  function( collection ) {
                  collection.drop();
                  var docs = [];
                  for ( var i = 0; i < 4800; i++ ) {
                      docs.push( { _id : i , x : 0 } );
                  }
                  collection.insert(docs);
                  collection.getDB().getLastError();
}
use test0
setup(db.Mixed_FindOneUpdateIntId)
benchRun({"ops":[{"op":"let","target":"x","value":{"#RAND_INT_PLUS_THREAD":[0,100]},"ns":"test0.Mixed_FindOneUpdateIntId","safe":false,"w":0,"j":false,"writeCmd":true},{"op":"findOne","query":{"_id":{"#VARIABLE":"x"}},"ns":"test0.Mixed_FindOneUpdateIntId","safe":false,"w":0,"j":false,"writeCmd":true},{"op":"update","query":{"_id":{"#VARIABLE":"x"}},"update":{"$inc":{"x":1}},"ns":"test0.Mixed_FindOneUpdateIntId","safe":false,"w":0,"j":false,"writeCmd":true}],"seconds":5,"host":"127.0.0.1:27017","parallel":8})

Participants:

 Description   

12-14% reduction in through from 3.0.6 for MMAPv1

  • Commands.DistinctWithoutIndex
  • Commands.CountsIntIDRange
  • Mixed.FindOneUpdateIntId-50-50
  • Commands.DistinctWithoutIndexAndQuery

Smaller regression for wiredTiger.



 Comments   
Comment by Craig Homa [ 31/Jul/19 ]

Closing as this is an old report and it falls outside the process we're currently using for measuring and monitoring perf in the server.

Comment by Githook User [ 11/Dec/15 ]

Author:

{u'username': u'dalyd', u'name': u'dalyd', u'email': u'david.daly@mongodb.com'}

Message: Overrides for SERVER-21080
Branch: mc-test
https://github.com/10gen/dsi/commit/b4e804e53ecb0cc933199c966f61fd79ca3fdc06

Comment by David Daly [ 30/Nov/15 ]

Still failing. Latest results here

Some of the results are being suppresed, or else more boxes would be red.

Assigning to query team for now.

Comment by David Daly [ 22/Oct/15 ]

Some of these tests show some noise commit to commit. However, the regression is in addition to that noise.

Comment by David Daly [ 08/Oct/15 ]

WiredTiger shows some regression also. May or may not be the same.

Generated at Thu Feb 08 03:56:14 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.