[SERVER-64072] Upload compile/build times to Signal Processing. Created: 11/Feb/22  Updated: 29/Oct/23  Resolved: 28/Mar/22

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 6.0.0-rc0

Type: Task Priority: Critical - P2
Reporter: Robert Guo (Inactive) Assignee: Mikhail Shchatko
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Sprint: DAG 2022-03-07, DAG 2022-03-21, DAG 2022-04-04
Participants:
Story Points: 0

 Description   

Similar to the Google Benchmark integration, we want to get build times for SCons invocation activiites in the compile process. We should ping Drew so he is aware of this work and can add new metrics when he comes back.



 Comments   
Comment by Githook User [ 28/Mar/22 ]

Author:

{'name': 'Mikhail Shchatko', 'email': 'mikhail.shchatko@mongodb.com', 'username': 'MikhailShchatko'}

Message: SERVER-64072 Upload compile/build times to Signal Processing
Branch: master
https://github.com/mongodb/mongo/commit/f2adf371c8668950d02c26ba7ea38183cd0af473

Comment by Robert Guo (Inactive) [ 07/Mar/22 ]

Yep I'll discuss ownership with SDP since it's to support one of their systems.

Comment by Iryna Zhuravlova [ 07/Mar/22 ]

hey robert.guo, since Misha is out, who should continue working on this ticket? 

Comment by Daniel Moody [ 22/Feb/22 ]

some of the scons options have built in metrics around the debug option: https://scons.org/doc/4.2.0/HTML/scons-man.html#opt-debug

Probably the ones we care about are covered by using:

--debug=time,memory,count

Heres example output:

Command execution time: zip-dist-base: 0.000024 seconds
Command execution time: archive-mongo-debug: 0.000022 seconds
Command execution time: archive-platform-test-meta: 0.000021 seconds
Command execution time: archive-stitch-support-test-debug: 0.000021 seconds
Command execution time: build.ninja: 0.576917 seconds
Command execution time: generate-ninja: 0.000039 seconds
scons: done building targets.
Memory before reading SConscript files:     59064320
Memory after reading SConscript files:     194977792
Memory before building targets:            194977792
Memory after building targets:             341471232
Object counts:
       pre-   post-    pre-   post-   
       read    read   build   build   Class
          0    8217    8217   58181   Action.CommandAction
          0       4       4       4   Action.CommandGeneratorAction
          0      66      66      72   Action.FunctionAction
          0     281     281     281   Action.LazyAction
          0       6       6      12   Action.ListAction
          0    1494    1494    1494   Builder.BuilderBase
          0       2       2       2   Builder.CompositeBuilder
          0    5389    5389    5389   Builder.OverrideWarner
          0       3       3       3   Environment.Base
          0     282     282     282   Environment.EnvironmentClone
          0    2431    2431    2431   Environment.OverrideEnvironment
          0    9485    9485    9526   Executor.Executor
          0      92      92    4997   Executor.Null
          0   20724   20724   26686   Node.FS.Base
          0     560     560     597   Node.FS.Dir
          0    7060    7060    7069   Node.FS.File
          0   21619   21619   27581   Node.Node
Total build time: 22.649954 seconds
Total SConscript file execution time: 8.614944 seconds
Total SCons execution time: 0.773662 seconds
Total command execution time: 13.261348 seconds

Generated at Thu Feb 08 05:59:26 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.