[SERVER-42319] Improve performance of Archive Builder Created: 22/Jul/19  Updated: 29/Oct/23  Resolved: 16/Aug/19

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 4.3.1

Type: Improvement Priority: Major - P3
Reporter: Mathew Robinson (Inactive) Assignee: Mathew Robinson (Inactive)
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Sprint: Dev Tools 2019-08-26
Participants:

 Comments   
Comment by Githook User [ 14/Aug/19 ]

Author:

{'username': 'chasinglogic', 'email': 'chasinglogic@gmail.com', 'name': 'Mathew Robinson'}

Message: SERVER-42319 Improve performance of Archive Builder
Branch: master
https://github.com/mongodb/mongo/commit/b73a7d6ab9d38382a6c2f1fd0b5c8369d54d8b95

Comment by Mathew Robinson (Inactive) [ 12/Aug/19 ]

Using the new method with aib_make_archive.py:

real	0m8.289s
user	0m0.450s
sys	0m4.852s

Comment by Mathew Robinson (Inactive) [ 12/Aug/19 ]

For reference on my machine build an archive with native tar:

real	0m12.954s
user	0m0.403s
sys	0m5.262s

Building it with aib_make_archive.py:

real	20m4.594s
user	19m54.936s
sys	0m4.969s

Note for the Python time above it only got about halfway done. This is because the tarfile module in Python is a pure python implementation of tar+gzip.

I'm going to modify aib_make_archive.py to check for the tar program on the system and call it for building tars if available.

Generated at Thu Feb 08 05:00:11 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.