[SERVER-44314] Fuzzer tasks not merging corpus Created: 30/Oct/19  Updated: 29/Oct/23  Resolved: 12/Nov/19

Status: Closed
Project: Core Server
Component/s: None
Affects Version/s: None
Fix Version/s: 4.3.1

Type: Bug Priority: Major - P3
Reporter: Spencer Jackson Assignee: Sara Golemon
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Backwards Compatibility: Fully Compatible
Operating System: ALL
Sprint: Security 2019-11-18
Participants:

 Description   

This task run successfully:
https://evergreen.mongodb.com/task/mongodb_mongo_master_ubuntu1804_debug_aubsan_lite_fuzzer_libfuzzertests_1c4b9635631a8408b626fa9259d1c83860c0c054_19_10_30_00_58_16/0

However, the corpus merge task actually failed:

[2019/10/30 11:14:56.111] Running command 'shell.exec' (step 12 of 15)
 [2019/10/30 11:14:56.113] set -o errexit
 [2019/10/30 11:14:56.113] ./buildscripts/merge_corpus.sh
 [2019/10/30 11:14:56.113] set -o errexit
 [2019/10/30 11:14:56.113] input="build/libfuzzer_tests.txt"
 [2019/10/30 11:14:56.113] corpus_dir="corpus"
 [2019/10/30 11:14:56.113] if [ ! -f $input ] || [ ! -d $corpus_dir ]; then
 [2019/10/30 11:14:56.113]     echo "Missing corpus information"
 [2019/10/30 11:14:56.113]     exit 0
 [2019/10/30 11:14:56.113] fi
 [2019/10/30 11:14:56.113] # We need to merge the corpus once it has been tested
 [2019/10/30 11:14:56.113] while IFS= read -r line
 [2019/10/30 11:14:56.113] do
 [2019/10/30 11:14:56.113]     mkdir "$corpus_dir"/corpus-"${line##*/}"-new
 [2019/10/30 11:14:56.113]     ./"$line" "$corpus_dir"/corpus-"${line##*/}"-new "$corpus_dir"/corpus-"${line##*/}" -merge=1
 [2019/10/30 11:14:56.113] done < "$input"
 [2019/10/30 11:14:56.114] mkdir: cannot create directory 'corpus/corpus-bson_validate_fuzzer-new': File exists
 [2019/10/30 11:14:56.115] Command failed: command encountered problem: exit status 1
 [2019/10/30 11:14:56.115] Running command 'archive.targz_pack' in "archive new corpus" (step 13 of 15)
 [2019/10/30 11:15:35.581] Running command 's3.put' in "upload new corpus" (step 14 of 15)
 [2019/10/30 11:15:35.609] Putting corpus.tgz into https://s3.amazonaws.com//fuzzer-artifacts/mongodb-mongo-master/corpus/mongo-ubuntu1804-debug-aubsan-lite_fuzzer-latest.tgz
 [2019/10/30 11:15:35.626] performing s3 put to fuzzer-artifacts of mongodb-mongo-master/corpus/mongo-ubuntu1804-debug-aubsan-lite_fuzzer-latest.tgz [1 of 10]
 [2019/10/30 11:15:37.422] Running command 'shell.exec' in "remove files" (step 15 of 15)



 Comments   
Comment by Githook User [ 12/Nov/19 ]

Author:

{'name': 'Sara Golemon', 'username': 'sgolemon', 'email': 'sara.golemon@mongodb.com'}

Message: SERVER-44314 Refactor merge_corpus.sh
Branch: master
https://github.com/mongodb/mongo/commit/5616923be4dfce1b2e938f8be5819f25e891c2b8

Generated at Thu Feb 08 05:05:39 UTC 2024 using Jira 9.7.1#970001-sha1:2222b88b221c4928ef0de3161136cc90c8356a66.