Compress and upload the jjb-verify XML files 28/13828/3
authorAnil Belur <abelur@linuxfoundation.org>
Wed, 5 Dec 2018 09:19:33 +0000 (19:19 +1000)
committerAnil Belur <abelur@linuxfoundation.org>
Wed, 5 Dec 2018 11:30:39 +0000 (21:30 +1000)
commitacb1db1cf0efbeea7540866b500657d3dec935ce
treec25499b799d4274916dd28904f385b62f0f68a09
parent905318304cfc9faed813df54965b0b32d4abc3c1
Compress and upload the jjb-verify XML files

The present jjb-verify job that calls lftools maven
deploy archives for releng/builder which takes about ~8 mins to
complete uploading the archives. This is because the job generates
around ~2.3K XML files (small files) which is uploaded to Nexus.
This is possibly because the Nexus Unpack plugin in the Nexus
end unpacking the zip file we upload takes longer.

It's best to compress this into a single file and upload
to Nexus, potentially minimizing the Nexus logs from
bloating up since we have been seeing higher IOPs
and load managing these files in the backend cron jobs.

Compressing the job files before hand shaves off around
6-8 mins from the upload time, therefore reducing the
job time overall significantly.

Tested the change here:
https://jenkins.opendaylight.org/releng/job/builder-jjb-verify/4325

Change-Id: Ifb3ea6e61d28b234c79088ca128294a037ec511f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
releasenotes/notes/jjv-verify-compress-xml-files-71ae17abdfc79c2f.yaml [new file with mode: 0644]
shell/jjb-verify-job.sh