Aric Gardner [Mon, 5 Aug 2019 17:32:04 +0000 (13:32 -0400)]
Exit 0 if release job has already tagged a repo.
The release merge job is a one way operation.
Given this, Release jobs should only exist in the format
{project-name}-release-verify
and
{project-name}-release-merge
They should trigger from a change to any branch/**
As a developer working on {example-branch} will not want to
check out master to push a new release file.
Edge Cases:
Inevitably a release file will be pulled in from master to {example-branch}
or a remerge will be requested
This will again trigger the release jobs.
since in this case the repo is already tagged, the job should not report
a failure.
This is solved by having the verfiy and merge exit 0 when the repo is already tagged
if git tag -v "$VERSION"; then
echo "Repo already tagged $VERSION"
echo "This job has already run exit 0"
exit 0
if
Example Workflow - Milestone 0 is released from master:
releases/1.4.0.yaml (on branch master)
tag: 1.4.0
log_dir: 'optf-osdf-maven-stage-master/97/'
Repo is tagged and artifact is pushed!
Milestone 3 is released from dublin:
releases/1.4.3.yaml (on branch dublin)
tag: 1.4.3
log_dir: 'optf-osdf-maven-stage-dublin/20/'
Repo is tagged and artifact is pushed!
Note:
the ref is determined by the log file.
So We could check if this ref can be found on the {branch}
to reduce human errors.
example:
odlparent-maven-stage-4.0.x/152/patches/taglist.log.gz
has:
odlparent
c8964051cf81e2bd5d831fe6e5d568c5eedeeb8e
Psudo code:
STREAM=${STREAM:-'nostream'}
echo "--> Checking if $ref is on stable/$STREAM"
if ! (git branch -a --contains $ref | grep "stable/$STREAM"); then
echo "--> ERROR: $ref for $repo is not on stable/$STREAM!"
fi
Also in this patch:
To reduce possible errors:
Don't get project name from the release file:
PROJECT="$(niet ".project" "$release_file")"
we can just use ${PROJECT//\//-} when we need
the /'s changed to -'s
It will allways be correct when passed to jenkins
from gerrit
Also remove quiet from wget,
if there is a failure I want to see it on the console.
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I1e95e864bc2b49a62b3f7016cb2f1292a6687d9a
Aric Gardner [Sun, 4 Aug 2019 23:26:45 +0000 (23:26 +0000)]
Merge "Add release notes for lftools v0.25.3 release"
Anil Belur [Sun, 4 Aug 2019 22:55:50 +0000 (08:55 +1000)]
Improve the release job script
Change-Id: Ie62e2f3771632012423e0b791aca1551b4b31112
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Sun, 4 Aug 2019 08:35:30 +0000 (18:35 +1000)]
Update the release job tigger
Update release job template to tigger on any branch name, and not just
'**/master'. ODL projects branches are version '4.0.x' which requires
passing the branch name to the template.
Issue: RELENG-2129
Change-Id: I9c29d1c986fee73f6bad4fe39af8f9ffbda201c6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Sun, 4 Aug 2019 01:08:22 +0000 (11:08 +1000)]
Add release notes for lftools v0.25.3 release
This was missed in CR Id64b36e8f59d500800d6b9078f56b314348ed1f2
Change-Id: Ie5412ea5724db51fe1eb73fd5f9370b2b6e3b6d2
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Aric Gardner [Sat, 3 Aug 2019 15:59:44 +0000 (11:59 -0400)]
Verify job needs target/variable switch
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I46501ed93f873c87a7d297398c1eb0dc9d23700f
Jessica Wagantall [Fri, 2 Aug 2019 23:04:08 +0000 (16:04 -0700)]
Fix release-job.sh
Use {GERRIT_PROJECT} when calling Gerrit in
release-merge job.
Change-Id: I0d62d5c713858e7e43b2fc6a6462813b01bea2f8
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Andrew Grimberg [Fri, 2 Aug 2019 22:42:47 +0000 (15:42 -0700)]
Fix signing pubkey declaration
Change-Id: Id9fb1cfa8c992949266622e3a2ed2100e8bc78f6
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Aric Gardner [Fri, 2 Aug 2019 21:48:04 +0000 (21:48 +0000)]
Merge "Update lftools version to v0.25.3"
Anil Belur [Fri, 2 Aug 2019 09:34:31 +0000 (19:34 +1000)]
Handle multiple repos listed in staging-repo.
Handle multiple repos listed in staging-repo for ODL.
Also multiple release files in the same commit will not work.
exiting if this case is detected
Also
git diff HEAD^1 --name-only
is bad. if there is another merge it fails.
Change to
git diff-tree --no-commit-id -r $GERRIT_PATCHSET_REVISION \
--name-only -- "releases/"
StrictHostKeyChecking is enabled on the builder.
disabled
Also needed to change
{jenkins-ssh-credential}
to
{jenkins-ssh-release-credential}
Also
Give group ``self-serve-release`` Forge Committer rights
on refs/tags/
and allow on Create Signed Tag Create Annotated Tag
Also
- file-id: signing-pubkey
target: SIGNING_PUBKEY
Also fix nexus url needs https://
Issue: RELENG-2129
Change-Id: I55dc0a4022f93a6c3c0f389c04c88c38c53eff64
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Fri, 2 Aug 2019 21:34:35 +0000 (07:34 +1000)]
Update lftools version to v0.25.3
Change-Id: Id64b36e8f59d500800d6b9078f56b314348ed1f2
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jessica Wagantall [Fri, 2 Aug 2019 02:11:16 +0000 (19:11 -0700)]
Add upgrade information
Add upgrade information for commit
729b2e3535f009a146719df7d7b52e036b2505cb
Change-Id: Id27a14aaff31153dad534794ef70534d0bfe8bf7
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Aric Gardner [Fri, 2 Aug 2019 01:27:18 +0000 (21:27 -0400)]
Import the pubkey and check the tag
with git tag -v $VERSION
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I954dfa1c8ca09f64ff8a35c138290565de8de4b9
Aric Gardner [Thu, 1 Aug 2019 18:09:34 +0000 (14:09 -0400)]
Project pattern was incorrectly set to **
must be {project}
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ic2db72185a3b2e2eb22011b2bc5e8f6012c235c3
Anil Belur [Wed, 31 Jul 2019 23:39:20 +0000 (23:39 +0000)]
Merge "Self serve release docs"
Aric Gardner [Wed, 19 Jun 2019 18:10:42 +0000 (14:10 -0400)]
Self serve release docs
And code fixes for new:
jenkins-ssh-release-credential
Fix in release-job.sh
These were overlooked for merge:
git config user.name
git config user.email
gerrit_ssh=$(echo "$GERRIT_URL" | awk -F"/" '{print $3}')
git remote set-url origin ssh://"$RELEASE_USERNAME"@"$gerrit_ssh":29418/$PROJECT
Also included a small capitalization fix in lf-info-vote.rst
ISSUE: RELENG-2127
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I11ad122153d71a3d25d6b8839e09435f8b27b19d
Andrew Grimberg [Wed, 31 Jul 2019 22:17:17 +0000 (22:17 +0000)]
Merge "Log $JOB_NAME with the jjb-deploy"
Jessica Wagantall [Wed, 31 Jul 2019 22:15:21 +0000 (22:15 +0000)]
Merge "Update lf-info-yaml-verify"
Anil Belur [Mon, 29 Jul 2019 01:33:00 +0000 (11:33 +1000)]
Log $JOB_NAME with the jjb-deploy
Change-Id: Ifb2715402dc1dcb21708e4dc8851e0c621d59145
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Wed, 31 Jul 2019 22:03:18 +0000 (22:03 +0000)]
Merge "Consolidate lf-infra-jjbini with JJB 2.0"
Anil Belur [Mon, 29 Jul 2019 03:35:20 +0000 (13:35 +1000)]
Consolidate lf-infra-jjbini with JJB 2.0
There is no need to have two separate versions of the
macro anymore since we are already on JJB 2.0
Change-Id: I2295489f8d0bebf9e1628db91c38e74d3839b8a0
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jessica Wagantall [Tue, 30 Jul 2019 01:05:00 +0000 (18:05 -0700)]
Update lf-info-yaml-verify
Move info-schema to schema/info-schema.yaml
to keep schemas consistency.
Download only needed files for lf-info-yaml-verify
rather than cloning the entire repo.
Issue: RELENG-2242
Change-Id: Ie135c761d1401957be33c98634467967cc085ce2
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 30 Jul 2019 21:05:21 +0000 (21:05 +0000)]
Merge "Extend sonatype-clm.sh goals"
Jessica Wagantall [Tue, 30 Jul 2019 00:32:05 +0000 (17:32 -0700)]
Fix wget release-schema.yaml
Download raw version of release-schema.yaml to
compare against release files using lftools.
Issue: RELENG-2131
Change-Id: I82b505260ff172ddb47ad0e58e8721f91ed98581
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 30 Jul 2019 00:14:25 +0000 (17:14 -0700)]
Fix release-job.sh Nexus proxy var - 2
Avoid the usage of project specific variables.
Do not use ODLNEXUSPROXY var, but instead use
a generalized variable.
Commit
118b7cbf171aca498d1a0a3a485bad990ad2e7b6
missed this variable.
Issue: RELENG-2131
Change-Id: I3adee1f41616495aab3afe262e8fa70902d619f7
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Sat, 27 Jul 2019 02:08:16 +0000 (19:08 -0700)]
Extend sonatype-clm.sh goals
Allow to configure maven goals in
lf-maven-clm to allow running test in
some projects.
Issue: RELENG-2236
Change-Id: I83c0efb8b3749483554bf4c1db04ea77c2d17cd7
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 23 Jul 2019 19:39:46 +0000 (12:39 -0700)]
Update staging jobs triggers
- Allow lf-maven-stage jobs to be triggered
using either "stage-release" or "stage-maven-release".
- Allow lf-maven-docker-stage jobs to be triggered
using either "stage-release" or "stage-docker-release".
Change-Id: I133063d0cf99ab9b6a06b452ac392959bc678b39
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 26 Jul 2019 21:27:43 +0000 (14:27 -0700)]
Pin numpy to 1.16.4
numpy numpy-1.17.0 requires python 3.5
Change-Id: I4bfffcf2bd7b4cf8c9246d15b6fbe819d86e695d
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Andrew Grimberg [Fri, 26 Jul 2019 19:51:55 +0000 (19:51 +0000)]
Merge "Add packer image $NAME in description setting"
Jessica Wagantall [Fri, 26 Jul 2019 17:54:44 +0000 (10:54 -0700)]
Upgrade wss-unified-agent
Upgrade to the WhiteSource Unified Agent
version 19.7.1.
Issue: RELENG-2237
Change-Id: Iac87fc09597a79586718cc3b07ec7034e4a95c13
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Anil Belur [Wed, 24 Jul 2019 12:17:27 +0000 (22:17 +1000)]
Add packer image $NAME in description setting
Add packer image $NAME in description setting so that the image name
is displayed above the job logs URL. This saves a little time from
looking for the image name in the console logs.
Tested:
https://jenkins.opendaylight.org/releng/view/packer/job/builder-packer-merge-centos-7-builder/57/
Issue: RELENG-2230
Change-Id: Id86ee9795e1bfd50850c4833fc6f90545367f113
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Thu, 18 Jul 2019 16:03:54 +0000 (16:03 +0000)]
Merge "Add option to pass JAVA_OPTIONS"
Suresh Channamallu [Tue, 16 Jul 2019 17:36:29 +0000 (13:36 -0400)]
Add option to pass JAVA_OPTIONS
JAVA_OPTIONS are required to execute sonar jobs
Currently there is no options to pass this variable
so adding this option to pass from the project.yaml
Issue: RELENG-2152
Signed-off-by: Suresh Channamallu <schannamallu@linuxfoundation.org>
Change-Id: I0842f222fc7abf11b258b0691167b701bb319458
Jessica Wagantall [Tue, 16 Jul 2019 01:06:39 +0000 (18:06 -0700)]
Fix release-job schema and central url
Perform "lftools schema verify" command to validate the release files
against schema/release-schema.yaml
Obtain optional maven central URL inside the loop that scans release
files.
Issue: RELENG-2131
Change-Id: I6af1cbb32f25ad33385bac176dc57021d94a5043
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Andrew Grimberg [Fri, 12 Jul 2019 18:02:26 +0000 (18:02 +0000)]
Merge "Fix release-job.sh version var"
Jessica Wagantall [Fri, 28 Jun 2019 01:17:24 +0000 (18:17 -0700)]
Fix release-job.sh version var
Allow only semantic release versions like
"v${SEMVER}" or "${SEMVER}".
Fail the script if the version is not valid.
Do not append any additional characters to the
release version during tagging and pushing steps.
In this case, if the user wants to use the prefixed
"v", they can define it in the releases/*.yaml as:
version: 'v1.0.0'
Issue: RELENG-2131
Change-Id: I71f32600d3e17ec117776be6764c2e45ee934bdd
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Andrew Grimberg [Fri, 12 Jul 2019 15:15:29 +0000 (15:15 +0000)]
Merge "Set $JAVA_HOME for openjdk12 on CentOS7"
Thanh Ha [Wed, 10 Jul 2019 02:12:48 +0000 (22:12 -0400)]
Use prettier for automatic formatting for YAML
No more debate on style formatting, prettier is an opinionated
style formatter that will automatically format to the right
style.
Signed-off-by: Thanh Ha <zxiiro@gmail.com>
Change-Id: If9aae2087c3299ae5d54728cd17d86c2b0dcb8a0
Thanh Ha [Wed, 10 Jul 2019 02:14:36 +0000 (22:14 -0400)]
Fix formatting to prettier style
Refer to If9aae2087c3299ae5d54728cd17d86c2b0dcb8a0 for details
on the implementation.
Signed-off-by: Thanh Ha <zxiiro@gmail.com>
Change-Id: If845d7ecf8ee229bdd2407038cfe6bb0e2a9194f
Jessica Wagantall [Sat, 29 Jun 2019 01:37:20 +0000 (18:37 -0700)]
Add release-schema
Add schema file used to verify releases yaml file
contents during lf-release-jobs
Issue: RELENG-2131
Change-Id: I8466269333f6f6597ee2a3b1c55b3140c1ea1e23
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Wed, 10 Jul 2019 18:56:05 +0000 (18:56 +0000)]
Merge "Standardize "release" wording"
Anil Belur [Wed, 10 Jul 2019 11:17:58 +0000 (21:17 +1000)]
Set $JAVA_HOME for openjdk12 on CentOS7
Issue: RELENG-2202
Change-Id: Ib2a53613bfb3b6f1ee388d2f621356b1cefb185e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Wed, 10 Jul 2019 08:50:17 +0000 (08:50 +0000)]
Merge "Add workaround for javadoc verify jobs"
Anil Belur [Wed, 10 Jul 2019 08:49:49 +0000 (08:49 +0000)]
Merge "Fix script indent to 4 spaces"
Anil Belur [Wed, 10 Jul 2019 00:12:22 +0000 (00:12 +0000)]
Merge "Handle stack removal with the force option"
Jessica Wagantall [Fri, 28 Jun 2019 22:14:52 +0000 (15:14 -0700)]
Standardize "release" wording
Using "releases" and "release" in different places
is becoming a little confusing. Standardize to "release"
to match lftools command and the majority of the exisiting
wording.
Using "releases" for the list of tech team releases does
makes sense to be kept that way, for example:
releases/1.1.1.yaml
Issue: RELENG-2131
Change-Id: I9a9a548947cc1acbe3e61bb8fa6532a89fb17e16
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 9 Jul 2019 22:45:59 +0000 (22:45 +0000)]
Merge "Fix typo and sphinx doc formatting"
Anil Belur [Mon, 8 Jul 2019 22:35:40 +0000 (08:35 +1000)]
Handle stack removal with the force option
Issue: RELENG-2058
Change-Id: I7e428c6b3a5dd0c21f10b368cb8e9584d5e77648
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Mon, 8 Jul 2019 09:40:31 +0000 (19:40 +1000)]
Remove orphaned ports on the cloud env
Issue: RELENG-2059
Change-Id: I0ce6e5c832d5d9481ae1f13d85716da4cab774f8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Sun, 7 Jul 2019 07:50:03 +0000 (17:50 +1000)]
Fix typo and sphinx doc formatting
Change-Id: I6ad71ca93e2e258bb4a628f38acc12431d92447d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Sun, 7 Jul 2019 00:31:16 +0000 (10:31 +1000)]
Fix script indent to 4 spaces
Change the indent to 4 spaces which is consistant with
rest of scripts in the repo.
Add missing script anchor for debugging.
Change-Id: I543441162636b2931665b16ddc50836c11dfd7f8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Fri, 5 Jul 2019 01:04:09 +0000 (11:04 +1000)]
Add workaround for javadoc verify jobs
Nexus unpack plugin throws a "504 gateway timeout" for jobs archiving
large number of small files. Remove the workaround only we move away
from using Nexus as the log server.
Tested the workaround with javadoc-verify job.
https://logs.opendaylight.org/releng/vex-yul-odl-jenkins-1/bgpcep-maven-javadoc-verify-sodium-openjdk8/189
Issue: IT-16635
Change-Id: Ic7b0e3a56800312e3bcb888b4d35f9ccfd2d5018
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jessica Wagantall [Fri, 5 Jul 2019 19:26:17 +0000 (12:26 -0700)]
Configure mvn-goals in maven-sonar.sh
Extend maven-sonar.sh to allow configuration of
maven goals for the build step. Set to default as
"clean install".
This change will not cause any issue for projects
already using this job.
Issue: RELENG-2184
Change-Id: Ic8fe16de24097ec9ef805a24de4cebaef934fb04
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Thu, 4 Jul 2019 02:09:20 +0000 (19:09 -0700)]
Fix release-job.sh Nexus proxy var
Avoid the usage of project specific variables.
Do not use ODLNEXUSPROXY var, but instead use
a generalized variable.
Projects using lf-release-jobs need to make
sure they have the global variable NEXUSPROXY
added in Jenkins production and Jenkins sandbox
servers.
The value of this variable should be the URL to
the project's Nexus server.
Issue: RELENG-2131
Change-Id: Ia33c106c3c0ff86e57064deb74fb3863fcd90bdc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Anil Belur [Tue, 2 Jul 2019 21:33:55 +0000 (07:33 +1000)]
Upgrade lftools to version v0.25.2
Change-Id: I211297034a7cd6629ce93fe5e1f31ef0ea5054f8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Wed, 26 Jun 2019 22:32:09 +0000 (15:32 -0700)]
Upgrade lftools to version v0.25.1
Change-Id: I98d8505aa8e293cb9c5ebe6193284e207e0930b1
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Jessica Wagantall [Fri, 21 Jun 2019 18:31:34 +0000 (11:31 -0700)]
Fix releases-merge job
Add missing git-url variable in {project-name}-releases-merge-{stream}
job.
Change-Id: I8888b6fce6049de252e537c140c542c2945b3ff1
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 21 Jun 2019 18:11:54 +0000 (11:11 -0700)]
Add {stream} to releases jobs
Add the {stream} variable to the verify and merge
releases jobs to make them:
{project-name}-releases-verfy-{stream} and
{project-name}-releases-merge-{stream}
Change-Id: I63dcd51ea5d6eaf2eb57442f72f7e2f339070a7d
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 14 Jun 2019 23:07:47 +0000 (16:07 -0700)]
Allow version-properties-file parameter
Some ONAP components like DCAEGEN2 do not host a version.properties file
in the root of their repos. We need to be able to provide a location and/or
different name for the version.properties file for jobs using the
lf-maven-versions-plugin builder step.
Issue: RELENG-2136
Change-Id: Ie5ae50887276bf8a4f8da3f865cf35e6a2292494
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Anil Belur [Thu, 13 Jun 2019 21:52:10 +0000 (07:52 +1000)]
Update lftools version to **v0.25.0**
Change-Id: Ie72f9250e94c84b94b94f7e68f3fe8eb5dc4ef76
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Thu, 13 Jun 2019 21:18:24 +0000 (21:18 +0000)]
Merge changes from topic "lf-release-jobs"
* changes:
Add lf-release-jobs test and group
Add fixes for lf-release-jobs
Jessica Wagantall [Wed, 12 Jun 2019 23:55:41 +0000 (16:55 -0700)]
Add lf-release-jobs test and group
- Group {project-name}-releases-verify and {project-name}-releases-merge
into {project-name}-gerrit-release-jobs.
- Add test jobs for lf-release-jobs.
Issue: RELENG-1657
Change-Id: I20b7348b299fda2333119326f9861f24d1645ec2
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Wed, 12 Jun 2019 23:53:02 +0000 (16:53 -0700)]
Add fixes for lf-release-jobs
- Add missing scm block in gerrit-releases-merge job definition.
- Add missing submodule-disable for jobs using lf-infra-gerrit-scm.
- Add missing submodule-timeout variable in lf-releases-merge
- Remove submodule "Optional parameters" documentation for
gerrit-releases-merge and gerrit-releases-verify.
Issue: RELENG-1657
Change-Id: I656fe6d27773022581cba9d8bb6c448ba97cf8e5
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Lott, Christopher (cl778h) [Thu, 13 Jun 2019 02:01:56 +0000 (22:01 -0400)]
Use login shell in docker-get-container-tag.sh
Add -l to /bin/bash shebang line at top of docker-get-container-tag.sh
to make it a login shell, which automatically includes
/home/jenkins/.local/bin on the path, because that is where pip
installs the yq command.
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I6b715b8d3757414344fe154d9b8a0d44feb1daaa
Lott, Christopher (cl778h) [Wed, 12 Jun 2019 18:00:04 +0000 (14:00 -0400)]
Add missing $ in shell command
Add missing $ to variable tag_file so the yq query can pull
the tag from the container-tag.yaml file.
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: If1d99fca46f2a0cc6ea8328d7ed1b1495c7af116
Andrew Grimberg [Mon, 10 Jun 2019 19:31:59 +0000 (19:31 +0000)]
Merge "typo and add link for jenkins Managed Files"
Daniel Pono Takamori [Mon, 10 Jun 2019 18:58:59 +0000 (11:58 -0700)]
typo and add link for jenkins Managed Files
Change-Id: Ifc86f759b6fb732d76a93f79d1caca2bfbafb9c3
Signed-off-by: Daniel Takamori <dtakamori@contractor.linuxfoundation.org>
Lott, Christopher (cl778h) [Mon, 10 Jun 2019 14:56:30 +0000 (10:56 -0400)]
Refactor templates and scripts for container tag
Change parameter names used to specify container tag method,
with a new default to use the fixed string 'latest' as a tag.
Merge two shell scripts into one instead of using Jenkins
conditional steps.
Extend to accept a custom directory for the container-tag.yaml
if the yaml-file method is used to set the docker tag information;
this is an optional variable which is set to empty by default,
and falls back to DOCKER_ROOT.
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I19a8809650fa29706acaf0f06f4b666bef0067d7
Anil Belur [Fri, 7 Jun 2019 02:13:59 +0000 (12:13 +1000)]
Update lftools version v0.24.0
Change-Id: Ieee1cb98c5ed7e191bd208213aa8663de6cb2ed4
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Thu, 6 Jun 2019 23:45:23 +0000 (09:45 +1000)]
Add missing closing bracket
Patch I45070e0b364136b28e4130aed3972603e8c2e3c1 caused a regression
which broke the image protection code due to missing square bracket.
Signed-off-by: Thanh Ha <zxiiro@gmail.com>
Change-Id: I6ceed9f7243425e43748824036e2ebd431906eec
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Thu, 6 Jun 2019 21:31:18 +0000 (07:31 +1000)]
Add numpy to tox.ini
Change-Id: I358a77f71e86f0c86966fbc6e1eb7389e3268cdd
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jessica Wagantall [Tue, 4 Jun 2019 22:47:29 +0000 (15:47 -0700)]
Add yamllint to info-file-validate.sh
Run yamllint as part of info-file-validate.sh
to catch lint errors.
Change-Id: I4bf3e85b69481f7e5cdca989af1e7ec034966538
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Lott, Christopher (cl778h) [Mon, 3 Jun 2019 14:12:12 +0000 (10:12 -0400)]
Add trigger-on-cron to docker merge job
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Change-Id: I6e1d46d3b4e10a5e694201aeb493a4ef152ee954
Lott, Christopher (cl778h) [Sat, 1 Jun 2019 11:25:27 +0000 (07:25 -0400)]
Add missing file-based triggers to docker templates
Includes gerrit_trigger_file_paths and github_included_regions.
In documention: add github_included_regions parameter and
correct gerrit_verify_triggers to gerrit_merge_triggers.
Change-Id: If1dd342d9fe8591028cd1fabcb7c830e41df2fe5
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Jessica Wagantall [Thu, 30 May 2019 00:43:45 +0000 (17:43 -0700)]
Update docker scripts
- docker-build: Allow DOCKER_ARGS to be empty. This is not
a required parameter, it can be empty.
- docker-get-git-describe: Remove container reference. The
CONTAINER_PUSH_REGISTRY already gets added in the docker-push
script. No need to add it again. Only process the tag variable.
- docker-get-yaml-tag: Rename image_name to image_build_tag
to match docker-get-git-describe. Add missing "DOCKER_NAME" in
the DOCKER_IMAGE. Only process the tag variable.
- docker-push: Update the correct image name and tag in the push
command.
Change-Id: Ic3aad7ae0f87b589ce5d57f6848f7e8e75f9b71e
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Thu, 30 May 2019 00:43:45 +0000 (17:43 -0700)]
Update lf-docker-jobs to enforce macro vars
Enforce the variables from "lf-docker-get-container-tag",
"lf-docker-build" and "lf-docker-push" to be carried over
when calling the macros. This avoids the issue of loosing
the value of the variables.
Update the test file to reflect the example better.
Change-Id: I5087b6fbd064d145fab4be8dad72ff196fdfa213
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Thu, 30 May 2019 17:55:50 +0000 (10:55 -0700)]
Move yq install to python-tools-install
This will allow future scripts to use yq package.
Change-Id: Ic855363698cfeb28c5f3428dd381f42c3ea5b1a3
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Thu, 30 May 2019 05:55:02 +0000 (22:55 -0700)]
Install yq in docker-get-yaml-tag.sh
Install yq which will be needed to read container-tag.yaml
Change-Id: I0f284675fe45cd2c408a4e1d6933673b744f2735
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Wed, 29 May 2019 21:10:40 +0000 (21:10 +0000)]
Merge "Add Docker Verify and Merge jobs"
Jessica Wagantall [Wed, 13 Feb 2019 18:13:19 +0000 (10:13 -0800)]
Add Docker Verify and Merge jobs
Add {project-name}-docker-verify-{stream} and
{project-name}-docker-merge-{stream} jobs.
Issue: RELENG-908
Change-Id: I009fea61fd4c13daebac0d14f5dc00e1a90011e7
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Tim Johnson [Mon, 27 May 2019 22:57:04 +0000 (15:57 -0700)]
Pass multiple pattern args in logs-deploy.sh
Pass multiple args from ARCHIVE_ARTIFACTS as separate '-p' arguments to
'lftools deploy'
RELENG-2039
Change-Id: I35475a20e499731aac454b66fbb347c7d861f609
Signed-off-by: Tim Johnson <tijohnson@linuxfoundation.org>
Anil Belur [Mon, 27 May 2019 01:21:12 +0000 (11:21 +1000)]
Revert "Pass multiple pattern args in logs-deploy.sh"
This reverts commit
2dcdf635f5b1d7feffa3af9fe4f15368a0f1ebe7.
The change does not handle the case when the archive artifacts
are empty.
Change-Id: I0601254373777078f86834bf52bedb37fda6cb65
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Tim Johnson [Fri, 17 May 2019 02:16:10 +0000 (19:16 -0700)]
Pass multiple pattern args in logs-deploy.sh
Pass multiple args from ARCHIVE_ARTIFACTS as separate '-p' arguments to
'lftools deploy'
RELENG-2039
Change-Id: I91fd4ddba273034f1568523c3694ac2605368663
Signed-off-by: Tim Johnson <tijohnson@linuxfoundation.org>
Aric Gardner [Wed, 16 Jan 2019 21:45:30 +0000 (16:45 -0500)]
Automate Artifact release
This will be adapted to work for ONAP/Other projects
once we are okay with this.
projects that want self-serve releases will create a
tagname.yaml file in the releases/ directory of their git repo.
Here is the change I have been testing in the sandbox
https://git.opendaylight.org/gerrit/#/c/80613/
example of a releases file:
$ cat releases/1.0.0.yaml
---
distribution_type: 'maven'
version: '1.0.0'
project: 'zzz-test-release'
log_dir: 'zzz-test-release-maven-stage-master/17/'
maven_central_url: 'oss.sonatype.org'
Issue: RELENG-1657
Change-Id: I02dc935a84425d194cdd8eaabe5b43c5920ce319
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Andrew Grimberg [Fri, 24 May 2019 17:24:29 +0000 (17:24 +0000)]
Merge "Fix info-vote job"
Anil Belur [Thu, 23 May 2019 01:11:55 +0000 (11:11 +1000)]
Update gerrit comment trigger keywords with regex
Update gerrit comment trigger to use standard regex
and avoid triggering jobs, when these keywords are used as
gerrit comments between users.
Change-Id: Iac67e9508fd600650c4ed351094cfdaf2e212835
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Tue, 21 May 2019 08:27:41 +0000 (18:27 +1000)]
Pin requests to 2.21.0
request-2.22.0 does not work with python-3.4.9, so pin requests
to 2.21.0.
Change-Id: I8f79fdd2ba2100eb41f0d5e9a23862950e07e7bc
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Aric Gardner [Tue, 14 May 2019 20:16:07 +0000 (16:16 -0400)]
Fix info-vote job
When majority voting checks out:
info-vote job must verify, sleep for a second,
and then submit based on GERRIT_PATCHSET_REVISION
change compare type from REGEX to ANT for file trigger
Replace comment-added with comment-added-event
Also remove the depreciated CDRV and only have Code-Review
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ie9477b0e0b3cfc193469fe55bc59eecae72ef756
Anil Belur [Tue, 14 May 2019 22:22:06 +0000 (22:22 +0000)]
Merge "Handle unbound arrays correctly"
Anil Belur [Tue, 14 May 2019 13:14:05 +0000 (23:14 +1000)]
Handle unbound arrays correctly
The change
cfe54b794b3814f288009b796e82668ba8846ca1 missed
handling unbound arrays with `set -u`.
Issue: RELENG-2013
Change-Id: Ic37ce0404f13bff04aa4122c9b1c91add78e2145
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Daniel Pono Takamori [Tue, 14 May 2019 20:50:21 +0000 (20:50 +0000)]
Merge "Fix builder steps in lf-maven-docker-stage"
Aric Gardner [Tue, 14 May 2019 19:17:17 +0000 (15:17 -0400)]
Change project comapre type to ANT
REG_EXP was the wrong compare type
Saw this in the logs:
Exception caught for project info-vote and pattern *, message: Dangling
meta character '*' near index 0
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I69bdda475ad85ee7aefafc559f25bdaf22a84ec3
Jessica Wagantall [Tue, 14 May 2019 18:59:14 +0000 (11:59 -0700)]
Fix builder steps in lf-maven-docker-stage
lf-maven-versions-plugin builder step needs to run before
maven-patch-release.sh as this second script contains a
condition to confirm if the maven vesions plugin was selected
as a way to remove the 'SNAPSHOT' pattern from the pom.xml
files.
lf-maven-docker-stage was based on lf-maven-stage and it
seems that these particular builder steps were switched in
place accidentally.
Change-Id: I30ac4af2a7566cb2c1072412a738f38d4f3318fb
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Anil Belur [Mon, 13 May 2019 23:38:16 +0000 (23:38 +0000)]
Merge "Handle multiple search extension passed by JJB"
Andrew Grimberg [Mon, 13 May 2019 21:15:06 +0000 (21:15 +0000)]
Merge "Update status-context to append java-version"
Suresh Channamallu [Fri, 10 May 2019 18:15:45 +0000 (14:15 -0400)]
Update status-context to append java-version
Multiple jobs created using same job-template updating same github check status
due to hard coded status-context to Maven Verify.
Now appending status-context with maven-version and java-version to make it unique.
Issue: RELENG-2027
Signed-off-by: Suresh Channamallu <schannamallu@linuxfoundation.org>
Change-Id: I2ae048a24c9c68e73ab0086cf05d327eb375856d
Andrew Grimberg [Mon, 13 May 2019 20:05:10 +0000 (13:05 -0700)]
Fix LOGS_SERVER to not be required
Change
0251b7fda7266760bd82a6e56a696160822a57a0 added in a regression
that forces LOGS_SERVER to be defined when it is not supposed to be
required for jobs.
Change-Id: I3800371e831616c9e9332d0a43e3721d8580a834
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Alexandru Avadanii [Wed, 8 May 2019 14:54:00 +0000 (16:54 +0200)]
gerrit-tox-verify: Allow skip-vote configuration
Add a new parameter controlling whether the Jenkins Gerrit Trigger
plugin should vote depending on the build outcome.
Change-Id: I0197b2df19e303a813df91e4c4e6120cc79456fc
Signed-off-by: Alexandru Avadanii <Alexandru.Avadanii@enea.com>
Anil Belur [Mon, 13 May 2019 09:05:24 +0000 (19:05 +1000)]
Handle multiple search extension passed by JJB
`lftools deploy archives` implementation supports '-p|--pattern'
as a multi-value option and does not support processing
multi-values as a single string.
Handle multiple search extension / patterns passed by upstream
${ARCHIVE_ARTIFACTS} param as a single string by spliting these values
before being passed to `lftools deploy archive`.
Issue: RELENG-2013
Change-Id: Id524a291a7fe03ea6f518def94b0f4ebf0974164
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Fri, 10 May 2019 19:03:21 +0000 (12:03 -0700)]
Pin pygments to 2.3.x
Pygments release 2.4.0 which added a python requires that excludes all
versions of Python < 3.5. The LFCI's default 3 version is 3.4 so causes
build failure.
Change-Id: Ide6d0da7357326c64153f0f74f328cee98429344
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>