releng/global-jjb.git
6 years agoMerge "Add triggers to jenkins-cfg job"
Thanh Ha [Wed, 28 Feb 2018 01:53:04 +0000 (01:53 +0000)]
Merge "Add triggers to jenkins-cfg job"

6 years agoGIT_URL variable corruption in script 57/9057/2
Thanh Ha [Tue, 27 Feb 2018 05:29:49 +0000 (00:29 -0500)]
GIT_URL variable corruption in script

Not sure why but GIT_URL seems to get corrupt inside of this
script. Use GERRIT_URL instead to clone patches.

Additionally also ignore a patch if a patch that matches the
Gerrit that triggered it is passed in.

Issue: RELENG-784
Change-Id: I85de941ad64d64597f69c1c924295b26e1dc1bec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd triggers to jenkins-cfg job 83/8883/1
Thanh Ha [Fri, 16 Feb 2018 19:55:55 +0000 (14:55 -0500)]
Add triggers to jenkins-cfg job

Allows the job to run on a timed trigger as well as on patch
merged events. Default timed trigger is run @daily.

Change-Id: I54b04e7814718816fe221a33d80aa1c1574095d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd local-{templates}.yaml path to packer pattern 78/8878/1
Thanh Ha [Thu, 15 Feb 2018 22:09:05 +0000 (17:09 -0500)]
Add local-{templates}.yaml path to packer pattern

Common packer supports local improvements via local-*.yaml files
so we need to add this to the file paths.

Change-Id: Id6d723a174de5f272cc267496279d7e79cef8b8f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoGit submodule update after fetching patch 59/8859/1
Thanh Ha [Wed, 14 Feb 2018 21:13:11 +0000 (16:13 -0500)]
Git submodule update after fetching patch

For projects that have submodules we need to call
`git submodule update` after fetching the patch so that
submodule updates caused by the patch are pulled in.

Running that command on a repo that does not contain submodules
returns cleanly as a noop.

Change-Id: Iec76e4c42d9e0132571af477f3ae770e5e360781
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd a note about requiring jjbini configuration 39/8839/1
Thanh Ha [Tue, 13 Feb 2018 18:21:45 +0000 (13:21 -0500)]
Add a note about requiring jjbini configuration

Document that jjbini needs to include JJB 2.0 style configuration
sections for the "production" and "sandbox" systems.

Change-Id: I102c57774a75bd1545f21a67bb2d98ccb0f270a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump version to 0.17.0-dev 30/8830/1
Thanh Ha [Mon, 12 Feb 2018 23:55:07 +0000 (18:55 -0500)]
Bump version to 0.17.0-dev

Change-Id: I9c352b633fcf83a0b60e2351401cd76c42df238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.16.0 86/8786/3 v0.16.0
Thanh Ha [Fri, 9 Feb 2018 19:12:42 +0000 (14:12 -0500)]
Release global-jjb v0.16.0

Change-Id: I6acf020cda29198ad930ceeffe08e09ad0c7d6bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoCreate job to manage Jenkins Global Variables 34/8434/8
Thanh Ha [Fri, 19 Jan 2018 00:24:56 +0000 (19:24 -0500)]
Create job to manage Jenkins Global Variables

Parses a configuration file containing variable listings in the form
"KEY=value" one per line and creates the appropriate groovy
script to push these environment variables to Jenkins Global Config.

Configuration file is stored in
ci-management/jenkins-config/global-vars-SILO.sh

(Where silo is production | sandbox)

While JJB provided us a way to store job configuration in a git repo
we have never had a good way to manage global Jenkins configuration.
This patch enables us to manage one aspect, Global Environment
variables in the ci-management repository.

Issue: RELENG-753
Change-Id: I7d134950b25d469686cace2f79fd8c297727166c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add pip.conf to wrappers"
Thanh Ha [Fri, 9 Feb 2018 18:13:01 +0000 (18:13 +0000)]
Merge "Add pip.conf to wrappers"

6 years agoUpdate submodule documentation 67/8767/2
Andrew Grimberg [Thu, 8 Feb 2018 21:26:14 +0000 (13:26 -0800)]
Update submodule documentation

Production deployments of global-jjb should be using the GitHub mirror
as their primary source as GitHub rarely has outages. This decouples the
master Gerrit instance from downstream consumption such that we are more
free to do maintenance whenever we desire.

Change-Id: I37139965902fa922cbb14f7ad01c22248bc1847b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoset +x around sensitive code docker login code 47/8747/1
Thanh Ha [Thu, 8 Feb 2018 04:19:43 +0000 (23:19 -0500)]
set +x around sensitive code docker login code

Call `set +x` as a guard just in case a script elsewhere is calling
`set -x` which could cause the credentials to print to console.

Change-Id: I6802887c7a3c9809d9d13d6b3cc90e3570f120fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd : to jjb-deploy: 81/8681/3
Jamo Luhrsen [Tue, 6 Feb 2018 03:28:23 +0000 (19:28 -0800)]
Add : to jjb-deploy:

This is more intuitive to me, as the keyword takes an
argument. I realized this when I used the ODL keyword
copy-logs:

Change-Id: Ic321d6be56ef518a2056099cb5690ea6880c16c2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd test to check for double curly braces 88/8688/1
Thanh Ha [Tue, 6 Feb 2018 16:36:31 +0000 (11:36 -0500)]
Add test to check for double curly braces

This will cause the build to fail if double curly braces are in
JJB output XML. This should help catch the JJB bug that adds
curly braces when using !include-raw-escape.

Issue: RELENG-777
Change-Id: Iaf9a9ef695229fa24dfc639ca60a4b9a9928a234
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRepair shell-include directive 85/8685/2
Christopher Lott (cl778h) [Tue, 6 Feb 2018 16:11:18 +0000 (11:11 -0500)]
Repair shell-include directive

Change stage macro to use include-raw instead of include-raw-escape to
work around a JJB bug that inserts lftools_activate with double braces.

Change-Id: Iec5e0b12a287f1945eedc895a25dd16e74b47082
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
6 years agoAdd maven metadata validator tool 75/8675/3
Thanh Ha [Mon, 5 Feb 2018 20:03:01 +0000 (15:03 -0500)]
Add maven metadata validator tool

Add a tool to validate maven-metadata.xml to catch timestamp issues
in builds and fail the build if a mismatch is detected.

Issue: RELENG-772
Change-Id: I35a7b9c3b12321a3a7af24ab36397e38ebb01de9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd pip.conf to wrappers 58/8658/3
Thanh Ha [Fri, 2 Feb 2018 20:46:58 +0000 (15:46 -0500)]
Add pip.conf to wrappers

This is a global-jjb breaking change as it now causes us to require
the pipconf file configured in Config File Provider. This allows us
to configure for projects that have Nexus 3 a PyPi proxy for faster
local downloads.

Contents of pip.conf should look something like:

[global]
timeout = 60
index-url = https://nexus3.opendaylight.org/repository/PyPi/simple

Change-Id: I4ac816f1b78f09c101e6d614bdd3c459fe0e133a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAllow goal override for maven-build macro 38/8438/2
Thanh Ha [Fri, 19 Jan 2018 01:24:26 +0000 (20:24 -0500)]
Allow goal override for maven-build macro

Splits out the maven-build into a macro that can be used
to allow projects to override the default goals if they
wish to tweak them for their projects.

Change-Id: I8cabbac997d165bfe8b68d76b78cdb4bb7cc4bbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSplit maven-stage script into a reusable macro 37/8437/2
Thanh Ha [Fri, 19 Jan 2018 01:16:13 +0000 (20:16 -0500)]
Split maven-stage script into a reusable macro

Change-Id: If8d2208e2469d295637a9e82545b2289e5a7588b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add sphinx link to rtd jobs page"
Thanh Ha [Fri, 2 Feb 2018 00:56:50 +0000 (00:56 +0000)]
Merge "Add sphinx link to rtd jobs page"

6 years agoMerge "Add Links to Plugins mentioned in README"
Thanh Ha [Thu, 1 Feb 2018 20:12:03 +0000 (20:12 +0000)]
Merge "Add Links to Plugins mentioned in README"

6 years agoFix local platform file path 37/8637/2
Thanh Ha [Thu, 1 Feb 2018 18:50:47 +0000 (13:50 -0500)]
Fix local platform file path

The local vars path is incorrect in the if-statement but
correct in the declaration below it. Update to match.

Change-Id: I1e8ec19adf842668fb46e54aaf8beebfcef9c34d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDisable unbound variable checking for activate 36/8636/1
Thanh Ha [Thu, 1 Feb 2018 18:15:04 +0000 (13:15 -0500)]
Disable unbound variable checking for activate

virtualenv activate contains unbound variables so must be disabled
when calling `source activate`.

Change-Id: I8af6b55962580778fbb349c8164f661c4c462928
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd sphinx link to rtd jobs page 35/8635/1
Thanh Ha [Thu, 1 Feb 2018 02:26:16 +0000 (21:26 -0500)]
Add sphinx link to rtd jobs page

Change-Id: I67bf0e81fd3e6156cd31dbb4700c8909cf2bf87d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agodeploy cleanup not removing all unmodified files 23/8623/1
Thanh Ha [Wed, 31 Jan 2018 22:00:23 +0000 (17:00 -0500)]
deploy cleanup not removing all unmodified files

The linting patch If87fceb79e384e26f021a9c85a2e9d7413ce421e
broke the cleanup script so unmodified maven-metadata.xml files
were not properly being cleaned up before upload to Nexus. This
caused the maven-merge job to update maven-metadata.xml files
outside of what was actually modified. So when 2 maven-merge jobs
running on different streams are run at the same time they would
overwrite each other with old data.

Issue: RELENG-766
Change-Id: I18da721bfb5db6eef9c15ffabd4482e0aa24e3a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoupdate docs to use minutes over seconds 13/8613/1
Sam Hague [Wed, 31 Jan 2018 13:31:56 +0000 (08:31 -0500)]
update docs to use minutes over seconds

Change-Id: Ia1e7b101ee6a3605d6c0ec4ac163a6f8c362921b
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoAdd Links to Plugins mentioned in README 92/8592/2
Trevor Bramwell [Tue, 30 Jan 2018 18:41:12 +0000 (10:41 -0800)]
Add Links to Plugins mentioned in README

Includes a link to the download location of the PostBuildScript plugin
since it is no longer being released.

Change-Id: Ia2d34921fa9d870fd5792d938f9b2844853a38e9
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoAdd script to update Java alternatives 93/8493/15
Jessica Wagantall [Wed, 24 Jan 2018 00:31:47 +0000 (16:31 -0800)]
Add script to update Java alternatives

Use ${java-version} to set the correct java, javac
and java_sdk_openjdk alternative for lf-maven-jobs.

Issue-ID: RELENG-752
Change-Id: Iff0c2e7d92c4cc802925ae67cdda1f4247db52be
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoRemove jdk variable from lf-maven-jobs 71/8471/3
Jessica Wagantall [Tue, 23 Jan 2018 00:14:53 +0000 (16:14 -0800)]
Remove jdk variable from lf-maven-jobs

Setting this variable to {java-version} creates some issues for
projects using the Ubuntu nodes as they need to use explicitly
'System' as their JDK version.

Change-Id: I0a12bc83f7c8c1c8fcdf8f2a1d5f47b8360b94c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoBump default timeout to 15 minutes for tox 80/8580/1
Thanh Ha [Mon, 29 Jan 2018 22:20:55 +0000 (17:20 -0500)]
Bump default timeout to 15 minutes for tox

Increase tox jobs default timeout to 15 minutes. Considering many
things appear to be taking longer in Vexxhost this is likely
necessary.

Change-Id: I592146b1f0d47a9aedfdc91c1878a6f94b3d363c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRefactor macro/template cron param 66/8566/3
Christopher Lott (cl778h) [Mon, 29 Jan 2018 17:51:21 +0000 (12:51 -0500)]
Refactor macro/template cron param

Be consistent with cron parameter: define in macro, use in template.
Never hard-code a trigger in a job template.
Document the parameters in the RST file.

Change-Id: I70a1deefd23bc9498f6c6013fb8751298dec7f53
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
6 years agoMerge "Split maven-deploy into a macro"
Andrew Grimberg [Mon, 22 Jan 2018 23:02:07 +0000 (23:02 +0000)]
Merge "Split maven-deploy into a macro"

6 years agoBump global-jjb to 0.16.0-dev 66/8466/1
Thanh Ha [Mon, 22 Jan 2018 21:47:11 +0000 (16:47 -0500)]
Bump global-jjb to 0.16.0-dev

Change-Id: I0f5e3d41bcdc3f6938208d3b710b20df9dfb5c70
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.15.0 56/8456/1 v0.15.0
Thanh Ha [Mon, 22 Jan 2018 02:02:41 +0000 (21:02 -0500)]
Release global-jjb v0.15.0

Change-Id: I1186feb6ff4fefb5311bcfb84ad34b4001b9cef7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoIncrease maven-jobs default timeout to 60 mins 43/8443/1
Thanh Ha [Fri, 19 Jan 2018 16:50:13 +0000 (11:50 -0500)]
Increase maven-jobs default timeout to 60 mins

The new Vexxhost cloud seems to be slower in general and
continuous to cause OpenDaylight grief when it comes to running
jobs. Increase the timeout to 60 mins to account for the slower
infra.

Change-Id: I04325ce9d700ac4879a17f1b0547bc0b861c7cac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSplit maven-deploy into a macro 36/8436/2
Thanh Ha [Fri, 19 Jan 2018 01:10:24 +0000 (20:10 -0500)]
Split maven-deploy into a macro

Split out maven-deploy into a reusable macro.

Change-Id: I6ddad68576cdbf9d9ef8b4805da94dc6a80cbefd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Improve verbosity in maven shell scripts"
Thanh Ha [Fri, 19 Jan 2018 01:02:36 +0000 (01:02 +0000)]
Merge "Improve verbosity in maven shell scripts"

6 years agoUse clean install for Sonar 31/8431/1
Thanh Ha [Thu, 18 Jan 2018 19:22:07 +0000 (14:22 -0500)]
Use clean install for Sonar

The Sonar job does not need to deploy so switch to using
`mvn clean install` to build the project before running
sonar scan.

Change-Id: I577a57417d0c56f403e66b9fb7201bf58fef818e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoImprove verbosity in maven shell scripts 30/8430/1
Thanh Ha [Thu, 18 Jan 2018 19:20:46 +0000 (14:20 -0500)]
Improve verbosity in maven shell scripts

There is no harm in enabling debug level verbosity for these scripts
and may help in improving troubleshooting.

Change-Id: I9edfee2f7d2415117d854ad7cdba280cc9751004
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRevert "Switch global-jjb to lfdocs-conf" 23/8423/1
Thanh Ha [Wed, 17 Jan 2018 20:23:26 +0000 (15:23 -0500)]
Revert "Switch global-jjb to lfdocs-conf"

Need to revert because conf.yaml causes deployment issues in
jjb recursive runs as it's not expecting a non-jjb yaml. Let's
not use lfdocs-conf in global-jjb until we have a way around
that.

This reverts commit ac79981ec42d37f943c2a4159e2980913cb1716d.

Change-Id: I0eb5d269b31c76e5da7affd80d93715cee8e4037
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDefault to python2 for tox 19/8419/1
Thanh Ha [Wed, 17 Jan 2018 19:26:54 +0000 (14:26 -0500)]
Default to python2 for tox

This caused many ODL projects to break due to it now assuming
py3 by default. The only project that needs python3 tox run is
Acumos so let us default this back to python2 which is the OS level
default and explicitly set python3 in Acumos.

Change-Id: I97df6eee112a2e9e1e8d18eb9e16990a1c703538
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSwitch global-jjb to lfdocs-conf 12/8412/1
Thanh Ha [Wed, 17 Jan 2018 03:08:58 +0000 (22:08 -0500)]
Switch global-jjb to lfdocs-conf

Consolidate conf.py into lfdocs-conf package.

Change-Id: I18b975acaa2ef28dfdaeb9ebf29357a9ed58202d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSet default archive patterns for maven-verify 99/8399/3
Thanh Ha [Tue, 16 Jan 2018 14:22:59 +0000 (09:22 -0500)]
Set default archive patterns for maven-verify

Adds some default archive patterns for the maven-verify job
template.

Change-Id: I18e85f859fbba088ab338672f4fb28e7a02787af
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add maven-merge job to maven job group"
Thanh Ha [Mon, 15 Jan 2018 19:15:23 +0000 (19:15 +0000)]
Merge "Add maven-merge job to maven job group"

6 years agoAdd maven-merge job to maven job group 98/8398/1
Thanh Ha [Mon, 15 Jan 2018 19:10:22 +0000 (14:10 -0500)]
Add maven-merge job to maven job group

Tested this for a couple weeks now. Let's start deploying it
more broadly.

Change-Id: Iddefb7a53668c311a41cc8b8bf216cb97e3c1bd2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd -e flag to mvn calls 97/8397/2
Thanh Ha [Mon, 15 Jan 2018 18:47:27 +0000 (13:47 -0500)]
Add -e flag to mvn calls

Enables full stack traces and display execution errors during
maven output.

Change-Id: Idb16eb1187bcf857530b6288ed8728de8cabdf69
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Do not force expected-xml"
Thanh Ha [Mon, 15 Jan 2018 19:05:50 +0000 (19:05 +0000)]
Merge "Do not force expected-xml"

6 years agoPrint file size before deploy maven file to nexus 94/8394/1
Anil Belur [Sun, 14 Jan 2018 23:11:45 +0000 (09:11 +1000)]
Print file size before deploy maven file to nexus

The size of the file is useful to determine if nexus deploy failures
are due to the file size exceeding the limits.

Change-Id: I1c0eda93ab964a30e37ea910a7a5859a65de8ee3
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoDo not force expected-xml 92/8392/1
Thanh Ha [Sat, 13 Jan 2018 17:05:34 +0000 (12:05 -0500)]
Do not force expected-xml

After using this for a few months now I'm convinced this is not the
right way to achieve what we want here. XML differences should be
informational and not build breaking. Pretty much every change
requires XML changes so I think this has been more annoying than
helpful.

This new patch removes expected-xml and instead outputs XML diffs
instead which can be stored in logs and reviewed.

Change-Id: Ia4039489502499df1b15a4d9fe1e553af3c5bfcd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix default platform location to common-packer 91/8391/1
Thanh Ha [Sat, 13 Jan 2018 17:03:40 +0000 (12:03 -0500)]
Fix default platform location to common-packer

The default search path should be common-packer and only loading
the local project's version if it exists.

Change-Id: Iae1af0e804806ef99761c2e02a39214443a74b23
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump packer build timeout to 90 minutes 90/8390/2
Thanh Ha [Sat, 13 Jan 2018 04:09:06 +0000 (23:09 -0500)]
Bump packer build timeout to 90 minutes

With all of the consolidation of packaging into the new baseline
scripts as well as known slowness in Vexxhost builds for baseline
are now taking around 60 minutes to run. Bump to 90 minutes so that
there is a buffer for us to continue developing baseline.

Change-Id: I195a74d902111c937bebf7c8e599a3d641e74a37
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd a check for missing vars/*.json 88/8388/3
Thanh Ha [Fri, 12 Jan 2018 21:18:03 +0000 (16:18 -0500)]
Add a check for missing vars/*.json

If a project does not have any then we should detect it and skip
trying to parse those files.

Change-Id: I9fd1fee88a68e745709779de9fec3f2013b7483f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate expected xml to JJB 2.0 format 89/8389/1
Thanh Ha [Fri, 12 Jan 2018 21:56:34 +0000 (16:56 -0500)]
Update expected xml to JJB 2.0 format

Change-Id: I73ac8158a85559ec8d09682b8192aecb7f78ba8b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Install git-review outside of loop"
Jamo Luhrsen [Fri, 12 Jan 2018 06:08:46 +0000 (06:08 +0000)]
Merge "Install git-review outside of loop"

6 years agoFix detox logs not being archived 79/8379/6
Thanh Ha [Fri, 12 Jan 2018 02:23:45 +0000 (21:23 -0500)]
Fix detox logs not being archived

Since we immediately fail on any shell errors we miss log
collection at the end of the build. Fix detox part of script to
allow the log collection code to run.

Change-Id: I50bcd337224adcecbf028f08b56cfebe2e10a3d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAllow tox-install to handle base python ver 80/8380/3
Thanh Ha [Fri, 12 Jan 2018 03:26:39 +0000 (22:26 -0500)]
Allow tox-install to handle base python ver

Turns tox-install.sh into a proper macro allowing the user to choose
which base Python version to use in the tox virtualenv.

Issue: RT-50802
Change-Id: Iff578f4cfa39ce6b2540be45537931e6a3b48d22
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoEnable pyenv if available in image 70/8370/2
Thanh Ha [Thu, 11 Jan 2018 23:27:16 +0000 (18:27 -0500)]
Enable pyenv if available in image

We need pyenv so that tox can pull in Python versions provided by
the pyenv setup.

Issue: RT-50802
Change-Id: I406f28e10e2d701f5f8fd396fea10d81bffd61a8
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoInstall tox-pyenv 65/8365/3
Thanh Ha [Thu, 11 Jan 2018 20:21:21 +0000 (15:21 -0500)]
Install tox-pyenv

Need tox-pyenv so that tox can automatically pick up pyenv
installations.

Issue: RT-50802
Change-Id: I601f8d7a21cab0a215947ff1d882c6666be0cf65
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoInstall git-review outside of loop 51/8351/2
Thanh Ha [Wed, 10 Jan 2018 22:39:23 +0000 (17:39 -0500)]
Install git-review outside of loop

Mistakenly put the virtualenv bits inside of a loop. Minor
issue and code still works without this patch but should move
it as best practice.

Change-Id: I047ec5f67daea10ef71bc151a2999f6a2235e44f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd Gerrit trigger to clm job 66/8366/8
Jessica Wagantall [Thu, 11 Jan 2018 20:25:34 +0000 (12:25 -0800)]
Add Gerrit trigger to clm job

Add Gerrit trigger on comment "run-clm" for Gerrit and Github
clm jobs.

Change-Id: I220bc93e147d278fab09420cabf7c14feb874b97
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoMerge "Add script to print all creds in Jenkins"
Thanh Ha [Wed, 10 Jan 2018 22:29:45 +0000 (22:29 +0000)]
Merge "Add script to print all creds in Jenkins"

6 years agoAdd script to print all creds in Jenkins 42/8342/3
Jessica Wagantall [Wed, 10 Jan 2018 20:22:25 +0000 (12:22 -0800)]
Add script to print all creds in Jenkins

Add groovy script to run in the script console
that will display all credentials registered in Jenkins in
an Id : Password format.

Change-Id: I81d74a72a1bb5558c7230a6da7a5de055de809c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoBump version to v0.15.0-dev 49/8349/1
Thanh Ha [Wed, 10 Jan 2018 21:41:57 +0000 (16:41 -0500)]
Bump version to v0.15.0-dev

Change-Id: I0fff3b7dd581d1a5cd50382c551d0f9681211ce2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.14.1 48/8348/1 v0.14.1
Thanh Ha [Wed, 10 Jan 2018 21:31:08 +0000 (16:31 -0500)]
Release global-jjb v0.14.1

Change-Id: Ice69cad332a65f91db0d558130f6ae2d51767a57
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDon't try to pushd into dir that doesn't exist 47/8347/3
Daniel Farrell [Wed, 10 Jan 2018 20:58:27 +0000 (15:58 -0500)]
Don't try to pushd into dir that doesn't exist

Just download packer into WORKSPACE vs bothering with a tmp packer dir.

Change-Id: Id97f3ae4635dc7a685a0d1e58effd24ee312c703
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
6 years agoRelease global-jjb v0.14.0 44/8344/1 v0.14.0
Thanh Ha [Wed, 10 Jan 2018 20:46:11 +0000 (15:46 -0500)]
Release global-jjb v0.14.0

Change-Id: Ic0a55eba3dac5759af7d8f276f30af8690d4e30f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate remote gerrit to use GERRIT_URL 35/8335/3
Thanh Ha [Wed, 10 Jan 2018 18:40:39 +0000 (13:40 -0500)]
Update remote gerrit to use GERRIT_URL

Because GIT_BASE and GIT_URL now point to a git mirror
that is not a Gerrit system we need to set it up with
GERRIT_URL anonymous http.

Change-Id: I8f4eccf89dc14d7c27d353b00a7595fdcded70b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Use detox to run tox in parallel"
Andrew Grimberg [Wed, 10 Jan 2018 18:40:13 +0000 (18:40 +0000)]
Merge "Use detox to run tox in parallel"

6 years agoUpdate merge job to work with common-packer 14/8314/4
Thanh Ha [Tue, 9 Jan 2018 18:01:59 +0000 (13:01 -0500)]
Update merge job to work with common-packer

This patch requires that projects upgrading to the next global-jjb
release to now require common-packer.

Change-Id: I4d85452801e4eff78f33b86afba4c7d23dd3d678
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate packer file_path triggers 11/8311/4
Thanh Ha [Tue, 9 Jan 2018 17:49:21 +0000 (12:49 -0500)]
Update packer file_path triggers

Changes to migrate our scripts to ansible now requires us to update
these filepath triggers.

Issue: RELENG-288
Change-Id: I82e457aa2453c6446e30ddb9c567ecd8ad71878c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoImprove packer-validate debugging output 05/8305/5
Anil Belur [Tue, 9 Jan 2018 09:21:14 +0000 (19:21 +1000)]
Improve packer-validate debugging output

This patch achieves 3 tasks:

1. Improves the debugging output provided by printing out the
   details about which vars and templates files are being tested.
2. Fixes an issue where packer was not actually testing every
   combination of varfile and template file due to cloud-env.json.
3. Includes common-packer vars files if available (should silently
   ignore if it does not exist).

Issue: RELENG-744
Change-Id: Id6e1f2423a378cbe376ccefe2568c22669fb7859
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse detox to run tox in parallel 03/8203/3
Thanh Ha [Thu, 4 Jan 2018 02:10:02 +0000 (21:10 -0500)]
Use detox to run tox in parallel

Rather than hacking something together with parallel use a tool
supported by the tox project called detox.

Change-Id: I04fc3a083c420f71938b99f942b682093822ddda
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix ShellCheck v0.4.7 lint issues 21/8321/5
Anil Belur [Tue, 9 Jan 2018 23:37:00 +0000 (09:37 +1000)]
Fix ShellCheck v0.4.7 lint issues

v0.4.7 introduces some new rules which now need to be handled.

Change-Id: If87fceb79e384e26f021a9c85a2e9d7413ce421e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoMerge "Base sigul macros and scripts"
Andrew Grimberg [Tue, 9 Jan 2018 14:44:07 +0000 (14:44 +0000)]
Merge "Base sigul macros and scripts"

6 years agoMerge "Allow SONAR_MAVEN_GOAL to be configurable"
Andrew Grimberg [Wed, 3 Jan 2018 16:22:37 +0000 (16:22 +0000)]
Merge "Allow SONAR_MAVEN_GOAL to be configurable"

6 years agoBump version to v0.14.0-dev 78/8178/1
Thanh Ha [Thu, 28 Dec 2017 17:48:51 +0000 (12:48 -0500)]
Bump version to v0.14.0-dev

Change-Id: Idbda87687afcfc631e409a4e53d2e6045c1bddf9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.13.1 77/8177/1 v0.13.1
Thanh Ha [Thu, 28 Dec 2017 17:41:41 +0000 (12:41 -0500)]
Release global-jjb v0.13.1

Change-Id: Ib1b5dbcf8d941c70c4aadc36f936701ea0e7953b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrioritize MAVEN_PARAMS to override OPTIONS 76/8176/2
Thanh Ha [Thu, 28 Dec 2017 17:21:27 +0000 (12:21 -0500)]
Prioritize MAVEN_PARAMS to override OPTIONS

MAVEN_PARAMS (user defined) can override MAVEN_OPTIONS (gjjb defined)
but only if it comes last on the CLI. Re-shuffle the variables so that
the desired prioritization can take affect.

RT 50181
Change-Id: Ib79cf11625e9b2d1f279b721f3a90a31e04020dc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAllow SONAR_MAVEN_GOAL to be configurable 72/8172/5
Thanh Ha [Thu, 28 Dec 2017 01:48:36 +0000 (20:48 -0500)]
Allow SONAR_MAVEN_GOAL to be configurable

Per reports on the mailing list Sonar jobs are broken in OpenDaylight.
This is because Sonar release a new plugin which only works with newer
versions of Sonar so until we can upgrade we need to allow flexibility
to configure the Sonar job to override the default sonar:sonar goal.

With this patch it is now possible to override the Sonar goal in JJB
and force an older version of the Sonar plugin to run using a JJB
defaults config or projects variable like this:

  sonar-mvn-goal: org.codehaus.mojo:sonar-maven-plugin:3.3.0.603:sonar

Unfortunately due to the defaults priority of JJB since we are
defining the sonar-mvn-goal parameter inside of the job template it
can only be overrided via a project section.

Reports:
https://lists.opendaylight.org/pipermail/release/2017-December/013119.html
https://lists.opendaylight.org/pipermail/release/2017-December/013223.html

Change-Id: I04512613f39e7c328e0f2f18d9c4729667e86909
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Make sysstat script more readable"
Thanh Ha [Wed, 27 Dec 2017 22:15:41 +0000 (22:15 +0000)]
Merge "Make sysstat script more readable"

7 years agoMake sysstat script more readable 61/8061/1
Anil Belur [Tue, 19 Dec 2017 09:35:12 +0000 (19:35 +1000)]
Make sysstat script more readable

Change-Id: I10415a461d57ad8c0e7f95b4bfea5327a6b14e72
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoUpdate packer version to 1.1.3 18/8018/2
Anil Belur [Fri, 15 Dec 2017 15:51:54 +0000 (01:51 +1000)]
Update packer version to 1.1.3

Change-Id: I7c0b4255d9b06ffd8833146be68982099768676c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoBump CLM job timeout to 30 00/8000/2
Thanh Ha [Wed, 13 Dec 2017 22:24:53 +0000 (17:24 -0500)]
Bump CLM job timeout to 30

Noticed today that many OpenDaylight CLM jobs are failing the
CLM 15 minute timeout. With the move to Vex where we have less
cores in our builds too bumping the timeout to 30 to account for
longer build times.

Change-Id: I69e2d32d10a04584bb2d66fab73583b70a3fc066
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to v0.14.0-dev 20/7920/1
Thanh Ha [Mon, 11 Dec 2017 18:14:22 +0000 (13:14 -0500)]
Bump version to v0.14.0-dev

Change-Id: I39d13bf084223b38f2da70158651f14a7ae13e59
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.13.0 19/7919/2 v0.13.0
Thanh Ha [Mon, 11 Dec 2017 18:10:32 +0000 (13:10 -0500)]
Release global-jjb v0.13.0

Also fix previous release notes titles.

Change-Id: I967131a7f89c56d132a6d8eae0411c1d6cf2b003
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMigrate Maven Merge job to global-jjb 68/6968/17
Thanh Ha [Sun, 15 Oct 2017 20:44:08 +0000 (16:44 -0400)]
Migrate Maven Merge job to global-jjb

Provide a Maven Merge job that is generically reusable by other
projects. This new job uses cURL to upload artifacts to Nexus and uses
`wget -r` to mirror existing maven-metadata.xml files in order to update
them when pushing SNAPSHOTs.

This job uses the following strategy to deploy jobs to Nexus:

1. `wget -r` to fetch maven-metadata.xml from Nexus
2. `mvn deploy -DaltDeploymentRepository` to prepare files for upload
3. Removes untouched maven-metadata.xml files before upload
4. Use lftools (cURL) upload script to push artifacts to Nexus

Issue: RELENG-61
Change-Id: I7663731d0eb750e4ccc1b07bcf5ad39c6135900c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBase sigul macros and scripts 56/6556/6
Andrew Grimberg [Fri, 22 Sep 2017 14:23:19 +0000 (07:23 -0700)]
Base sigul macros and scripts

Before any jobs can be created using sigul we need to have some basic
scaffolding for setting up the sigul enviroment.

Changes to lftools to extend the signing command to leverage sigul will
then allow us to create a meta macro which combines this scaffolding
into a single cohesive macro.

Change-Id: I080c1eb7271a2a64559b2c2f7b1011be1e9a8b16
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoFix branch on verify and merge jobs 28/7528/2
Jeremy Phelps [Wed, 15 Nov 2017 00:39:57 +0000 (18:39 -0600)]
Fix branch on verify and merge jobs

This fixes the branch parameter
on verify and merge jobs to be
refs/heads/{branch} and $sha1
respectively.

Change-Id: I230e04fda467848c5e764c90bf9190416b72dac4
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoFix branch variable in github scm 13/7513/2
Jeremy Phelps [Tue, 14 Nov 2017 20:44:21 +0000 (14:44 -0600)]
Fix branch variable in github scm

The branch variable should not be
concatenated with refs/heads.
GHPRB makes use of variables to
put here.

Change-Id: I54c6f3f51b734b894abb090d4473683a3e34fa06
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoBump to v0.13.0-dev 09/7509/1
Andrew Grimberg [Tue, 14 Nov 2017 19:01:34 +0000 (11:01 -0800)]
Bump to v0.13.0-dev

Change-Id: I92a54cc34ad23a666f90aa76e1168a87235a686c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoRelease global-jjb v0.12.0 08/7508/1 v0.12.0
Andrew Grimberg [Tue, 14 Nov 2017 18:50:36 +0000 (10:50 -0800)]
Release global-jjb v0.12.0

Change-Id: I706b80fcdc695d3fb2b25984d65d352ba688b559
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoMerge "Add npm config script"
Andrew Grimberg [Tue, 14 Nov 2017 18:41:24 +0000 (18:41 +0000)]
Merge "Add npm config script"

7 years agoAdd branches parameter to github scm macro 04/7504/4
Jeremy Phelps [Tue, 14 Nov 2017 16:11:03 +0000 (10:11 -0600)]
Add branches parameter to github scm macro

Make sure that the github scm macro accepts
branches as a configuration option like the
gerrit version of the macro.

Change-Id: Ife15943fa3fc094e20981f804f7036133d881f46
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoEnable maven jobs to archive artifacts 92/7492/1
Anil Belur [Mon, 13 Nov 2017 02:02:52 +0000 (12:02 +1000)]
Enable maven jobs to archive artifacts

Projects which use the maven jobs in global-jjb may
require to archive additional logs such as surefire
reports. This needs to be handled by globstar patterns
passed through the projects using these templates.

Change-Id: I97dc8801a0fb05cccf75f32ad7ad621cb6e974bf
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAdd npm config script 67/7367/5
Jeremy Phelps [Mon, 6 Nov 2017 20:20:55 +0000 (14:20 -0600)]
Add npm config script

Change-Id: I12a9af7f6926660143e40b2382b44e7af606ff00
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Move jjb-version to templates"
Jeremy Phelps [Tue, 7 Nov 2017 20:24:44 +0000 (20:24 +0000)]
Merge "Move jjb-version to templates"

7 years agoMerge "Add install goal to javadoc job"
Jeremy Phelps [Tue, 7 Nov 2017 17:46:35 +0000 (17:46 +0000)]
Merge "Add install goal to javadoc job"

7 years agoMove jjb-version to templates 74/7274/1
Thanh Ha [Fri, 3 Nov 2017 18:13:07 +0000 (14:13 -0400)]
Move jjb-version to templates

It appears that `job-group` definitions take priority over `project`
definitions. Move it to the template so that we can override the
parameter correctly.

Change-Id: I2b824e3cc89667698db8ebfdd3ce43f551e961d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add npmrc config file to lf-infra-wrappers"
Jeremy Phelps [Fri, 3 Nov 2017 15:26:06 +0000 (15:26 +0000)]
Merge "Add npmrc config file to lf-infra-wrappers"

7 years agoAdd npmrc config file to lf-infra-wrappers 57/6957/11
Jeremy Phelps [Wed, 18 Oct 2017 17:55:14 +0000 (12:55 -0500)]
Add npmrc config file to lf-infra-wrappers

Change-Id: I2bafb9a9787f6820243e1ee19861fb8fc45670d7
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>