releng/global-jjb.git
6 years agoBump default timeout to 15 minutes for tox 80/8580/1
Thanh Ha [Mon, 29 Jan 2018 22:20:55 +0000 (17:20 -0500)]
Bump default timeout to 15 minutes for tox

Increase tox jobs default timeout to 15 minutes. Considering many
things appear to be taking longer in Vexxhost this is likely
necessary.

Change-Id: I592146b1f0d47a9aedfdc91c1878a6f94b3d363c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRefactor macro/template cron param 66/8566/3
Christopher Lott (cl778h) [Mon, 29 Jan 2018 17:51:21 +0000 (12:51 -0500)]
Refactor macro/template cron param

Be consistent with cron parameter: define in macro, use in template.
Never hard-code a trigger in a job template.
Document the parameters in the RST file.

Change-Id: I70a1deefd23bc9498f6c6013fb8751298dec7f53
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
6 years agoMerge "Split maven-deploy into a macro"
Andrew Grimberg [Mon, 22 Jan 2018 23:02:07 +0000 (23:02 +0000)]
Merge "Split maven-deploy into a macro"

6 years agoBump global-jjb to 0.16.0-dev 66/8466/1
Thanh Ha [Mon, 22 Jan 2018 21:47:11 +0000 (16:47 -0500)]
Bump global-jjb to 0.16.0-dev

Change-Id: I0f5e3d41bcdc3f6938208d3b710b20df9dfb5c70
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.15.0 56/8456/1 v0.15.0
Thanh Ha [Mon, 22 Jan 2018 02:02:41 +0000 (21:02 -0500)]
Release global-jjb v0.15.0

Change-Id: I1186feb6ff4fefb5311bcfb84ad34b4001b9cef7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoIncrease maven-jobs default timeout to 60 mins 43/8443/1
Thanh Ha [Fri, 19 Jan 2018 16:50:13 +0000 (11:50 -0500)]
Increase maven-jobs default timeout to 60 mins

The new Vexxhost cloud seems to be slower in general and
continuous to cause OpenDaylight grief when it comes to running
jobs. Increase the timeout to 60 mins to account for the slower
infra.

Change-Id: I04325ce9d700ac4879a17f1b0547bc0b861c7cac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSplit maven-deploy into a macro 36/8436/2
Thanh Ha [Fri, 19 Jan 2018 01:10:24 +0000 (20:10 -0500)]
Split maven-deploy into a macro

Split out maven-deploy into a reusable macro.

Change-Id: I6ddad68576cdbf9d9ef8b4805da94dc6a80cbefd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Improve verbosity in maven shell scripts"
Thanh Ha [Fri, 19 Jan 2018 01:02:36 +0000 (01:02 +0000)]
Merge "Improve verbosity in maven shell scripts"

6 years agoUse clean install for Sonar 31/8431/1
Thanh Ha [Thu, 18 Jan 2018 19:22:07 +0000 (14:22 -0500)]
Use clean install for Sonar

The Sonar job does not need to deploy so switch to using
`mvn clean install` to build the project before running
sonar scan.

Change-Id: I577a57417d0c56f403e66b9fb7201bf58fef818e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoImprove verbosity in maven shell scripts 30/8430/1
Thanh Ha [Thu, 18 Jan 2018 19:20:46 +0000 (14:20 -0500)]
Improve verbosity in maven shell scripts

There is no harm in enabling debug level verbosity for these scripts
and may help in improving troubleshooting.

Change-Id: I9edfee2f7d2415117d854ad7cdba280cc9751004
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRevert "Switch global-jjb to lfdocs-conf" 23/8423/1
Thanh Ha [Wed, 17 Jan 2018 20:23:26 +0000 (15:23 -0500)]
Revert "Switch global-jjb to lfdocs-conf"

Need to revert because conf.yaml causes deployment issues in
jjb recursive runs as it's not expecting a non-jjb yaml. Let's
not use lfdocs-conf in global-jjb until we have a way around
that.

This reverts commit ac79981ec42d37f943c2a4159e2980913cb1716d.

Change-Id: I0eb5d269b31c76e5da7affd80d93715cee8e4037
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDefault to python2 for tox 19/8419/1
Thanh Ha [Wed, 17 Jan 2018 19:26:54 +0000 (14:26 -0500)]
Default to python2 for tox

This caused many ODL projects to break due to it now assuming
py3 by default. The only project that needs python3 tox run is
Acumos so let us default this back to python2 which is the OS level
default and explicitly set python3 in Acumos.

Change-Id: I97df6eee112a2e9e1e8d18eb9e16990a1c703538
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSwitch global-jjb to lfdocs-conf 12/8412/1
Thanh Ha [Wed, 17 Jan 2018 03:08:58 +0000 (22:08 -0500)]
Switch global-jjb to lfdocs-conf

Consolidate conf.py into lfdocs-conf package.

Change-Id: I18b975acaa2ef28dfdaeb9ebf29357a9ed58202d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSet default archive patterns for maven-verify 99/8399/3
Thanh Ha [Tue, 16 Jan 2018 14:22:59 +0000 (09:22 -0500)]
Set default archive patterns for maven-verify

Adds some default archive patterns for the maven-verify job
template.

Change-Id: I18e85f859fbba088ab338672f4fb28e7a02787af
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add maven-merge job to maven job group"
Thanh Ha [Mon, 15 Jan 2018 19:15:23 +0000 (19:15 +0000)]
Merge "Add maven-merge job to maven job group"

6 years agoAdd maven-merge job to maven job group 98/8398/1
Thanh Ha [Mon, 15 Jan 2018 19:10:22 +0000 (14:10 -0500)]
Add maven-merge job to maven job group

Tested this for a couple weeks now. Let's start deploying it
more broadly.

Change-Id: Iddefb7a53668c311a41cc8b8bf216cb97e3c1bd2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd -e flag to mvn calls 97/8397/2
Thanh Ha [Mon, 15 Jan 2018 18:47:27 +0000 (13:47 -0500)]
Add -e flag to mvn calls

Enables full stack traces and display execution errors during
maven output.

Change-Id: Idb16eb1187bcf857530b6288ed8728de8cabdf69
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Do not force expected-xml"
Thanh Ha [Mon, 15 Jan 2018 19:05:50 +0000 (19:05 +0000)]
Merge "Do not force expected-xml"

6 years agoPrint file size before deploy maven file to nexus 94/8394/1
Anil Belur [Sun, 14 Jan 2018 23:11:45 +0000 (09:11 +1000)]
Print file size before deploy maven file to nexus

The size of the file is useful to determine if nexus deploy failures
are due to the file size exceeding the limits.

Change-Id: I1c0eda93ab964a30e37ea910a7a5859a65de8ee3
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoDo not force expected-xml 92/8392/1
Thanh Ha [Sat, 13 Jan 2018 17:05:34 +0000 (12:05 -0500)]
Do not force expected-xml

After using this for a few months now I'm convinced this is not the
right way to achieve what we want here. XML differences should be
informational and not build breaking. Pretty much every change
requires XML changes so I think this has been more annoying than
helpful.

This new patch removes expected-xml and instead outputs XML diffs
instead which can be stored in logs and reviewed.

Change-Id: Ia4039489502499df1b15a4d9fe1e553af3c5bfcd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix default platform location to common-packer 91/8391/1
Thanh Ha [Sat, 13 Jan 2018 17:03:40 +0000 (12:03 -0500)]
Fix default platform location to common-packer

The default search path should be common-packer and only loading
the local project's version if it exists.

Change-Id: Iae1af0e804806ef99761c2e02a39214443a74b23
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump packer build timeout to 90 minutes 90/8390/2
Thanh Ha [Sat, 13 Jan 2018 04:09:06 +0000 (23:09 -0500)]
Bump packer build timeout to 90 minutes

With all of the consolidation of packaging into the new baseline
scripts as well as known slowness in Vexxhost builds for baseline
are now taking around 60 minutes to run. Bump to 90 minutes so that
there is a buffer for us to continue developing baseline.

Change-Id: I195a74d902111c937bebf7c8e599a3d641e74a37
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd a check for missing vars/*.json 88/8388/3
Thanh Ha [Fri, 12 Jan 2018 21:18:03 +0000 (16:18 -0500)]
Add a check for missing vars/*.json

If a project does not have any then we should detect it and skip
trying to parse those files.

Change-Id: I9fd1fee88a68e745709779de9fec3f2013b7483f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate expected xml to JJB 2.0 format 89/8389/1
Thanh Ha [Fri, 12 Jan 2018 21:56:34 +0000 (16:56 -0500)]
Update expected xml to JJB 2.0 format

Change-Id: I73ac8158a85559ec8d09682b8192aecb7f78ba8b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Install git-review outside of loop"
Jamo Luhrsen [Fri, 12 Jan 2018 06:08:46 +0000 (06:08 +0000)]
Merge "Install git-review outside of loop"

6 years agoFix detox logs not being archived 79/8379/6
Thanh Ha [Fri, 12 Jan 2018 02:23:45 +0000 (21:23 -0500)]
Fix detox logs not being archived

Since we immediately fail on any shell errors we miss log
collection at the end of the build. Fix detox part of script to
allow the log collection code to run.

Change-Id: I50bcd337224adcecbf028f08b56cfebe2e10a3d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAllow tox-install to handle base python ver 80/8380/3
Thanh Ha [Fri, 12 Jan 2018 03:26:39 +0000 (22:26 -0500)]
Allow tox-install to handle base python ver

Turns tox-install.sh into a proper macro allowing the user to choose
which base Python version to use in the tox virtualenv.

Issue: RT-50802
Change-Id: Iff578f4cfa39ce6b2540be45537931e6a3b48d22
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoEnable pyenv if available in image 70/8370/2
Thanh Ha [Thu, 11 Jan 2018 23:27:16 +0000 (18:27 -0500)]
Enable pyenv if available in image

We need pyenv so that tox can pull in Python versions provided by
the pyenv setup.

Issue: RT-50802
Change-Id: I406f28e10e2d701f5f8fd396fea10d81bffd61a8
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoInstall tox-pyenv 65/8365/3
Thanh Ha [Thu, 11 Jan 2018 20:21:21 +0000 (15:21 -0500)]
Install tox-pyenv

Need tox-pyenv so that tox can automatically pick up pyenv
installations.

Issue: RT-50802
Change-Id: I601f8d7a21cab0a215947ff1d882c6666be0cf65
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoInstall git-review outside of loop 51/8351/2
Thanh Ha [Wed, 10 Jan 2018 22:39:23 +0000 (17:39 -0500)]
Install git-review outside of loop

Mistakenly put the virtualenv bits inside of a loop. Minor
issue and code still works without this patch but should move
it as best practice.

Change-Id: I047ec5f67daea10ef71bc151a2999f6a2235e44f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd Gerrit trigger to clm job 66/8366/8
Jessica Wagantall [Thu, 11 Jan 2018 20:25:34 +0000 (12:25 -0800)]
Add Gerrit trigger to clm job

Add Gerrit trigger on comment "run-clm" for Gerrit and Github
clm jobs.

Change-Id: I220bc93e147d278fab09420cabf7c14feb874b97
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoMerge "Add script to print all creds in Jenkins"
Thanh Ha [Wed, 10 Jan 2018 22:29:45 +0000 (22:29 +0000)]
Merge "Add script to print all creds in Jenkins"

6 years agoAdd script to print all creds in Jenkins 42/8342/3
Jessica Wagantall [Wed, 10 Jan 2018 20:22:25 +0000 (12:22 -0800)]
Add script to print all creds in Jenkins

Add groovy script to run in the script console
that will display all credentials registered in Jenkins in
an Id : Password format.

Change-Id: I81d74a72a1bb5558c7230a6da7a5de055de809c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoBump version to v0.15.0-dev 49/8349/1
Thanh Ha [Wed, 10 Jan 2018 21:41:57 +0000 (16:41 -0500)]
Bump version to v0.15.0-dev

Change-Id: I0fff3b7dd581d1a5cd50382c551d0f9681211ce2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.14.1 48/8348/1 v0.14.1
Thanh Ha [Wed, 10 Jan 2018 21:31:08 +0000 (16:31 -0500)]
Release global-jjb v0.14.1

Change-Id: Ice69cad332a65f91db0d558130f6ae2d51767a57
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDon't try to pushd into dir that doesn't exist 47/8347/3
Daniel Farrell [Wed, 10 Jan 2018 20:58:27 +0000 (15:58 -0500)]
Don't try to pushd into dir that doesn't exist

Just download packer into WORKSPACE vs bothering with a tmp packer dir.

Change-Id: Id97f3ae4635dc7a685a0d1e58effd24ee312c703
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
6 years agoRelease global-jjb v0.14.0 44/8344/1 v0.14.0
Thanh Ha [Wed, 10 Jan 2018 20:46:11 +0000 (15:46 -0500)]
Release global-jjb v0.14.0

Change-Id: Ic0a55eba3dac5759af7d8f276f30af8690d4e30f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate remote gerrit to use GERRIT_URL 35/8335/3
Thanh Ha [Wed, 10 Jan 2018 18:40:39 +0000 (13:40 -0500)]
Update remote gerrit to use GERRIT_URL

Because GIT_BASE and GIT_URL now point to a git mirror
that is not a Gerrit system we need to set it up with
GERRIT_URL anonymous http.

Change-Id: I8f4eccf89dc14d7c27d353b00a7595fdcded70b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Use detox to run tox in parallel"
Andrew Grimberg [Wed, 10 Jan 2018 18:40:13 +0000 (18:40 +0000)]
Merge "Use detox to run tox in parallel"

6 years agoUpdate merge job to work with common-packer 14/8314/4
Thanh Ha [Tue, 9 Jan 2018 18:01:59 +0000 (13:01 -0500)]
Update merge job to work with common-packer

This patch requires that projects upgrading to the next global-jjb
release to now require common-packer.

Change-Id: I4d85452801e4eff78f33b86afba4c7d23dd3d678
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate packer file_path triggers 11/8311/4
Thanh Ha [Tue, 9 Jan 2018 17:49:21 +0000 (12:49 -0500)]
Update packer file_path triggers

Changes to migrate our scripts to ansible now requires us to update
these filepath triggers.

Issue: RELENG-288
Change-Id: I82e457aa2453c6446e30ddb9c567ecd8ad71878c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoImprove packer-validate debugging output 05/8305/5
Anil Belur [Tue, 9 Jan 2018 09:21:14 +0000 (19:21 +1000)]
Improve packer-validate debugging output

This patch achieves 3 tasks:

1. Improves the debugging output provided by printing out the
   details about which vars and templates files are being tested.
2. Fixes an issue where packer was not actually testing every
   combination of varfile and template file due to cloud-env.json.
3. Includes common-packer vars files if available (should silently
   ignore if it does not exist).

Issue: RELENG-744
Change-Id: Id6e1f2423a378cbe376ccefe2568c22669fb7859
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse detox to run tox in parallel 03/8203/3
Thanh Ha [Thu, 4 Jan 2018 02:10:02 +0000 (21:10 -0500)]
Use detox to run tox in parallel

Rather than hacking something together with parallel use a tool
supported by the tox project called detox.

Change-Id: I04fc3a083c420f71938b99f942b682093822ddda
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix ShellCheck v0.4.7 lint issues 21/8321/5
Anil Belur [Tue, 9 Jan 2018 23:37:00 +0000 (09:37 +1000)]
Fix ShellCheck v0.4.7 lint issues

v0.4.7 introduces some new rules which now need to be handled.

Change-Id: If87fceb79e384e26f021a9c85a2e9d7413ce421e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoMerge "Base sigul macros and scripts"
Andrew Grimberg [Tue, 9 Jan 2018 14:44:07 +0000 (14:44 +0000)]
Merge "Base sigul macros and scripts"

6 years agoMerge "Allow SONAR_MAVEN_GOAL to be configurable"
Andrew Grimberg [Wed, 3 Jan 2018 16:22:37 +0000 (16:22 +0000)]
Merge "Allow SONAR_MAVEN_GOAL to be configurable"

6 years agoBump version to v0.14.0-dev 78/8178/1
Thanh Ha [Thu, 28 Dec 2017 17:48:51 +0000 (12:48 -0500)]
Bump version to v0.14.0-dev

Change-Id: Idbda87687afcfc631e409a4e53d2e6045c1bddf9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.13.1 77/8177/1 v0.13.1
Thanh Ha [Thu, 28 Dec 2017 17:41:41 +0000 (12:41 -0500)]
Release global-jjb v0.13.1

Change-Id: Ib1b5dbcf8d941c70c4aadc36f936701ea0e7953b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrioritize MAVEN_PARAMS to override OPTIONS 76/8176/2
Thanh Ha [Thu, 28 Dec 2017 17:21:27 +0000 (12:21 -0500)]
Prioritize MAVEN_PARAMS to override OPTIONS

MAVEN_PARAMS (user defined) can override MAVEN_OPTIONS (gjjb defined)
but only if it comes last on the CLI. Re-shuffle the variables so that
the desired prioritization can take affect.

RT 50181
Change-Id: Ib79cf11625e9b2d1f279b721f3a90a31e04020dc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAllow SONAR_MAVEN_GOAL to be configurable 72/8172/5
Thanh Ha [Thu, 28 Dec 2017 01:48:36 +0000 (20:48 -0500)]
Allow SONAR_MAVEN_GOAL to be configurable

Per reports on the mailing list Sonar jobs are broken in OpenDaylight.
This is because Sonar release a new plugin which only works with newer
versions of Sonar so until we can upgrade we need to allow flexibility
to configure the Sonar job to override the default sonar:sonar goal.

With this patch it is now possible to override the Sonar goal in JJB
and force an older version of the Sonar plugin to run using a JJB
defaults config or projects variable like this:

  sonar-mvn-goal: org.codehaus.mojo:sonar-maven-plugin:3.3.0.603:sonar

Unfortunately due to the defaults priority of JJB since we are
defining the sonar-mvn-goal parameter inside of the job template it
can only be overrided via a project section.

Reports:
https://lists.opendaylight.org/pipermail/release/2017-December/013119.html
https://lists.opendaylight.org/pipermail/release/2017-December/013223.html

Change-Id: I04512613f39e7c328e0f2f18d9c4729667e86909
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Make sysstat script more readable"
Thanh Ha [Wed, 27 Dec 2017 22:15:41 +0000 (22:15 +0000)]
Merge "Make sysstat script more readable"

7 years agoMake sysstat script more readable 61/8061/1
Anil Belur [Tue, 19 Dec 2017 09:35:12 +0000 (19:35 +1000)]
Make sysstat script more readable

Change-Id: I10415a461d57ad8c0e7f95b4bfea5327a6b14e72
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoUpdate packer version to 1.1.3 18/8018/2
Anil Belur [Fri, 15 Dec 2017 15:51:54 +0000 (01:51 +1000)]
Update packer version to 1.1.3

Change-Id: I7c0b4255d9b06ffd8833146be68982099768676c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoBump CLM job timeout to 30 00/8000/2
Thanh Ha [Wed, 13 Dec 2017 22:24:53 +0000 (17:24 -0500)]
Bump CLM job timeout to 30

Noticed today that many OpenDaylight CLM jobs are failing the
CLM 15 minute timeout. With the move to Vex where we have less
cores in our builds too bumping the timeout to 30 to account for
longer build times.

Change-Id: I69e2d32d10a04584bb2d66fab73583b70a3fc066
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to v0.14.0-dev 20/7920/1
Thanh Ha [Mon, 11 Dec 2017 18:14:22 +0000 (13:14 -0500)]
Bump version to v0.14.0-dev

Change-Id: I39d13bf084223b38f2da70158651f14a7ae13e59
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.13.0 19/7919/2 v0.13.0
Thanh Ha [Mon, 11 Dec 2017 18:10:32 +0000 (13:10 -0500)]
Release global-jjb v0.13.0

Also fix previous release notes titles.

Change-Id: I967131a7f89c56d132a6d8eae0411c1d6cf2b003
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMigrate Maven Merge job to global-jjb 68/6968/17
Thanh Ha [Sun, 15 Oct 2017 20:44:08 +0000 (16:44 -0400)]
Migrate Maven Merge job to global-jjb

Provide a Maven Merge job that is generically reusable by other
projects. This new job uses cURL to upload artifacts to Nexus and uses
`wget -r` to mirror existing maven-metadata.xml files in order to update
them when pushing SNAPSHOTs.

This job uses the following strategy to deploy jobs to Nexus:

1. `wget -r` to fetch maven-metadata.xml from Nexus
2. `mvn deploy -DaltDeploymentRepository` to prepare files for upload
3. Removes untouched maven-metadata.xml files before upload
4. Use lftools (cURL) upload script to push artifacts to Nexus

Issue: RELENG-61
Change-Id: I7663731d0eb750e4ccc1b07bcf5ad39c6135900c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBase sigul macros and scripts 56/6556/6
Andrew Grimberg [Fri, 22 Sep 2017 14:23:19 +0000 (07:23 -0700)]
Base sigul macros and scripts

Before any jobs can be created using sigul we need to have some basic
scaffolding for setting up the sigul enviroment.

Changes to lftools to extend the signing command to leverage sigul will
then allow us to create a meta macro which combines this scaffolding
into a single cohesive macro.

Change-Id: I080c1eb7271a2a64559b2c2f7b1011be1e9a8b16
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoFix branch on verify and merge jobs 28/7528/2
Jeremy Phelps [Wed, 15 Nov 2017 00:39:57 +0000 (18:39 -0600)]
Fix branch on verify and merge jobs

This fixes the branch parameter
on verify and merge jobs to be
refs/heads/{branch} and $sha1
respectively.

Change-Id: I230e04fda467848c5e764c90bf9190416b72dac4
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoFix branch variable in github scm 13/7513/2
Jeremy Phelps [Tue, 14 Nov 2017 20:44:21 +0000 (14:44 -0600)]
Fix branch variable in github scm

The branch variable should not be
concatenated with refs/heads.
GHPRB makes use of variables to
put here.

Change-Id: I54c6f3f51b734b894abb090d4473683a3e34fa06
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoBump to v0.13.0-dev 09/7509/1
Andrew Grimberg [Tue, 14 Nov 2017 19:01:34 +0000 (11:01 -0800)]
Bump to v0.13.0-dev

Change-Id: I92a54cc34ad23a666f90aa76e1168a87235a686c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoRelease global-jjb v0.12.0 08/7508/1 v0.12.0
Andrew Grimberg [Tue, 14 Nov 2017 18:50:36 +0000 (10:50 -0800)]
Release global-jjb v0.12.0

Change-Id: I706b80fcdc695d3fb2b25984d65d352ba688b559
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoMerge "Add npm config script"
Andrew Grimberg [Tue, 14 Nov 2017 18:41:24 +0000 (18:41 +0000)]
Merge "Add npm config script"

7 years agoAdd branches parameter to github scm macro 04/7504/4
Jeremy Phelps [Tue, 14 Nov 2017 16:11:03 +0000 (10:11 -0600)]
Add branches parameter to github scm macro

Make sure that the github scm macro accepts
branches as a configuration option like the
gerrit version of the macro.

Change-Id: Ife15943fa3fc094e20981f804f7036133d881f46
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoEnable maven jobs to archive artifacts 92/7492/1
Anil Belur [Mon, 13 Nov 2017 02:02:52 +0000 (12:02 +1000)]
Enable maven jobs to archive artifacts

Projects which use the maven jobs in global-jjb may
require to archive additional logs such as surefire
reports. This needs to be handled by globstar patterns
passed through the projects using these templates.

Change-Id: I97dc8801a0fb05cccf75f32ad7ad621cb6e974bf
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAdd npm config script 67/7367/5
Jeremy Phelps [Mon, 6 Nov 2017 20:20:55 +0000 (14:20 -0600)]
Add npm config script

Change-Id: I12a9af7f6926660143e40b2382b44e7af606ff00
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Move jjb-version to templates"
Jeremy Phelps [Tue, 7 Nov 2017 20:24:44 +0000 (20:24 +0000)]
Merge "Move jjb-version to templates"

7 years agoMerge "Add install goal to javadoc job"
Jeremy Phelps [Tue, 7 Nov 2017 17:46:35 +0000 (17:46 +0000)]
Merge "Add install goal to javadoc job"

7 years agoMove jjb-version to templates 74/7274/1
Thanh Ha [Fri, 3 Nov 2017 18:13:07 +0000 (14:13 -0400)]
Move jjb-version to templates

It appears that `job-group` definitions take priority over `project`
definitions. Move it to the template so that we can override the
parameter correctly.

Change-Id: I2b824e3cc89667698db8ebfdd3ce43f551e961d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add npmrc config file to lf-infra-wrappers"
Jeremy Phelps [Fri, 3 Nov 2017 15:26:06 +0000 (15:26 +0000)]
Merge "Add npmrc config file to lf-infra-wrappers"

7 years agoAdd npmrc config file to lf-infra-wrappers 57/6957/11
Jeremy Phelps [Wed, 18 Oct 2017 17:55:14 +0000 (12:55 -0500)]
Add npmrc config file to lf-infra-wrappers

Change-Id: I2bafb9a9787f6820243e1ee19861fb8fc45670d7
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Add note on JJB defaults"
Anil Shashikumar Belur [Fri, 3 Nov 2017 14:52:53 +0000 (14:52 +0000)]
Merge "Add note on JJB defaults"

7 years agoAdd install goal to javadoc job 44/7244/4
Thanh Ha [Thu, 2 Nov 2017 14:36:59 +0000 (10:36 -0400)]
Add install goal to javadoc job

It turns out javadoc needs to have the artifacts available to them in
order to run javadoc:aggregate. In some cases this means artifacts
installed to the local maven repo. This patch adds the install goal as
well as ensuring we continue to skip tests, checkstyle, and findbugs to
keep the jobs running quick.

Change-Id: I3ffa36b207a1412e0489d6c20a91ffcd3ac93c27
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump to v0.12.0-dev 55/7155/1
Thanh Ha [Mon, 30 Oct 2017 16:30:17 +0000 (12:30 -0400)]
Bump to v0.12.0-dev

Change-Id: I5eaaa3d84e66a0216225c9b4a16baedf4393d461
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.11.0 54/7154/3 v0.11.0
Thanh Ha [Mon, 30 Oct 2017 16:10:54 +0000 (12:10 -0400)]
Release global-jjb v0.11.0

Change-Id: Ieaf88baf73a8a1563164879555d25732303ebf8d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoCat the failed tox-envs 53/7153/3
Thanh Ha [Mon, 30 Oct 2017 15:50:18 +0000 (11:50 -0400)]
Cat the failed tox-envs

Before failing the build we should print the problematic tox
environments into the console to make it easier for folks to
troubleshoot. We are still archiving the individual tox runs but the
console logs will now also contain the errors.

Issue: RELENG-611
Change-Id: Ie6fd132c0de69e8448d320d23daaed811a0d47a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd note on JJB defaults 78/7078/7
Thanh Ha [Wed, 25 Oct 2017 23:52:19 +0000 (09:52 +1000)]
Add note on JJB defaults

This patch provides additional clarification on how defaults are used in
JJB and when to expect the prioritization of variable expansion with
JJB.

Additionally add in intersphinx linking to jjb so that we can link
directly to JJB upstream documentation.

This documentation is based on details provided by Thanh Ha on the
OpenDaylight dev mailing list.

https://lists.opendaylight.org/pipermail/dev/2017-October/004184.html

Issue: RELENG-591
Change-Id: I65aaf933b88519dfbd1daaf8e00661146bc8c38f
Co-Authored-By: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd linting for RST files 34/7134/2
Thanh Ha [Fri, 27 Oct 2017 17:44:33 +0000 (13:44 -0400)]
Add linting for RST files

We should be linting our reStructuredText documentation as well.

Change-Id: Iff5c8f142a8dbc58550cc749c2742094bf13954d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix WriteGood lint errors 33/7133/1
Thanh Ha [Fri, 27 Oct 2017 18:42:48 +0000 (14:42 -0400)]
Fix WriteGood lint errors

Change-Id: I5e8331c42fa1dcfefac62f03d3e1f57eb8713c16
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPin nodeenv version to 1.1.2 32/7132/1
Thanh Ha [Fri, 27 Oct 2017 17:49:25 +0000 (13:49 -0400)]
Pin nodeenv version to 1.1.2

This fixes an issue where you cannot run tox -e coala more than once.

Change-Id: Ied59caddfea7fe237007d987310f0ce35cd71ef4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake javadoc-verify jobs run concurrently 11/7111/3
Thanh Ha [Fri, 27 Oct 2017 16:10:18 +0000 (12:10 -0400)]
Make javadoc-verify jobs run concurrently

We forgot to enable concurrency for the javadoc-verify job when we
created it. This patch fixes that.

Issue: RELENG-607
Change-Id: I622939f418ff254b6714eb28d296199cf86d9589
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Remove port from NEXUS_URL for netrc"
Thanh Ha [Mon, 23 Oct 2017 15:57:07 +0000 (15:57 +0000)]
Merge "Remove port from NEXUS_URL for netrc"

7 years agoMerge "Let NEXUSPROXY override NEXUS_URL if both are set"
Thanh Ha [Mon, 23 Oct 2017 15:55:34 +0000 (15:55 +0000)]
Merge "Let NEXUSPROXY override NEXUS_URL if both are set"

7 years agoRemove port from NEXUS_URL for netrc 29/7029/2
Trevor Bramwell [Wed, 18 Oct 2017 17:42:17 +0000 (10:42 -0700)]
Remove port from NEXUS_URL for netrc

If the NEXUS_URL or NEXUSPROXY contains a port, curl commands
will fail with 401 Unauthorized errors.

Change-Id: I611a7d88f35426b950f12534fba7e9e26618198d
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
7 years agoLet NEXUSPROXY override NEXUS_URL if both are set 30/7030/1
Trevor Bramwell [Mon, 23 Oct 2017 03:12:02 +0000 (20:12 -0700)]
Let NEXUSPROXY override NEXUS_URL if both are set

NEXUS_URL will never be overridden by NEXUSPROXY when creating a netrc,
or deploy logs, unless NEXUS_URL is not explicitly set.

Change-Id: I0f22775d29f4c8cc577df70cc016a1db0ac578f1
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
7 years agoMerge "Revert refspec change breaking submodule build"
Thanh Ha [Fri, 20 Oct 2017 20:44:01 +0000 (20:44 +0000)]
Merge "Revert refspec change breaking submodule build"

7 years agoMerge "Migrate Global JJB docs to RST"
Thanh Ha [Fri, 20 Oct 2017 20:43:32 +0000 (20:43 +0000)]
Merge "Migrate Global JJB docs to RST"

7 years agoUpdate packer version to 1.1.1 88/6988/1
Anil Belur [Fri, 20 Oct 2017 06:45:18 +0000 (16:45 +1000)]
Update packer version to 1.1.1

Change-Id: I95607aad0739700323fc36566e89ddf193dba576
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoRevert refspec change breaking submodule build 78/6978/1
Thanh Ha [Thu, 19 Oct 2017 14:02:22 +0000 (10:02 -0400)]
Revert refspec change breaking submodule build

Reverts change I65ef5886af59ec85841734f03bfac781194f780a which
introduced a breaking change for submodule projects inside a docs
project. Docs builds have a separate script which handles fetching
patches from Gerrit so should not be setting the refspec in the SCM
plugin.

Change-Id: I657a473a274b2831ad1470bb4895a2c8bcf3c92f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
(cherry picked from commit 85ebe3be68d3cc20f990e1f4adfd254b08f8c1f8)

7 years agoAdd M2_HOME to Maven parameters 75/6975/1
Thanh Ha [Thu, 19 Oct 2017 12:28:15 +0000 (08:28 -0400)]
Add M2_HOME to Maven parameters

Change-Id: I8557dbc46e742fbc5eeafecd3e23b060ceb200f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
(cherry picked from commit b00fefb9ade05788816a1b802644fc68614cdc64)

7 years agoMigrate Global JJB docs to RST 96/6896/6
Thanh Ha [Sun, 15 Oct 2017 20:44:08 +0000 (16:44 -0400)]
Migrate Global JJB docs to RST

This moves Global JJB documentation into RST docs and adds a
new checker which parses YAML files for items that are missing
documentation to ensure that every new template addition comes with
supporting documentation.

Tried to update documentation where it made sense too but we should
probably go back later and review all the items to make sure they are
all sufficiently documented. Especially macros which in many places are
lacking in required parameter documentation.

Change-Id: I6551e14f934a904378771262d1491cb5b3df5854
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd note to release notes v0.9.0 34/6934/1
Jessica Wagantall [Tue, 17 Oct 2017 18:25:03 +0000 (11:25 -0700)]
Add note to release notes v0.9.0

A new commit (74befe2) in global-jjb v0.9.0 introduced
the usage of crudini package. Add a note in the
release notes to make sure this package is installed.

Change-Id: If14c8f15d749cd95db3c5708aa897ec4a5f4b0e9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
7 years agoIgnore binary files when grepping 12/6912/2
Thanh Ha [Mon, 16 Oct 2017 18:16:08 +0000 (14:16 -0400)]
Ignore binary files when grepping

Change-Id: I798bda2e55036c3b4aab1cde2a07aca9d2191431
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Convert packer file-paths cfg to {obj:var}"
Andrew Grimberg [Mon, 16 Oct 2017 17:40:41 +0000 (17:40 +0000)]
Merge "Convert packer file-paths cfg to {obj:var}"

7 years agoUpdate RTD Gerrit job to check GERRIT_* variables 09/6909/4
Thanh Ha [Mon, 16 Oct 2017 17:14:07 +0000 (13:14 -0400)]
Update RTD Gerrit job to check GERRIT_* variables

This allows the job to handle branch '*' more easily..

Change-Id: I65ef5886af59ec85841734f03bfac781194f780a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Fix jjb-verify job to ignore the docs directory"
Andrew Grimberg [Mon, 16 Oct 2017 16:57:24 +0000 (16:57 +0000)]
Merge "Fix jjb-verify job to ignore the docs directory"

7 years agoFix jjb-verify job to ignore the docs directory 06/6906/2
Thanh Ha [Mon, 16 Oct 2017 16:31:01 +0000 (12:31 -0400)]
Fix jjb-verify job to ignore the docs directory

The non-ascii checker should not check the docs directory as that
directory does not contain jjb code.

Change-Id: I3ec988a308c67346f4ebe6cdd6e933a2f4637f5b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to v0.11.0-dev 03/6903/1
Thanh Ha [Mon, 16 Oct 2017 15:54:32 +0000 (11:54 -0400)]
Bump version to v0.11.0-dev

Change-Id: I6ea1d089e82fcbdc287751783344942651e7b495
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.10.0 85/6885/5 v0.10.0
Thanh Ha [Sun, 15 Oct 2017 18:15:26 +0000 (14:15 -0400)]
Release global-jjb v0.10.0

Change-Id: If8918550d84c703a6704b0e955e0a430bcb74250
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoMerge "Add Maven job to build dependencies with patches"
Thanh Ha [Mon, 16 Oct 2017 15:31:33 +0000 (15:31 +0000)]
Merge "Add Maven job to build dependencies with patches"