Thanh Ha [Tue, 13 Feb 2018 18:21:45 +0000 (13:21 -0500)]
Add a note about requiring jjbini configuration
Document that jjbini needs to include JJB 2.0 style configuration
sections for the "production" and "sandbox" systems.
Change-Id: I102c57774a75bd1545f21a67bb2d98ccb0f270a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Feb 2018 23:55:07 +0000 (18:55 -0500)]
Bump version to 0.17.0-dev
Change-Id: I9c352b633fcf83a0b60e2351401cd76c42df238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 9 Feb 2018 19:12:42 +0000 (14:12 -0500)]
Release global-jjb v0.16.0
Change-Id: I6acf020cda29198ad930ceeffe08e09ad0c7d6bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 00:24:56 +0000 (19:24 -0500)]
Create job to manage Jenkins Global Variables
Parses a configuration file containing variable listings in the form
"KEY=value" one per line and creates the appropriate groovy
script to push these environment variables to Jenkins Global Config.
Configuration file is stored in
ci-management/jenkins-config/global-vars-SILO.sh
(Where silo is production | sandbox)
While JJB provided us a way to store job configuration in a git repo
we have never had a good way to manage global Jenkins configuration.
This patch enables us to manage one aspect, Global Environment
variables in the ci-management repository.
Issue: RELENG-753
Change-Id: I7d134950b25d469686cace2f79fd8c297727166c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 9 Feb 2018 18:13:01 +0000 (18:13 +0000)]
Merge "Add pip.conf to wrappers"
Andrew Grimberg [Thu, 8 Feb 2018 21:26:14 +0000 (13:26 -0800)]
Update submodule documentation
Production deployments of global-jjb should be using the GitHub mirror
as their primary source as GitHub rarely has outages. This decouples the
master Gerrit instance from downstream consumption such that we are more
free to do maintenance whenever we desire.
Change-Id: I37139965902fa922cbb14f7ad01c22248bc1847b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Thanh Ha [Thu, 8 Feb 2018 04:19:43 +0000 (23:19 -0500)]
set +x around sensitive code docker login code
Call `set +x` as a guard just in case a script elsewhere is calling
`set -x` which could cause the credentials to print to console.
Change-Id: I6802887c7a3c9809d9d13d6b3cc90e3570f120fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jamo Luhrsen [Tue, 6 Feb 2018 03:28:23 +0000 (19:28 -0800)]
Add : to jjb-deploy:
This is more intuitive to me, as the keyword takes an
argument. I realized this when I used the ODL keyword
copy-logs:
Change-Id: Ic321d6be56ef518a2056099cb5690ea6880c16c2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Thanh Ha [Tue, 6 Feb 2018 16:36:31 +0000 (11:36 -0500)]
Add test to check for double curly braces
This will cause the build to fail if double curly braces are in
JJB output XML. This should help catch the JJB bug that adds
curly braces when using !include-raw-escape.
Issue: RELENG-777
Change-Id: Iaf9a9ef695229fa24dfc639ca60a4b9a9928a234
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Christopher Lott (cl778h) [Tue, 6 Feb 2018 16:11:18 +0000 (11:11 -0500)]
Repair shell-include directive
Change stage macro to use include-raw instead of include-raw-escape to
work around a JJB bug that inserts lftools_activate with double braces.
Change-Id: Iec5e0b12a287f1945eedc895a25dd16e74b47082
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
Thanh Ha [Mon, 5 Feb 2018 20:03:01 +0000 (15:03 -0500)]
Add maven metadata validator tool
Add a tool to validate maven-metadata.xml to catch timestamp issues
in builds and fail the build if a mismatch is detected.
Issue: RELENG-772
Change-Id: I35a7b9c3b12321a3a7af24ab36397e38ebb01de9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 20:46:58 +0000 (15:46 -0500)]
Add pip.conf to wrappers
This is a global-jjb breaking change as it now causes us to require
the pipconf file configured in Config File Provider. This allows us
to configure for projects that have Nexus 3 a PyPi proxy for faster
local downloads.
Contents of pip.conf should look something like:
[global]
timeout = 60
index-url = https://nexus3.opendaylight.org/repository/PyPi/simple
Change-Id: I4ac816f1b78f09c101e6d614bdd3c459fe0e133a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:24:26 +0000 (20:24 -0500)]
Allow goal override for maven-build macro
Splits out the maven-build into a macro that can be used
to allow projects to override the default goals if they
wish to tweak them for their projects.
Change-Id: I8cabbac997d165bfe8b68d76b78cdb4bb7cc4bbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:16:13 +0000 (20:16 -0500)]
Split maven-stage script into a reusable macro
Change-Id: If8d2208e2469d295637a9e82545b2289e5a7588b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 00:56:50 +0000 (00:56 +0000)]
Merge "Add sphinx link to rtd jobs page"
Thanh Ha [Thu, 1 Feb 2018 20:12:03 +0000 (20:12 +0000)]
Merge "Add Links to Plugins mentioned in README"
Thanh Ha [Thu, 1 Feb 2018 18:50:47 +0000 (13:50 -0500)]
Fix local platform file path
The local vars path is incorrect in the if-statement but
correct in the declaration below it. Update to match.
Change-Id: I1e8ec19adf842668fb46e54aaf8beebfcef9c34d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 1 Feb 2018 18:15:04 +0000 (13:15 -0500)]
Disable unbound variable checking for activate
virtualenv activate contains unbound variables so must be disabled
when calling `source activate`.
Change-Id: I8af6b55962580778fbb349c8164f661c4c462928
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 1 Feb 2018 02:26:16 +0000 (21:26 -0500)]
Add sphinx link to rtd jobs page
Change-Id: I67bf0e81fd3e6156cd31dbb4700c8909cf2bf87d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 31 Jan 2018 22:00:23 +0000 (17:00 -0500)]
deploy cleanup not removing all unmodified files
The linting patch If87fceb79e384e26f021a9c85a2e9d7413ce421e
broke the cleanup script so unmodified maven-metadata.xml files
were not properly being cleaned up before upload to Nexus. This
caused the maven-merge job to update maven-metadata.xml files
outside of what was actually modified. So when 2 maven-merge jobs
running on different streams are run at the same time they would
overwrite each other with old data.
Issue: RELENG-766
Change-Id: I18da721bfb5db6eef9c15ffabd4482e0aa24e3a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Sam Hague [Wed, 31 Jan 2018 13:31:56 +0000 (08:31 -0500)]
update docs to use minutes over seconds
Change-Id: Ia1e7b101ee6a3605d6c0ec4ac163a6f8c362921b
Signed-off-by: Sam Hague <shague@redhat.com>
Trevor Bramwell [Tue, 30 Jan 2018 18:41:12 +0000 (10:41 -0800)]
Add Links to Plugins mentioned in README
Includes a link to the download location of the PostBuildScript plugin
since it is no longer being released.
Change-Id: Ia2d34921fa9d870fd5792d938f9b2844853a38e9
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
Jessica Wagantall [Wed, 24 Jan 2018 00:31:47 +0000 (16:31 -0800)]
Add script to update Java alternatives
Use ${java-version} to set the correct java, javac
and java_sdk_openjdk alternative for lf-maven-jobs.
Issue-ID: RELENG-752
Change-Id: Iff0c2e7d92c4cc802925ae67cdda1f4247db52be
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 23 Jan 2018 00:14:53 +0000 (16:14 -0800)]
Remove jdk variable from lf-maven-jobs
Setting this variable to {java-version} creates some issues for
projects using the Ubuntu nodes as they need to use explicitly
'System' as their JDK version.
Change-Id: I0a12bc83f7c8c1c8fcdf8f2a1d5f47b8360b94c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Mon, 29 Jan 2018 22:20:55 +0000 (17:20 -0500)]
Bump default timeout to 15 minutes for tox
Increase tox jobs default timeout to 15 minutes. Considering many
things appear to be taking longer in Vexxhost this is likely
necessary.
Change-Id: I592146b1f0d47a9aedfdc91c1878a6f94b3d363c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Christopher Lott (cl778h) [Mon, 29 Jan 2018 17:51:21 +0000 (12:51 -0500)]
Refactor macro/template cron param
Be consistent with cron parameter: define in macro, use in template.
Never hard-code a trigger in a job template.
Document the parameters in the RST file.
Change-Id: I70a1deefd23bc9498f6c6013fb8751298dec7f53
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
Andrew Grimberg [Mon, 22 Jan 2018 23:02:07 +0000 (23:02 +0000)]
Merge "Split maven-deploy into a macro"
Thanh Ha [Mon, 22 Jan 2018 21:47:11 +0000 (16:47 -0500)]
Bump global-jjb to 0.16.0-dev
Change-Id: I0f5e3d41bcdc3f6938208d3b710b20df9dfb5c70
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 22 Jan 2018 02:02:41 +0000 (21:02 -0500)]
Release global-jjb v0.15.0
Change-Id: I1186feb6ff4fefb5311bcfb84ad34b4001b9cef7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 16:50:13 +0000 (11:50 -0500)]
Increase maven-jobs default timeout to 60 mins
The new Vexxhost cloud seems to be slower in general and
continuous to cause OpenDaylight grief when it comes to running
jobs. Increase the timeout to 60 mins to account for the slower
infra.
Change-Id: I04325ce9d700ac4879a17f1b0547bc0b861c7cac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:10:24 +0000 (20:10 -0500)]
Split maven-deploy into a macro
Split out maven-deploy into a reusable macro.
Change-Id: I6ddad68576cdbf9d9ef8b4805da94dc6a80cbefd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:02:36 +0000 (01:02 +0000)]
Merge "Improve verbosity in maven shell scripts"
Thanh Ha [Thu, 18 Jan 2018 19:22:07 +0000 (14:22 -0500)]
Use clean install for Sonar
The Sonar job does not need to deploy so switch to using
`mvn clean install` to build the project before running
sonar scan.
Change-Id: I577a57417d0c56f403e66b9fb7201bf58fef818e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 18 Jan 2018 19:20:46 +0000 (14:20 -0500)]
Improve verbosity in maven shell scripts
There is no harm in enabling debug level verbosity for these scripts
and may help in improving troubleshooting.
Change-Id: I9edfee2f7d2415117d854ad7cdba280cc9751004
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 17 Jan 2018 20:23:26 +0000 (15:23 -0500)]
Revert "Switch global-jjb to lfdocs-conf"
Need to revert because conf.yaml causes deployment issues in
jjb recursive runs as it's not expecting a non-jjb yaml. Let's
not use lfdocs-conf in global-jjb until we have a way around
that.
This reverts commit
ac79981ec42d37f943c2a4159e2980913cb1716d.
Change-Id: I0eb5d269b31c76e5da7affd80d93715cee8e4037
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 17 Jan 2018 19:26:54 +0000 (14:26 -0500)]
Default to python2 for tox
This caused many ODL projects to break due to it now assuming
py3 by default. The only project that needs python3 tox run is
Acumos so let us default this back to python2 which is the OS level
default and explicitly set python3 in Acumos.
Change-Id: I97df6eee112a2e9e1e8d18eb9e16990a1c703538
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 17 Jan 2018 03:08:58 +0000 (22:08 -0500)]
Switch global-jjb to lfdocs-conf
Consolidate conf.py into lfdocs-conf package.
Change-Id: I18b975acaa2ef28dfdaeb9ebf29357a9ed58202d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 16 Jan 2018 14:22:59 +0000 (09:22 -0500)]
Set default archive patterns for maven-verify
Adds some default archive patterns for the maven-verify job
template.
Change-Id: I18e85f859fbba088ab338672f4fb28e7a02787af
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 15 Jan 2018 19:15:23 +0000 (19:15 +0000)]
Merge "Add maven-merge job to maven job group"
Thanh Ha [Mon, 15 Jan 2018 19:10:22 +0000 (14:10 -0500)]
Add maven-merge job to maven job group
Tested this for a couple weeks now. Let's start deploying it
more broadly.
Change-Id: Iddefb7a53668c311a41cc8b8bf216cb97e3c1bd2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 15 Jan 2018 18:47:27 +0000 (13:47 -0500)]
Add -e flag to mvn calls
Enables full stack traces and display execution errors during
maven output.
Change-Id: Idb16eb1187bcf857530b6288ed8728de8cabdf69
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 15 Jan 2018 19:05:50 +0000 (19:05 +0000)]
Merge "Do not force expected-xml"
Anil Belur [Sun, 14 Jan 2018 23:11:45 +0000 (09:11 +1000)]
Print file size before deploy maven file to nexus
The size of the file is useful to determine if nexus deploy failures
are due to the file size exceeding the limits.
Change-Id: I1c0eda93ab964a30e37ea910a7a5859a65de8ee3
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Sat, 13 Jan 2018 17:05:34 +0000 (12:05 -0500)]
Do not force expected-xml
After using this for a few months now I'm convinced this is not the
right way to achieve what we want here. XML differences should be
informational and not build breaking. Pretty much every change
requires XML changes so I think this has been more annoying than
helpful.
This new patch removes expected-xml and instead outputs XML diffs
instead which can be stored in logs and reviewed.
Change-Id: Ia4039489502499df1b15a4d9fe1e553af3c5bfcd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 13 Jan 2018 17:03:40 +0000 (12:03 -0500)]
Fix default platform location to common-packer
The default search path should be common-packer and only loading
the local project's version if it exists.
Change-Id: Iae1af0e804806ef99761c2e02a39214443a74b23
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 13 Jan 2018 04:09:06 +0000 (23:09 -0500)]
Bump packer build timeout to 90 minutes
With all of the consolidation of packaging into the new baseline
scripts as well as known slowness in Vexxhost builds for baseline
are now taking around 60 minutes to run. Bump to 90 minutes so that
there is a buffer for us to continue developing baseline.
Change-Id: I195a74d902111c937bebf7c8e599a3d641e74a37
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 12 Jan 2018 21:18:03 +0000 (16:18 -0500)]
Add a check for missing vars/*.json
If a project does not have any then we should detect it and skip
trying to parse those files.
Change-Id: I9fd1fee88a68e745709779de9fec3f2013b7483f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 12 Jan 2018 21:56:34 +0000 (16:56 -0500)]
Update expected xml to JJB 2.0 format
Change-Id: I73ac8158a85559ec8d09682b8192aecb7f78ba8b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jamo Luhrsen [Fri, 12 Jan 2018 06:08:46 +0000 (06:08 +0000)]
Merge "Install git-review outside of loop"
Thanh Ha [Fri, 12 Jan 2018 02:23:45 +0000 (21:23 -0500)]
Fix detox logs not being archived
Since we immediately fail on any shell errors we miss log
collection at the end of the build. Fix detox part of script to
allow the log collection code to run.
Change-Id: I50bcd337224adcecbf028f08b56cfebe2e10a3d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 12 Jan 2018 03:26:39 +0000 (22:26 -0500)]
Allow tox-install to handle base python ver
Turns tox-install.sh into a proper macro allowing the user to choose
which base Python version to use in the tox virtualenv.
Issue: RT-50802
Change-Id: Iff578f4cfa39ce6b2540be45537931e6a3b48d22
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 11 Jan 2018 23:27:16 +0000 (18:27 -0500)]
Enable pyenv if available in image
We need pyenv so that tox can pull in Python versions provided by
the pyenv setup.
Issue: RT-50802
Change-Id: I406f28e10e2d701f5f8fd396fea10d81bffd61a8
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 11 Jan 2018 20:21:21 +0000 (15:21 -0500)]
Install tox-pyenv
Need tox-pyenv so that tox can automatically pick up pyenv
installations.
Issue: RT-50802
Change-Id: I601f8d7a21cab0a215947ff1d882c6666be0cf65
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 10 Jan 2018 22:39:23 +0000 (17:39 -0500)]
Install git-review outside of loop
Mistakenly put the virtualenv bits inside of a loop. Minor
issue and code still works without this patch but should move
it as best practice.
Change-Id: I047ec5f67daea10ef71bc151a2999f6a2235e44f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jessica Wagantall [Thu, 11 Jan 2018 20:25:34 +0000 (12:25 -0800)]
Add Gerrit trigger to clm job
Add Gerrit trigger on comment "run-clm" for Gerrit and Github
clm jobs.
Change-Id: I220bc93e147d278fab09420cabf7c14feb874b97
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Wed, 10 Jan 2018 22:29:45 +0000 (22:29 +0000)]
Merge "Add script to print all creds in Jenkins"
Jessica Wagantall [Wed, 10 Jan 2018 20:22:25 +0000 (12:22 -0800)]
Add script to print all creds in Jenkins
Add groovy script to run in the script console
that will display all credentials registered in Jenkins in
an Id : Password format.
Change-Id: I81d74a72a1bb5558c7230a6da7a5de055de809c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Wed, 10 Jan 2018 21:41:57 +0000 (16:41 -0500)]
Bump version to v0.15.0-dev
Change-Id: I0fff3b7dd581d1a5cd50382c551d0f9681211ce2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 10 Jan 2018 21:31:08 +0000 (16:31 -0500)]
Release global-jjb v0.14.1
Change-Id: Ice69cad332a65f91db0d558130f6ae2d51767a57
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Daniel Farrell [Wed, 10 Jan 2018 20:58:27 +0000 (15:58 -0500)]
Don't try to pushd into dir that doesn't exist
Just download packer into WORKSPACE vs bothering with a tmp packer dir.
Change-Id: Id97f3ae4635dc7a685a0d1e58effd24ee312c703
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
Thanh Ha [Wed, 10 Jan 2018 20:46:11 +0000 (15:46 -0500)]
Release global-jjb v0.14.0
Change-Id: Ic0a55eba3dac5759af7d8f276f30af8690d4e30f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 10 Jan 2018 18:40:39 +0000 (13:40 -0500)]
Update remote gerrit to use GERRIT_URL
Because GIT_BASE and GIT_URL now point to a git mirror
that is not a Gerrit system we need to set it up with
GERRIT_URL anonymous http.
Change-Id: I8f4eccf89dc14d7c27d353b00a7595fdcded70b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Wed, 10 Jan 2018 18:40:13 +0000 (18:40 +0000)]
Merge "Use detox to run tox in parallel"
Thanh Ha [Tue, 9 Jan 2018 18:01:59 +0000 (13:01 -0500)]
Update merge job to work with common-packer
This patch requires that projects upgrading to the next global-jjb
release to now require common-packer.
Change-Id: I4d85452801e4eff78f33b86afba4c7d23dd3d678
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 9 Jan 2018 17:49:21 +0000 (12:49 -0500)]
Update packer file_path triggers
Changes to migrate our scripts to ansible now requires us to update
these filepath triggers.
Issue: RELENG-288
Change-Id: I82e457aa2453c6446e30ddb9c567ecd8ad71878c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Tue, 9 Jan 2018 09:21:14 +0000 (19:21 +1000)]
Improve packer-validate debugging output
This patch achieves 3 tasks:
1. Improves the debugging output provided by printing out the
details about which vars and templates files are being tested.
2. Fixes an issue where packer was not actually testing every
combination of varfile and template file due to cloud-env.json.
3. Includes common-packer vars files if available (should silently
ignore if it does not exist).
Issue: RELENG-744
Change-Id: Id6e1f2423a378cbe376ccefe2568c22669fb7859
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 4 Jan 2018 02:10:02 +0000 (21:10 -0500)]
Use detox to run tox in parallel
Rather than hacking something together with parallel use a tool
supported by the tox project called detox.
Change-Id: I04fc3a083c420f71938b99f942b682093822ddda
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Tue, 9 Jan 2018 23:37:00 +0000 (09:37 +1000)]
Fix ShellCheck v0.4.7 lint issues
v0.4.7 introduces some new rules which now need to be handled.
Change-Id: If87fceb79e384e26f021a9c85a2e9d7413ce421e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Tue, 9 Jan 2018 14:44:07 +0000 (14:44 +0000)]
Merge "Base sigul macros and scripts"
Andrew Grimberg [Wed, 3 Jan 2018 16:22:37 +0000 (16:22 +0000)]
Merge "Allow SONAR_MAVEN_GOAL to be configurable"
Thanh Ha [Thu, 28 Dec 2017 17:48:51 +0000 (12:48 -0500)]
Bump version to v0.14.0-dev
Change-Id: Idbda87687afcfc631e409a4e53d2e6045c1bddf9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 28 Dec 2017 17:41:41 +0000 (12:41 -0500)]
Release global-jjb v0.13.1
Change-Id: Ib1b5dbcf8d941c70c4aadc36f936701ea0e7953b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 28 Dec 2017 17:21:27 +0000 (12:21 -0500)]
Prioritize MAVEN_PARAMS to override OPTIONS
MAVEN_PARAMS (user defined) can override MAVEN_OPTIONS (gjjb defined)
but only if it comes last on the CLI. Re-shuffle the variables so that
the desired prioritization can take affect.
RT 50181
Change-Id: Ib79cf11625e9b2d1f279b721f3a90a31e04020dc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 28 Dec 2017 01:48:36 +0000 (20:48 -0500)]
Allow SONAR_MAVEN_GOAL to be configurable
Per reports on the mailing list Sonar jobs are broken in OpenDaylight.
This is because Sonar release a new plugin which only works with newer
versions of Sonar so until we can upgrade we need to allow flexibility
to configure the Sonar job to override the default sonar:sonar goal.
With this patch it is now possible to override the Sonar goal in JJB
and force an older version of the Sonar plugin to run using a JJB
defaults config or projects variable like this:
sonar-mvn-goal: org.codehaus.mojo:sonar-maven-plugin:3.3.0.603:sonar
Unfortunately due to the defaults priority of JJB since we are
defining the sonar-mvn-goal parameter inside of the job template it
can only be overrided via a project section.
Reports:
https://lists.opendaylight.org/pipermail/release/2017-December/013119.html
https://lists.opendaylight.org/pipermail/release/2017-December/013223.html
Change-Id: I04512613f39e7c328e0f2f18d9c4729667e86909
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 27 Dec 2017 22:15:41 +0000 (22:15 +0000)]
Merge "Make sysstat script more readable"
Anil Belur [Tue, 19 Dec 2017 09:35:12 +0000 (19:35 +1000)]
Make sysstat script more readable
Change-Id: I10415a461d57ad8c0e7f95b4bfea5327a6b14e72
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Fri, 15 Dec 2017 15:51:54 +0000 (01:51 +1000)]
Update packer version to 1.1.3
Change-Id: I7c0b4255d9b06ffd8833146be68982099768676c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Wed, 13 Dec 2017 22:24:53 +0000 (17:24 -0500)]
Bump CLM job timeout to 30
Noticed today that many OpenDaylight CLM jobs are failing the
CLM 15 minute timeout. With the move to Vex where we have less
cores in our builds too bumping the timeout to 30 to account for
longer build times.
Change-Id: I69e2d32d10a04584bb2d66fab73583b70a3fc066
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 11 Dec 2017 18:14:22 +0000 (13:14 -0500)]
Bump version to v0.14.0-dev
Change-Id: I39d13bf084223b38f2da70158651f14a7ae13e59
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 11 Dec 2017 18:10:32 +0000 (13:10 -0500)]
Release global-jjb v0.13.0
Also fix previous release notes titles.
Change-Id: I967131a7f89c56d132a6d8eae0411c1d6cf2b003
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 20:44:08 +0000 (16:44 -0400)]
Migrate Maven Merge job to global-jjb
Provide a Maven Merge job that is generically reusable by other
projects. This new job uses cURL to upload artifacts to Nexus and uses
`wget -r` to mirror existing maven-metadata.xml files in order to update
them when pushing SNAPSHOTs.
This job uses the following strategy to deploy jobs to Nexus:
1. `wget -r` to fetch maven-metadata.xml from Nexus
2. `mvn deploy -DaltDeploymentRepository` to prepare files for upload
3. Removes untouched maven-metadata.xml files before upload
4. Use lftools (cURL) upload script to push artifacts to Nexus
Issue: RELENG-61
Change-Id: I7663731d0eb750e4ccc1b07bcf5ad39c6135900c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Fri, 22 Sep 2017 14:23:19 +0000 (07:23 -0700)]
Base sigul macros and scripts
Before any jobs can be created using sigul we need to have some basic
scaffolding for setting up the sigul enviroment.
Changes to lftools to extend the signing command to leverage sigul will
then allow us to create a meta macro which combines this scaffolding
into a single cohesive macro.
Change-Id: I080c1eb7271a2a64559b2c2f7b1011be1e9a8b16
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Jeremy Phelps [Wed, 15 Nov 2017 00:39:57 +0000 (18:39 -0600)]
Fix branch on verify and merge jobs
This fixes the branch parameter
on verify and merge jobs to be
refs/heads/{branch} and $sha1
respectively.
Change-Id: I230e04fda467848c5e764c90bf9190416b72dac4
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Jeremy Phelps [Tue, 14 Nov 2017 20:44:21 +0000 (14:44 -0600)]
Fix branch variable in github scm
The branch variable should not be
concatenated with refs/heads.
GHPRB makes use of variables to
put here.
Change-Id: I54c6f3f51b734b894abb090d4473683a3e34fa06
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Andrew Grimberg [Tue, 14 Nov 2017 19:01:34 +0000 (11:01 -0800)]
Bump to v0.13.0-dev
Change-Id: I92a54cc34ad23a666f90aa76e1168a87235a686c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Andrew Grimberg [Tue, 14 Nov 2017 18:50:36 +0000 (10:50 -0800)]
Release global-jjb v0.12.0
Change-Id: I706b80fcdc695d3fb2b25984d65d352ba688b559
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Andrew Grimberg [Tue, 14 Nov 2017 18:41:24 +0000 (18:41 +0000)]
Merge "Add npm config script"
Jeremy Phelps [Tue, 14 Nov 2017 16:11:03 +0000 (10:11 -0600)]
Add branches parameter to github scm macro
Make sure that the github scm macro accepts
branches as a configuration option like the
gerrit version of the macro.
Change-Id: Ife15943fa3fc094e20981f804f7036133d881f46
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Anil Belur [Mon, 13 Nov 2017 02:02:52 +0000 (12:02 +1000)]
Enable maven jobs to archive artifacts
Projects which use the maven jobs in global-jjb may
require to archive additional logs such as surefire
reports. This needs to be handled by globstar patterns
passed through the projects using these templates.
Change-Id: I97dc8801a0fb05cccf75f32ad7ad621cb6e974bf
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jeremy Phelps [Mon, 6 Nov 2017 20:20:55 +0000 (14:20 -0600)]
Add npm config script
Change-Id: I12a9af7f6926660143e40b2382b44e7af606ff00
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Jeremy Phelps [Tue, 7 Nov 2017 20:24:44 +0000 (20:24 +0000)]
Merge "Move jjb-version to templates"
Jeremy Phelps [Tue, 7 Nov 2017 17:46:35 +0000 (17:46 +0000)]
Merge "Add install goal to javadoc job"
Thanh Ha [Fri, 3 Nov 2017 18:13:07 +0000 (14:13 -0400)]
Move jjb-version to templates
It appears that `job-group` definitions take priority over `project`
definitions. Move it to the template so that we can override the
parameter correctly.
Change-Id: I2b824e3cc89667698db8ebfdd3ce43f551e961d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jeremy Phelps [Fri, 3 Nov 2017 15:26:06 +0000 (15:26 +0000)]
Merge "Add npmrc config file to lf-infra-wrappers"
Jeremy Phelps [Wed, 18 Oct 2017 17:55:14 +0000 (12:55 -0500)]
Add npmrc config file to lf-infra-wrappers
Change-Id: I2bafb9a9787f6820243e1ee19861fb8fc45670d7
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Anil Shashikumar Belur [Fri, 3 Nov 2017 14:52:53 +0000 (14:52 +0000)]
Merge "Add note on JJB defaults"
Thanh Ha [Thu, 2 Nov 2017 14:36:59 +0000 (10:36 -0400)]
Add install goal to javadoc job
It turns out javadoc needs to have the artifacts available to them in
order to run javadoc:aggregate. In some cases this means artifacts
installed to the local maven repo. This patch adds the install goal as
well as ensuring we continue to skip tests, checkstyle, and findbugs to
keep the jobs running quick.
Change-Id: I3ffa36b207a1412e0489d6c20a91ffcd3ac93c27
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 30 Oct 2017 16:30:17 +0000 (12:30 -0400)]
Bump to v0.12.0-dev
Change-Id: I5eaaa3d84e66a0216225c9b4a16baedf4393d461
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 30 Oct 2017 16:10:54 +0000 (12:10 -0400)]
Release global-jjb v0.11.0
Change-Id: Ieaf88baf73a8a1563164879555d25732303ebf8d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 30 Oct 2017 15:50:18 +0000 (11:50 -0400)]
Cat the failed tox-envs
Before failing the build we should print the problematic tox
environments into the console to make it easier for folks to
troubleshoot. We are still archiving the individual tox runs but the
console logs will now also contain the errors.
Issue: RELENG-611
Change-Id: Ie6fd132c0de69e8448d320d23daaed811a0d47a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>