Thanh Ha [Thu, 3 May 2018 14:07:34 +0000 (10:07 -0400)]
Remove maven_metadata_validate function
This function was originally added to detect a bug with Maven 3.5.1
and earlier. At the time the OpenDaylight community was not yet ready
to migrate to 3.5.2 from 3.3.9 so we implemented this function as a
way to detect the metadata issues.
This function ended up causing some edge case issues and is not worth
maintaining. Remove the function and recommend all projects use Maven
3.5.2 as a minimum.
The specific issue in Maven was that sometimes the deploy phase would
generate an off by one timestamp mismatch between the metadata and the
filename of the artifacts. This causes invalid metadata and then
builds against affected artifacts fail.
Issue: RELENG-927
Change-Id: I65f4f6dc73382b91940620aba587f5fe56259eb1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Vanessa Rene Valderrama [Tue, 24 Apr 2018 19:58:26 +0000 (14:58 -0500)]
Configure tox tests allow serial execution
Configuring tox tests to allow serial or parallel execution configurable
within JJB by setting the PARALLEL parameter to true or false.
Issue: RELENG-912
Change-Id: If2edba598b47484b1708f1e0f3fb96f035511841
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Thanh Ha [Fri, 16 Mar 2018 18:45:24 +0000 (14:45 -0400)]
Add instructions on how to test script locally
Useful for debugging the jenkins-cfg job if something is not working.
Change-Id: I6062b754fb01a8da60ac73472133aa2dfd4ae2fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 18:25:07 +0000 (13:25 -0500)]
Print out heading information
Makes the output a bit more structured.
Change-Id: Ieedcbf97af01cec63604c2907d6f74177271a64d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Apr 2018 16:25:06 +0000 (12:25 -0400)]
Sort packer macros alphabetically
Change-Id: I382cd173ca7e08cb3d69af874e74b8ce8d92d65b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Apr 2018 16:21:58 +0000 (12:21 -0400)]
Simplify packer-parameters macro name to just lf
The lf namespace is lf, not need to set lf-infra everywhere.
(We should go through and reduce this for other instances in
the future).
Change-Id: I629f378e1973ad0f7051df1d8aa15c3bb62f676d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Apr 2018 16:19:30 +0000 (12:19 -0400)]
Set default packer variable in job-template
Also add documentation for the packer parameters macro.
Change-Id: Ib1532c508196ee3fabbac0137aeb0fd2e10904f4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 24 Apr 2018 16:31:59 +0000 (12:31 -0400)]
Skip vote for jjb-deploy
This job should not be voting.
Issue: RELENG-918
Change-Id: Ia53fe0485e4187d85ecca4e6c48aacda6a997786
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Mon, 23 Apr 2018 22:40:58 +0000 (22:40 +0000)]
Merge "Add generic push changes to gerrit builder"
Jessica Wagantall [Fri, 20 Apr 2018 01:03:02 +0000 (18:03 -0700)]
Update XC CLM job parameters
- Remove unused archive-artifacts log patterns
- Many of these are Maven related and unused in Python.
- Adjust NEXUS_IQ_CLI_VERSION parameter name to unspecify
CLI format.
Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221
Change-Id: I0dde9b18468d52574b969c1f83c93f8ff0950faa
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 20 Apr 2018 00:44:06 +0000 (17:44 -0700)]
Add docs for Python XC CLM
Add documentation for Python XC CLM:
- Description of the job
- Job templates
- Description of parameters
Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221
Change-Id: I19713d37aa38159f26e437c961b6d1b4fa6f77fc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Mon, 23 Apr 2018 17:52:39 +0000 (17:52 +0000)]
Merge "Rename sonar-cli.sh to nexus-iq-cli.sh"
Anil Belur [Mon, 9 Apr 2018 09:22:15 +0000 (19:22 +1000)]
Add generic push changes to gerrit builder
This is a generic version of the script to push a change through
a job to Gerrit in an automated fashion. Projects can reuse this
macros when they have jobs which requires to push a change to
gerrit.
RELENG-769
Change-Id: I4d269a4dad6ddbd509a134306b61b2214194b479
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Fri, 20 Apr 2018 18:47:16 +0000 (14:47 -0400)]
Fail Sphinx build even on warnings
Resolve warnings caused by the -W flag.
Change-Id: I0c771da88af487e3a6ddb55b01d524d5a274226d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 20 Apr 2018 18:46:52 +0000 (14:46 -0400)]
Bump version to 0.19.0-dev
Change-Id: I000964a1bd8a4d7a9ed09fb29b130258e63ba922
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 18 Apr 2018 21:23:32 +0000 (17:23 -0400)]
Release global-jjb v0.18.0
Change-Id: I0538f3c15e6df43369ef5e7756a76236d52d0a9e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 20 Apr 2018 16:24:16 +0000 (16:24 +0000)]
Merge "Update JJB version 2.0.5"
Anil Belur [Fri, 20 Apr 2018 14:19:56 +0000 (00:19 +1000)]
Update packer version to 1.2.2
Change-Id: I188bb7b14e5122afc25b64765d846c4d1298e8f6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jessica Wagantall [Fri, 20 Apr 2018 00:55:42 +0000 (17:55 -0700)]
Update comment triggers XC CLM
Update comment triggers for Python XC CLM
jobs. From "run-xc-clm" to "run-clm" to make it more
consistent with other clm jobs.
Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221
Change-Id: I637d03805e19460c6c9abb20af61ee4d9d34763e
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 20 Apr 2018 00:50:49 +0000 (17:50 -0700)]
Rename sonar-cli.sh to nexus-iq-cli.sh
Rename sonar-cli.sh script to nexus-iq-cli.sh since
it is a more appropriated name for this script as Sonar
tasks are not involved on this job. Just Nexus-IQ scans.
Change-Id: I39a48c1cb8e24ad669a9a7f0ab4a7fcdb57ff1d5
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Thu, 19 Apr 2018 17:46:29 +0000 (13:46 -0400)]
Add new odl- flavors to cloud list
Change-Id: Icf5551056956f8d10367b3bf1efa106b1ce0b395
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Wed, 18 Apr 2018 11:03:06 +0000 (21:03 +1000)]
Update JJB version 2.0.5
JJB version 2.0.5 contains most recent changes required
to update and manage views on Jenkins.
RELENG-76
Change-Id: Ib230f452b060a21ed02229ff292198c6384ce44d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Sat, 14 Apr 2018 17:15:07 +0000 (13:15 -0400)]
Replace pipdeptree with pip freeze
While pipdeptree provides more detailed information it's
dependency with pip seems to break things if we don't
install in the correct order. Let's revert to pip freeze
for now until we have a better way to maintain these debugging
packages.
Issue: RELENG-884
Change-Id: Ib6d3008e2d0e195bc9a01a1c4dd476d92a9deace
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 14 Apr 2018 17:10:25 +0000 (13:10 -0400)]
Pin pip to 9.0.3
Pin pip versions to 9.0.3 in all scripts that try to install pip.
Issue: RELENG-884
Change-Id: I25df8beb412e06d14db88d90debafa46013bb7ac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jessica Wagantall [Thu, 12 Apr 2018 21:53:23 +0000 (21:53 +0000)]
Merge "Add lf_tox_sonar job"
Jessica Wagantall [Tue, 10 Apr 2018 22:24:16 +0000 (15:24 -0700)]
Add lf_tox_sonar job
Python jobs uses tox.ini to configure
their project coverage report. Adding a tox call
before the sonar calls makes the proper updates
to the reports based on that coverage.
Change-Id: I4e6787274ae15c1a9b3b866a55e02f3587b906fb
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Wed, 11 Apr 2018 18:12:53 +0000 (18:12 +0000)]
Merge "Update RTD to use Generic API v2 webhook"
Jeremy Phelps [Wed, 11 Apr 2018 18:00:19 +0000 (13:00 -0500)]
Update default jjb version
JJB contains bits in postbuildscript
publisher that require a minimum of
version 2.0.3.
Change-Id: Ibc62684a9b7dec125064fb5ce823e3f6452581db
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Jeremy Phelps [Tue, 27 Mar 2018 16:45:57 +0000 (11:45 -0500)]
Update RTD to use Generic API v2 webhook
The old tokenless generic trigger url has been deprecated. Update
to using the new v2 API that requires a token.
This is a backwards incompatible change and modifies 2 things:
* rtd-project is now the rtd-build-url parameter
* rtd-token is a new required parameter
Issue: RELENG-879
Change-Id: I786240ab14cf95a2896d92d1c87aef9d7815d964
Co-Authored-By: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 10 Apr 2018 20:27:23 +0000 (16:27 -0400)]
Force rm for cleanup macro
Using -f (force) rm will return a 0 status and not print a
message if a file is not found.
Issue: RELENG-880
Change-Id: Ia06166362526cf00754b4a21e6b977d57fe91db6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 10 Apr 2018 20:23:50 +0000 (16:23 -0400)]
Fix pipconf name to the default one
In Managed Files we do not give the filename a dot so remove
it to match what we really look for.
Change-Id: Iaa5df87921d7d7333ecb87bc11c707884e4fb277
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Sat, 7 Apr 2018 00:30:22 +0000 (00:30 +0000)]
Merge "Validate packer version before install"
Ry Jones [Thu, 5 Apr 2018 15:27:09 +0000 (08:27 -0700)]
Fix pip version
pip has released a beta version which breaks pipdeptree.
RELENG-868
Change-Id: I755a2521f28fc6441a69dd0ed93c0f85502b787b
Signed-off-by: Ry Jones <ry@walledcity.org>
Anil Belur [Mon, 26 Mar 2018 22:03:25 +0000 (15:03 -0700)]
Validate packer version before install
Packer 1.1.3 is the minimum version required to be installed
to build images on vexxhost. The install script does not check
the version and only checks the availability of the binary in the
$PATH before updating packer.
JIRA: RELENG-838
Change-Id: I8c343176d8f39e3e70b04dddbdec94ffed4354b1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jeremy Phelps [Tue, 3 Apr 2018 13:40:56 +0000 (08:40 -0500)]
Pin tox to <3.0.0 as it breaks detox
Issue-ID: RELENG-856
Change-Id: Id13aee7244cce6328fd10cbe495b5fb3e7069924
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Wed, 28 Mar 2018 16:47:02 +0000 (16:47 +0000)]
Merge "Revert "Update RTD to use custom trigger url""
Thanh Ha [Wed, 28 Mar 2018 16:40:52 +0000 (16:40 +0000)]
Revert "Update RTD to use custom trigger url"
This reverts commit
12d6179c0e7c208a360a3c61c0b715b49310b39e.
Change-Id: I87a8f3b25ab977cdcfd3c23da6cebd610edaf325
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Wed, 28 Mar 2018 16:23:13 +0000 (16:23 +0000)]
Merge "Export packer binary dir in $PATH"
Jeremy Phelps [Tue, 27 Mar 2018 16:45:57 +0000 (11:45 -0500)]
Update RTD to use custom trigger url
The generic trigger url is now deprecated. Going forward
users will have to use the Generic API incoming webhook
that is defined per project in the read the docs service.
Change-Id: Iac0774266e787705e7fb903712cbfb4b4a41fb55
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Wed, 21 Mar 2018 17:11:02 +0000 (13:11 -0400)]
Add link to release notes
Issue: RELENG-552
Change-Id: Ifddf4463ac6afa2395be25cddf989fe05dd9fec1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 19 Mar 2018 19:55:02 +0000 (19:55 +0000)]
Merge "Quit build if submodule not found"
Thanh Ha [Mon, 19 Mar 2018 19:30:08 +0000 (15:30 -0400)]
Quit build if submodule not found
In the monolithic docs build we only care to build if the
project is really a submodule of the monolithic docs build.
If not then skip the build as the project should be providing
their own docs verify job.
Issue: RELENG-845
Change-Id: I9bc146170e150097b3b9a30ec0456173bba9b1ef
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Mon, 19 Mar 2018 17:37:46 +0000 (17:37 +0000)]
Merge "Support PostBuildScript 2.x"
Thanh Ha [Sun, 18 Mar 2018 03:55:41 +0000 (23:55 -0400)]
Ensure setuptools is updated
Similar to pip, we should ensure that setuptools is updated as well.
pip 9.0.2 appears to break without setuptools also being updated.
Change-Id: I3b66140a1a5b292a6e44e955b31ddd62cdc6ed03
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 16 Mar 2018 18:47:18 +0000 (14:47 -0400)]
Add support for VolumeFromImage boot source
Allows us the ability to configure a volume size for images. This
feature requires OpenStack Cloud Plugin 2.32 to use.
Change-Id: Ic557373c16afc3df3af3571e5f3883f5b18e8e8c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Fri, 16 Mar 2018 06:44:07 +0000 (06:44 +0000)]
Merge "Document job-group defaults order of priority"
Anil Belur [Thu, 15 Mar 2018 12:55:28 +0000 (22:55 +1000)]
Export packer binary dir in $PATH
Add packer binary path to $PATH to avoid packer being
installed multiple times in builder merge jobs.
JIRA: RELENG-838
Change-Id: Ie414ff39d0829135cc797b187f693930cf45c6d5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 01:48:09 +0000 (21:48 -0400)]
Support PostBuildScript 2.x
This is a breaking change that requires consumers of global-jjb
to switch to JJB 2.0.3 and install PostBuildScript 2.x in Jenkins.
It updates lf-infra-publish macro to switch to the PostBuildScript 2.x
YAML definitions.
Issue: RELENG-832
Change-Id: I04020587acfb8b6550c0221ebfb97a501f46b15a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 15:15:28 +0000 (11:15 -0400)]
Bump version to 0.18.0-dev
Change-Id: Ib2d45332a9626b0aaf82443e1f37846a00569e46
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 01:24:16 +0000 (21:24 -0400)]
Release global-jjb v0.17.0
Change-Id: I13cf313e1875eabb50290c2409ef632eaa7183f7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 3 Nov 2017 19:20:03 +0000 (15:20 -0400)]
Document job-group defaults order of priority
We discovered that job-group variable definitions appear to
have higher precedence than project definitions. This caused a problem
for us in global-jjb as we would like to allow projects to override
default variables.
We should make it best practice that global-jjb stops providing
job-group definitions and deprecating any existing job groups.
Via patch I2b824e3cc89667698db8ebfdd3ce43f551e961d7 we were able to
resolve this for JJB version.
Change-Id: I93c8256193933a04e8732963216f69424cef3a5f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 12 Jan 2018 19:10:06 +0000 (14:10 -0500)]
Document pyenv usage in the tox job
Change-Id: Id07a1e4065b03489260dfe1d0b86cacf8d60238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 01:00:15 +0000 (21:00 -0400)]
Pin JJB to 2.0.2 for tests
JJB >2.0.2 requires use to update our shiplogs postbuildscript as
support for the 2.x version of postbuildscript takes over the
default code path.
Change-Id: Iff3cd415f12a54aa3fcbf48d7f10b6df01cd1279
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jessica Wagantall [Wed, 7 Mar 2018 01:10:41 +0000 (17:10 -0800)]
Add CLM support for Python
Add template to support CLM scans for python
based projects. This template uses the nexus-iq-cli
package directly and executes an extended report to
scan python based projects.
Change-Id: I5e5c420539ab3a3e5b292620da4418c16d557221
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Wed, 7 Mar 2018 01:41:00 +0000 (20:41 -0500)]
Add explicit links for Packer jobs
Change-Id: I90e4d89008f0f6550f640a8c03b268d1bde884e9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 18 Jan 2018 16:09:36 +0000 (11:09 -0500)]
Add script to manage Jenkins cloud cfg
A groovy script to manage the Jenkins global cloud cfg
programmatically. This script reads configuration from
the directory jenkins-config/clouds to configure cloud
configuration in Jenkins. Refer to the documentation for
details.
No upgrade consideration is necessary as this script
automatically detects the absence of the jenkins-config/clouds
directory and disables the Cloud configuration.
Issue: RELENG-804
Change-Id: Idad3078942618b7d8fd08a40bf9e4e5ed5a0dc48
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Lott, Christopher (cl778h) [Thu, 1 Mar 2018 14:40:28 +0000 (09:40 -0500)]
Make rtd jobs verbose
Add set -x flag so these scripts echo steps in Jenkins output.
Change-Id: Ia09f3194407f6c94d8cb1adfbb4d32e9a4592ff6
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Thanh Ha [Wed, 28 Feb 2018 01:53:47 +0000 (20:53 -0500)]
Add a description of global-jjb
Change-Id: I10926e554e4c99f6336837f7393d065f8e653599
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 28 Feb 2018 01:53:04 +0000 (01:53 +0000)]
Merge "Add triggers to jenkins-cfg job"
Thanh Ha [Tue, 27 Feb 2018 05:29:49 +0000 (00:29 -0500)]
GIT_URL variable corruption in script
Not sure why but GIT_URL seems to get corrupt inside of this
script. Use GERRIT_URL instead to clone patches.
Additionally also ignore a patch if a patch that matches the
Gerrit that triggered it is passed in.
Issue: RELENG-784
Change-Id: I85de941ad64d64597f69c1c924295b26e1dc1bec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 16 Feb 2018 19:55:55 +0000 (14:55 -0500)]
Add triggers to jenkins-cfg job
Allows the job to run on a timed trigger as well as on patch
merged events. Default timed trigger is run @daily.
Change-Id: I54b04e7814718816fe221a33d80aa1c1574095d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 15 Feb 2018 22:09:05 +0000 (17:09 -0500)]
Add local-{templates}.yaml path to packer pattern
Common packer supports local improvements via local-*.yaml files
so we need to add this to the file paths.
Change-Id: Id6d723a174de5f272cc267496279d7e79cef8b8f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 14 Feb 2018 21:13:11 +0000 (16:13 -0500)]
Git submodule update after fetching patch
For projects that have submodules we need to call
`git submodule update` after fetching the patch so that
submodule updates caused by the patch are pulled in.
Running that command on a repo that does not contain submodules
returns cleanly as a noop.
Change-Id: Iec76e4c42d9e0132571af477f3ae770e5e360781
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 13 Feb 2018 18:21:45 +0000 (13:21 -0500)]
Add a note about requiring jjbini configuration
Document that jjbini needs to include JJB 2.0 style configuration
sections for the "production" and "sandbox" systems.
Change-Id: I102c57774a75bd1545f21a67bb2d98ccb0f270a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Feb 2018 23:55:07 +0000 (18:55 -0500)]
Bump version to 0.17.0-dev
Change-Id: I9c352b633fcf83a0b60e2351401cd76c42df238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 9 Feb 2018 19:12:42 +0000 (14:12 -0500)]
Release global-jjb v0.16.0
Change-Id: I6acf020cda29198ad930ceeffe08e09ad0c7d6bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 00:24:56 +0000 (19:24 -0500)]
Create job to manage Jenkins Global Variables
Parses a configuration file containing variable listings in the form
"KEY=value" one per line and creates the appropriate groovy
script to push these environment variables to Jenkins Global Config.
Configuration file is stored in
ci-management/jenkins-config/global-vars-SILO.sh
(Where silo is production | sandbox)
While JJB provided us a way to store job configuration in a git repo
we have never had a good way to manage global Jenkins configuration.
This patch enables us to manage one aspect, Global Environment
variables in the ci-management repository.
Issue: RELENG-753
Change-Id: I7d134950b25d469686cace2f79fd8c297727166c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 9 Feb 2018 18:13:01 +0000 (18:13 +0000)]
Merge "Add pip.conf to wrappers"
Andrew Grimberg [Thu, 8 Feb 2018 21:26:14 +0000 (13:26 -0800)]
Update submodule documentation
Production deployments of global-jjb should be using the GitHub mirror
as their primary source as GitHub rarely has outages. This decouples the
master Gerrit instance from downstream consumption such that we are more
free to do maintenance whenever we desire.
Change-Id: I37139965902fa922cbb14f7ad01c22248bc1847b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Thanh Ha [Thu, 8 Feb 2018 04:19:43 +0000 (23:19 -0500)]
set +x around sensitive code docker login code
Call `set +x` as a guard just in case a script elsewhere is calling
`set -x` which could cause the credentials to print to console.
Change-Id: I6802887c7a3c9809d9d13d6b3cc90e3570f120fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jamo Luhrsen [Tue, 6 Feb 2018 03:28:23 +0000 (19:28 -0800)]
Add : to jjb-deploy:
This is more intuitive to me, as the keyword takes an
argument. I realized this when I used the ODL keyword
copy-logs:
Change-Id: Ic321d6be56ef518a2056099cb5690ea6880c16c2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Thanh Ha [Tue, 6 Feb 2018 16:36:31 +0000 (11:36 -0500)]
Add test to check for double curly braces
This will cause the build to fail if double curly braces are in
JJB output XML. This should help catch the JJB bug that adds
curly braces when using !include-raw-escape.
Issue: RELENG-777
Change-Id: Iaf9a9ef695229fa24dfc639ca60a4b9a9928a234
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Christopher Lott (cl778h) [Tue, 6 Feb 2018 16:11:18 +0000 (11:11 -0500)]
Repair shell-include directive
Change stage macro to use include-raw instead of include-raw-escape to
work around a JJB bug that inserts lftools_activate with double braces.
Change-Id: Iec5e0b12a287f1945eedc895a25dd16e74b47082
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
Thanh Ha [Mon, 5 Feb 2018 20:03:01 +0000 (15:03 -0500)]
Add maven metadata validator tool
Add a tool to validate maven-metadata.xml to catch timestamp issues
in builds and fail the build if a mismatch is detected.
Issue: RELENG-772
Change-Id: I35a7b9c3b12321a3a7af24ab36397e38ebb01de9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 20:46:58 +0000 (15:46 -0500)]
Add pip.conf to wrappers
This is a global-jjb breaking change as it now causes us to require
the pipconf file configured in Config File Provider. This allows us
to configure for projects that have Nexus 3 a PyPi proxy for faster
local downloads.
Contents of pip.conf should look something like:
[global]
timeout = 60
index-url = https://nexus3.opendaylight.org/repository/PyPi/simple
Change-Id: I4ac816f1b78f09c101e6d614bdd3c459fe0e133a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:24:26 +0000 (20:24 -0500)]
Allow goal override for maven-build macro
Splits out the maven-build into a macro that can be used
to allow projects to override the default goals if they
wish to tweak them for their projects.
Change-Id: I8cabbac997d165bfe8b68d76b78cdb4bb7cc4bbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:16:13 +0000 (20:16 -0500)]
Split maven-stage script into a reusable macro
Change-Id: If8d2208e2469d295637a9e82545b2289e5a7588b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 00:56:50 +0000 (00:56 +0000)]
Merge "Add sphinx link to rtd jobs page"
Thanh Ha [Thu, 1 Feb 2018 20:12:03 +0000 (20:12 +0000)]
Merge "Add Links to Plugins mentioned in README"
Thanh Ha [Thu, 1 Feb 2018 18:50:47 +0000 (13:50 -0500)]
Fix local platform file path
The local vars path is incorrect in the if-statement but
correct in the declaration below it. Update to match.
Change-Id: I1e8ec19adf842668fb46e54aaf8beebfcef9c34d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 1 Feb 2018 18:15:04 +0000 (13:15 -0500)]
Disable unbound variable checking for activate
virtualenv activate contains unbound variables so must be disabled
when calling `source activate`.
Change-Id: I8af6b55962580778fbb349c8164f661c4c462928
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 1 Feb 2018 02:26:16 +0000 (21:26 -0500)]
Add sphinx link to rtd jobs page
Change-Id: I67bf0e81fd3e6156cd31dbb4700c8909cf2bf87d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 31 Jan 2018 22:00:23 +0000 (17:00 -0500)]
deploy cleanup not removing all unmodified files
The linting patch If87fceb79e384e26f021a9c85a2e9d7413ce421e
broke the cleanup script so unmodified maven-metadata.xml files
were not properly being cleaned up before upload to Nexus. This
caused the maven-merge job to update maven-metadata.xml files
outside of what was actually modified. So when 2 maven-merge jobs
running on different streams are run at the same time they would
overwrite each other with old data.
Issue: RELENG-766
Change-Id: I18da721bfb5db6eef9c15ffabd4482e0aa24e3a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Sam Hague [Wed, 31 Jan 2018 13:31:56 +0000 (08:31 -0500)]
update docs to use minutes over seconds
Change-Id: Ia1e7b101ee6a3605d6c0ec4ac163a6f8c362921b
Signed-off-by: Sam Hague <shague@redhat.com>
Trevor Bramwell [Tue, 30 Jan 2018 18:41:12 +0000 (10:41 -0800)]
Add Links to Plugins mentioned in README
Includes a link to the download location of the PostBuildScript plugin
since it is no longer being released.
Change-Id: Ia2d34921fa9d870fd5792d938f9b2844853a38e9
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
Jessica Wagantall [Wed, 24 Jan 2018 00:31:47 +0000 (16:31 -0800)]
Add script to update Java alternatives
Use ${java-version} to set the correct java, javac
and java_sdk_openjdk alternative for lf-maven-jobs.
Issue-ID: RELENG-752
Change-Id: Iff0c2e7d92c4cc802925ae67cdda1f4247db52be
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Tue, 23 Jan 2018 00:14:53 +0000 (16:14 -0800)]
Remove jdk variable from lf-maven-jobs
Setting this variable to {java-version} creates some issues for
projects using the Ubuntu nodes as they need to use explicitly
'System' as their JDK version.
Change-Id: I0a12bc83f7c8c1c8fcdf8f2a1d5f47b8360b94c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Mon, 29 Jan 2018 22:20:55 +0000 (17:20 -0500)]
Bump default timeout to 15 minutes for tox
Increase tox jobs default timeout to 15 minutes. Considering many
things appear to be taking longer in Vexxhost this is likely
necessary.
Change-Id: I592146b1f0d47a9aedfdc91c1878a6f94b3d363c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Christopher Lott (cl778h) [Mon, 29 Jan 2018 17:51:21 +0000 (12:51 -0500)]
Refactor macro/template cron param
Be consistent with cron parameter: define in macro, use in template.
Never hard-code a trigger in a job template.
Document the parameters in the RST file.
Change-Id: I70a1deefd23bc9498f6c6013fb8751298dec7f53
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
Andrew Grimberg [Mon, 22 Jan 2018 23:02:07 +0000 (23:02 +0000)]
Merge "Split maven-deploy into a macro"
Thanh Ha [Mon, 22 Jan 2018 21:47:11 +0000 (16:47 -0500)]
Bump global-jjb to 0.16.0-dev
Change-Id: I0f5e3d41bcdc3f6938208d3b710b20df9dfb5c70
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 22 Jan 2018 02:02:41 +0000 (21:02 -0500)]
Release global-jjb v0.15.0
Change-Id: I1186feb6ff4fefb5311bcfb84ad34b4001b9cef7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 16:50:13 +0000 (11:50 -0500)]
Increase maven-jobs default timeout to 60 mins
The new Vexxhost cloud seems to be slower in general and
continuous to cause OpenDaylight grief when it comes to running
jobs. Increase the timeout to 60 mins to account for the slower
infra.
Change-Id: I04325ce9d700ac4879a17f1b0547bc0b861c7cac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:10:24 +0000 (20:10 -0500)]
Split maven-deploy into a macro
Split out maven-deploy into a reusable macro.
Change-Id: I6ddad68576cdbf9d9ef8b4805da94dc6a80cbefd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:02:36 +0000 (01:02 +0000)]
Merge "Improve verbosity in maven shell scripts"
Thanh Ha [Thu, 18 Jan 2018 19:22:07 +0000 (14:22 -0500)]
Use clean install for Sonar
The Sonar job does not need to deploy so switch to using
`mvn clean install` to build the project before running
sonar scan.
Change-Id: I577a57417d0c56f403e66b9fb7201bf58fef818e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 18 Jan 2018 19:20:46 +0000 (14:20 -0500)]
Improve verbosity in maven shell scripts
There is no harm in enabling debug level verbosity for these scripts
and may help in improving troubleshooting.
Change-Id: I9edfee2f7d2415117d854ad7cdba280cc9751004
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 17 Jan 2018 20:23:26 +0000 (15:23 -0500)]
Revert "Switch global-jjb to lfdocs-conf"
Need to revert because conf.yaml causes deployment issues in
jjb recursive runs as it's not expecting a non-jjb yaml. Let's
not use lfdocs-conf in global-jjb until we have a way around
that.
This reverts commit
ac79981ec42d37f943c2a4159e2980913cb1716d.
Change-Id: I0eb5d269b31c76e5da7affd80d93715cee8e4037
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 17 Jan 2018 19:26:54 +0000 (14:26 -0500)]
Default to python2 for tox
This caused many ODL projects to break due to it now assuming
py3 by default. The only project that needs python3 tox run is
Acumos so let us default this back to python2 which is the OS level
default and explicitly set python3 in Acumos.
Change-Id: I97df6eee112a2e9e1e8d18eb9e16990a1c703538
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 17 Jan 2018 03:08:58 +0000 (22:08 -0500)]
Switch global-jjb to lfdocs-conf
Consolidate conf.py into lfdocs-conf package.
Change-Id: I18b975acaa2ef28dfdaeb9ebf29357a9ed58202d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>