Thanh Ha [Fri, 1 Jun 2018 17:18:42 +0000 (13:18 -0400)]
Release global-jjb v0.20.0
Change-Id: Ia24912694223d4e8df81f591829dfb4b4ed5ff22
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 2 Jun 2018 05:33:43 +0000 (01:33 -0400)]
Remove echo statement
Sphinx already prints 'The HTML pages are in docs/_build/html.' at the
end of a build. This is redundent and not cross platform compatible
(fails on Windows).
Change-Id: I6e4098aaaed492138d8056495c6db69d3799de1a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Thu, 31 May 2018 23:42:42 +0000 (23:42 +0000)]
Merge "Simplify conditional statement for ALT_NEXUS_REPO"
Zack Williams [Tue, 15 May 2018 03:38:48 +0000 (20:38 -0700)]
Add *.groovy as a filetype trigger to ci-verify
Add support for Jenkinsfile to trigger ci-verify jobs.
Change-Id: I36986889ecea9a72b238a886146bb5faa10c9672
Signed-off-by: Zack Williams <zdw@opennetworking.org>
Thanh Ha [Thu, 31 May 2018 15:47:20 +0000 (11:47 -0400)]
Simplify conditional statement for ALT_NEXUS_REPO
Change-Id: I72cecef2c52e1c1e2688437a18dfa02bc1b4c3e6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Trevor Bramwell [Thu, 17 May 2018 22:55:23 +0000 (15:55 -0700)]
Fix echo when removing venv in jjb-cleanup.sh
Missing 'echo' call causes this script to fail when it in truth
succeeds.
Change-Id: I95d798a34442fcf3ca172b3bdd43260db8a09f3c
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
Trevor Bramwell [Thu, 17 May 2018 19:01:40 +0000 (12:01 -0700)]
Use a temporary directory for jjb-installs
When jjb-verify and jjb-merge jobs get scheduled on the same static
node only one can run at a time. So when jjb-merge is running any
jjb-verify jobs triggered during that time fail.
Change-Id: I2ba93417614977741999151cd155a4a165b0229a
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
Trevor Bramwell [Wed, 16 May 2018 23:35:42 +0000 (16:35 -0700)]
Support the .yml YAML File Suffix for CI Jobs
Change-Id: I410ba824c0d1d1fbeb763fe994a9a4a667b157e3
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
Andrew Grimberg [Tue, 15 May 2018 14:42:37 +0000 (14:42 +0000)]
Merge "Add docker clean macro"
Jeremy Phelps [Mon, 14 May 2018 22:09:55 +0000 (17:09 -0500)]
Prevent unbound variable error on create-netrc.sh
Change-Id: I15498ccf8a16fb93d307408f515751ea98c0003b
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Jessica Wagantall [Mon, 14 May 2018 20:50:58 +0000 (13:50 -0700)]
Add lf-infra-parameters XC CLM
Add lf-infra-parameters for branch and project
details. XC CLM job needs one extra parameter
(nexus-iq-cli-version) apart from the default
ones in lf_python_common.
Change-Id: I75b3f62c5469498d539db9e2c55ffc6d974e88dc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jeremy Phelps [Fri, 11 May 2018 20:18:06 +0000 (15:18 -0500)]
Add docker clean macro
This macro forcibly removes all docker images on build system.
Change-Id: I750e235b7de13338d816d2f963f0628b74ef0579
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Jeremy Phelps [Fri, 11 May 2018 18:33:03 +0000 (13:33 -0500)]
Add ALT_NEXUS_URL to create-netrc
This change is backwards compatible with existing system configs but
lets the user spec this env var which will take precedence. This is
useful, for example, to point at nexus3.edgexfoundry.org if you have
NEXUS_URL=nexus.edgexfoundry.org.
Change-Id: Ibbba26670ab374fd98e1bf20f78ffff7f8b7c52a
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Anil Belur [Wed, 9 May 2018 01:35:58 +0000 (11:35 +1000)]
Use --jobs-only option with jjb-deploy
JJB 2.0.3 implementation allows views to be managed by
code. The default behaviour is to update the job along with
all the views in the repository. This takes a longer if
the project has many views managed by code.
Therefore, use the flag --jobs-only to updated
on a given job in sandbox.
Change-Id: Ifaaf60f3479e7485e1dbb5618c6cbcce31525278
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Andrew Grimberg [Tue, 8 May 2018 23:17:37 +0000 (23:17 +0000)]
Merge "Remove maven_metadata_validate function"
Anil Belur [Tue, 8 May 2018 21:59:40 +0000 (07:59 +1000)]
Release global-jjb v0.19.2
Create a new tag with v0.19.2 which points to an object that changes
the version number.
Change-Id: I07282a819a14ce2edf37d71d2a0030dbcf2161d1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Tue, 8 May 2018 12:20:04 +0000 (22:20 +1000)]
Release global-jjb v0.19.1
Change-Id: Ie69a77b11ff92a40157a9fa31d70f4a9bca7aa9d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Dimitrios Markou [Sat, 5 May 2018 12:33:48 +0000 (15:33 +0300)]
Bug Fix: Replace -type f with -xtype f
The -type f parameter cannot recognize symbolic link files
so the replacement with the -xtype f parameter solve this problem
https://jira.opendaylight.org/browse/INTPAK-162
Change-Id: I38aaf2ff3d655d44e757c863f83a0b2cb811ab41
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Thu, 3 May 2018 22:14:48 +0000 (18:14 -0400)]
Release global-jjb v0.19.0
Change-Id: Ib0e5add67d0b645d55a7b39b6430f2c849c993ed
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jeremy Phelps [Fri, 4 May 2018 00:41:39 +0000 (19:41 -0500)]
Add support to log into docker.io
This follows essentially the same pattern
as logging into the nexus docker registries.
Change-Id: I174c0f27d46d59ddae5abc0fda67a839095c2535
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Daniel Farrell [Thu, 3 May 2018 22:15:19 +0000 (22:15 +0000)]
Merge "Add override for GT file-paths in Python jobs"
Thanh Ha [Thu, 3 May 2018 15:48:04 +0000 (11:48 -0400)]
Add override for GT file-paths in Python jobs
Some projects may have small Python sub-projects within their
repos. This would allow them to only trigger builds when there
is a change in the relevant directory.
Change-Id: If54f43eb3f66d0c6b493495a82a65989fc7ed6c3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
Thanh Ha [Thu, 3 May 2018 20:45:00 +0000 (16:45 -0400)]
Fix jenkins-cfg GitHub cfg to build head of branch
There this job was originally misconfigured and was configured as if
it was a verify job. It should be operating instead as a merge job
and not be pulling in the $sha1 setting. This fixes the job to only
build HEAD of branch as one would expect.
Issue: RELENG-844
Change-Id: I8fa6b25a2fd4b598f619ab4c6ae80ce411756cb4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 3 May 2018 14:07:34 +0000 (10:07 -0400)]
Remove maven_metadata_validate function
This function was originally added to detect a bug with Maven 3.5.1
and earlier. At the time the OpenDaylight community was not yet ready
to migrate to 3.5.2 from 3.3.9 so we implemented this function as a
way to detect the metadata issues.
This function ended up causing some edge case issues and is not worth
maintaining. Remove the function and recommend all projects use Maven
3.5.2 as a minimum.
The specific issue in Maven was that sometimes the deploy phase would
generate an off by one timestamp mismatch between the metadata and the
filename of the artifacts. This causes invalid metadata and then
builds against affected artifacts fail.
Issue: RELENG-927
Change-Id: I65f4f6dc73382b91940620aba587f5fe56259eb1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Vanessa Rene Valderrama [Tue, 24 Apr 2018 19:58:26 +0000 (14:58 -0500)]
Configure tox tests allow serial execution
Configuring tox tests to allow serial or parallel execution configurable
within JJB by setting the PARALLEL parameter to true or false.
Issue: RELENG-912
Change-Id: If2edba598b47484b1708f1e0f3fb96f035511841
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Thanh Ha [Fri, 16 Mar 2018 18:45:24 +0000 (14:45 -0400)]
Add instructions on how to test script locally
Useful for debugging the jenkins-cfg job if something is not working.
Change-Id: I6062b754fb01a8da60ac73472133aa2dfd4ae2fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 18:25:07 +0000 (13:25 -0500)]
Print out heading information
Makes the output a bit more structured.
Change-Id: Ieedcbf97af01cec63604c2907d6f74177271a64d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Apr 2018 16:25:06 +0000 (12:25 -0400)]
Sort packer macros alphabetically
Change-Id: I382cd173ca7e08cb3d69af874e74b8ce8d92d65b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Apr 2018 16:21:58 +0000 (12:21 -0400)]
Simplify packer-parameters macro name to just lf
The lf namespace is lf, not need to set lf-infra everywhere.
(We should go through and reduce this for other instances in
the future).
Change-Id: I629f378e1973ad0f7051df1d8aa15c3bb62f676d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Apr 2018 16:19:30 +0000 (12:19 -0400)]
Set default packer variable in job-template
Also add documentation for the packer parameters macro.
Change-Id: Ib1532c508196ee3fabbac0137aeb0fd2e10904f4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 24 Apr 2018 16:31:59 +0000 (12:31 -0400)]
Skip vote for jjb-deploy
This job should not be voting.
Issue: RELENG-918
Change-Id: Ia53fe0485e4187d85ecca4e6c48aacda6a997786
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Mon, 23 Apr 2018 22:40:58 +0000 (22:40 +0000)]
Merge "Add generic push changes to gerrit builder"
Jessica Wagantall [Fri, 20 Apr 2018 01:03:02 +0000 (18:03 -0700)]
Update XC CLM job parameters
- Remove unused archive-artifacts log patterns
- Many of these are Maven related and unused in Python.
- Adjust NEXUS_IQ_CLI_VERSION parameter name to unspecify
CLI format.
Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221
Change-Id: I0dde9b18468d52574b969c1f83c93f8ff0950faa
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 20 Apr 2018 00:44:06 +0000 (17:44 -0700)]
Add docs for Python XC CLM
Add documentation for Python XC CLM:
- Description of the job
- Job templates
- Description of parameters
Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221
Change-Id: I19713d37aa38159f26e437c961b6d1b4fa6f77fc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Mon, 23 Apr 2018 17:52:39 +0000 (17:52 +0000)]
Merge "Rename sonar-cli.sh to nexus-iq-cli.sh"
Anil Belur [Mon, 9 Apr 2018 09:22:15 +0000 (19:22 +1000)]
Add generic push changes to gerrit builder
This is a generic version of the script to push a change through
a job to Gerrit in an automated fashion. Projects can reuse this
macros when they have jobs which requires to push a change to
gerrit.
RELENG-769
Change-Id: I4d269a4dad6ddbd509a134306b61b2214194b479
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Fri, 20 Apr 2018 18:47:16 +0000 (14:47 -0400)]
Fail Sphinx build even on warnings
Resolve warnings caused by the -W flag.
Change-Id: I0c771da88af487e3a6ddb55b01d524d5a274226d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 20 Apr 2018 18:46:52 +0000 (14:46 -0400)]
Bump version to 0.19.0-dev
Change-Id: I000964a1bd8a4d7a9ed09fb29b130258e63ba922
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 18 Apr 2018 21:23:32 +0000 (17:23 -0400)]
Release global-jjb v0.18.0
Change-Id: I0538f3c15e6df43369ef5e7756a76236d52d0a9e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 20 Apr 2018 16:24:16 +0000 (16:24 +0000)]
Merge "Update JJB version 2.0.5"
Anil Belur [Fri, 20 Apr 2018 14:19:56 +0000 (00:19 +1000)]
Update packer version to 1.2.2
Change-Id: I188bb7b14e5122afc25b64765d846c4d1298e8f6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jessica Wagantall [Fri, 20 Apr 2018 00:55:42 +0000 (17:55 -0700)]
Update comment triggers XC CLM
Update comment triggers for Python XC CLM
jobs. From "run-xc-clm" to "run-clm" to make it more
consistent with other clm jobs.
Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221
Change-Id: I637d03805e19460c6c9abb20af61ee4d9d34763e
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Jessica Wagantall [Fri, 20 Apr 2018 00:50:49 +0000 (17:50 -0700)]
Rename sonar-cli.sh to nexus-iq-cli.sh
Rename sonar-cli.sh script to nexus-iq-cli.sh since
it is a more appropriated name for this script as Sonar
tasks are not involved on this job. Just Nexus-IQ scans.
Change-Id: I39a48c1cb8e24ad669a9a7f0ab4a7fcdb57ff1d5
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Thu, 19 Apr 2018 17:46:29 +0000 (13:46 -0400)]
Add new odl- flavors to cloud list
Change-Id: Icf5551056956f8d10367b3bf1efa106b1ce0b395
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Wed, 18 Apr 2018 11:03:06 +0000 (21:03 +1000)]
Update JJB version 2.0.5
JJB version 2.0.5 contains most recent changes required
to update and manage views on Jenkins.
RELENG-76
Change-Id: Ib230f452b060a21ed02229ff292198c6384ce44d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Sat, 14 Apr 2018 17:15:07 +0000 (13:15 -0400)]
Replace pipdeptree with pip freeze
While pipdeptree provides more detailed information it's
dependency with pip seems to break things if we don't
install in the correct order. Let's revert to pip freeze
for now until we have a better way to maintain these debugging
packages.
Issue: RELENG-884
Change-Id: Ib6d3008e2d0e195bc9a01a1c4dd476d92a9deace
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 14 Apr 2018 17:10:25 +0000 (13:10 -0400)]
Pin pip to 9.0.3
Pin pip versions to 9.0.3 in all scripts that try to install pip.
Issue: RELENG-884
Change-Id: I25df8beb412e06d14db88d90debafa46013bb7ac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jessica Wagantall [Thu, 12 Apr 2018 21:53:23 +0000 (21:53 +0000)]
Merge "Add lf_tox_sonar job"
Jessica Wagantall [Tue, 10 Apr 2018 22:24:16 +0000 (15:24 -0700)]
Add lf_tox_sonar job
Python jobs uses tox.ini to configure
their project coverage report. Adding a tox call
before the sonar calls makes the proper updates
to the reports based on that coverage.
Change-Id: I4e6787274ae15c1a9b3b866a55e02f3587b906fb
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Thanh Ha [Wed, 11 Apr 2018 18:12:53 +0000 (18:12 +0000)]
Merge "Update RTD to use Generic API v2 webhook"
Jeremy Phelps [Wed, 11 Apr 2018 18:00:19 +0000 (13:00 -0500)]
Update default jjb version
JJB contains bits in postbuildscript
publisher that require a minimum of
version 2.0.3.
Change-Id: Ibc62684a9b7dec125064fb5ce823e3f6452581db
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Jeremy Phelps [Tue, 27 Mar 2018 16:45:57 +0000 (11:45 -0500)]
Update RTD to use Generic API v2 webhook
The old tokenless generic trigger url has been deprecated. Update
to using the new v2 API that requires a token.
This is a backwards incompatible change and modifies 2 things:
* rtd-project is now the rtd-build-url parameter
* rtd-token is a new required parameter
Issue: RELENG-879
Change-Id: I786240ab14cf95a2896d92d1c87aef9d7815d964
Co-Authored-By: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 10 Apr 2018 20:27:23 +0000 (16:27 -0400)]
Force rm for cleanup macro
Using -f (force) rm will return a 0 status and not print a
message if a file is not found.
Issue: RELENG-880
Change-Id: Ia06166362526cf00754b4a21e6b977d57fe91db6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 10 Apr 2018 20:23:50 +0000 (16:23 -0400)]
Fix pipconf name to the default one
In Managed Files we do not give the filename a dot so remove
it to match what we really look for.
Change-Id: Iaa5df87921d7d7333ecb87bc11c707884e4fb277
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Sat, 7 Apr 2018 00:30:22 +0000 (00:30 +0000)]
Merge "Validate packer version before install"
Ry Jones [Thu, 5 Apr 2018 15:27:09 +0000 (08:27 -0700)]
Fix pip version
pip has released a beta version which breaks pipdeptree.
RELENG-868
Change-Id: I755a2521f28fc6441a69dd0ed93c0f85502b787b
Signed-off-by: Ry Jones <ry@walledcity.org>
Anil Belur [Mon, 26 Mar 2018 22:03:25 +0000 (15:03 -0700)]
Validate packer version before install
Packer 1.1.3 is the minimum version required to be installed
to build images on vexxhost. The install script does not check
the version and only checks the availability of the binary in the
$PATH before updating packer.
JIRA: RELENG-838
Change-Id: I8c343176d8f39e3e70b04dddbdec94ffed4354b1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Jeremy Phelps [Tue, 3 Apr 2018 13:40:56 +0000 (08:40 -0500)]
Pin tox to <3.0.0 as it breaks detox
Issue-ID: RELENG-856
Change-Id: Id13aee7244cce6328fd10cbe495b5fb3e7069924
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Wed, 28 Mar 2018 16:47:02 +0000 (16:47 +0000)]
Merge "Revert "Update RTD to use custom trigger url""
Thanh Ha [Wed, 28 Mar 2018 16:40:52 +0000 (16:40 +0000)]
Revert "Update RTD to use custom trigger url"
This reverts commit
12d6179c0e7c208a360a3c61c0b715b49310b39e.
Change-Id: I87a8f3b25ab977cdcfd3c23da6cebd610edaf325
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Wed, 28 Mar 2018 16:23:13 +0000 (16:23 +0000)]
Merge "Export packer binary dir in $PATH"
Jeremy Phelps [Tue, 27 Mar 2018 16:45:57 +0000 (11:45 -0500)]
Update RTD to use custom trigger url
The generic trigger url is now deprecated. Going forward
users will have to use the Generic API incoming webhook
that is defined per project in the read the docs service.
Change-Id: Iac0774266e787705e7fb903712cbfb4b4a41fb55
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Wed, 21 Mar 2018 17:11:02 +0000 (13:11 -0400)]
Add link to release notes
Issue: RELENG-552
Change-Id: Ifddf4463ac6afa2395be25cddf989fe05dd9fec1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 19 Mar 2018 19:55:02 +0000 (19:55 +0000)]
Merge "Quit build if submodule not found"
Thanh Ha [Mon, 19 Mar 2018 19:30:08 +0000 (15:30 -0400)]
Quit build if submodule not found
In the monolithic docs build we only care to build if the
project is really a submodule of the monolithic docs build.
If not then skip the build as the project should be providing
their own docs verify job.
Issue: RELENG-845
Change-Id: I9bc146170e150097b3b9a30ec0456173bba9b1ef
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Mon, 19 Mar 2018 17:37:46 +0000 (17:37 +0000)]
Merge "Support PostBuildScript 2.x"
Thanh Ha [Sun, 18 Mar 2018 03:55:41 +0000 (23:55 -0400)]
Ensure setuptools is updated
Similar to pip, we should ensure that setuptools is updated as well.
pip 9.0.2 appears to break without setuptools also being updated.
Change-Id: I3b66140a1a5b292a6e44e955b31ddd62cdc6ed03
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 16 Mar 2018 18:47:18 +0000 (14:47 -0400)]
Add support for VolumeFromImage boot source
Allows us the ability to configure a volume size for images. This
feature requires OpenStack Cloud Plugin 2.32 to use.
Change-Id: Ic557373c16afc3df3af3571e5f3883f5b18e8e8c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Fri, 16 Mar 2018 06:44:07 +0000 (06:44 +0000)]
Merge "Document job-group defaults order of priority"
Anil Belur [Thu, 15 Mar 2018 12:55:28 +0000 (22:55 +1000)]
Export packer binary dir in $PATH
Add packer binary path to $PATH to avoid packer being
installed multiple times in builder merge jobs.
JIRA: RELENG-838
Change-Id: Ie414ff39d0829135cc797b187f693930cf45c6d5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 01:48:09 +0000 (21:48 -0400)]
Support PostBuildScript 2.x
This is a breaking change that requires consumers of global-jjb
to switch to JJB 2.0.3 and install PostBuildScript 2.x in Jenkins.
It updates lf-infra-publish macro to switch to the PostBuildScript 2.x
YAML definitions.
Issue: RELENG-832
Change-Id: I04020587acfb8b6550c0221ebfb97a501f46b15a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 15:15:28 +0000 (11:15 -0400)]
Bump version to 0.18.0-dev
Change-Id: Ib2d45332a9626b0aaf82443e1f37846a00569e46
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 01:24:16 +0000 (21:24 -0400)]
Release global-jjb v0.17.0
Change-Id: I13cf313e1875eabb50290c2409ef632eaa7183f7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 3 Nov 2017 19:20:03 +0000 (15:20 -0400)]
Document job-group defaults order of priority
We discovered that job-group variable definitions appear to
have higher precedence than project definitions. This caused a problem
for us in global-jjb as we would like to allow projects to override
default variables.
We should make it best practice that global-jjb stops providing
job-group definitions and deprecating any existing job groups.
Via patch I2b824e3cc89667698db8ebfdd3ce43f551e961d7 we were able to
resolve this for JJB version.
Change-Id: I93c8256193933a04e8732963216f69424cef3a5f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 12 Jan 2018 19:10:06 +0000 (14:10 -0500)]
Document pyenv usage in the tox job
Change-Id: Id07a1e4065b03489260dfe1d0b86cacf8d60238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Mar 2018 01:00:15 +0000 (21:00 -0400)]
Pin JJB to 2.0.2 for tests
JJB >2.0.2 requires use to update our shiplogs postbuildscript as
support for the 2.x version of postbuildscript takes over the
default code path.
Change-Id: Iff3cd415f12a54aa3fcbf48d7f10b6df01cd1279
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jessica Wagantall [Wed, 7 Mar 2018 01:10:41 +0000 (17:10 -0800)]
Add CLM support for Python
Add template to support CLM scans for python
based projects. This template uses the nexus-iq-cli
package directly and executes an extended report to
scan python based projects.
Change-Id: I5e5c420539ab3a3e5b292620da4418c16d557221
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Wed, 7 Mar 2018 01:41:00 +0000 (20:41 -0500)]
Add explicit links for Packer jobs
Change-Id: I90e4d89008f0f6550f640a8c03b268d1bde884e9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 18 Jan 2018 16:09:36 +0000 (11:09 -0500)]
Add script to manage Jenkins cloud cfg
A groovy script to manage the Jenkins global cloud cfg
programmatically. This script reads configuration from
the directory jenkins-config/clouds to configure cloud
configuration in Jenkins. Refer to the documentation for
details.
No upgrade consideration is necessary as this script
automatically detects the absence of the jenkins-config/clouds
directory and disables the Cloud configuration.
Issue: RELENG-804
Change-Id: Idad3078942618b7d8fd08a40bf9e4e5ed5a0dc48
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Lott, Christopher (cl778h) [Thu, 1 Mar 2018 14:40:28 +0000 (09:40 -0500)]
Make rtd jobs verbose
Add set -x flag so these scripts echo steps in Jenkins output.
Change-Id: Ia09f3194407f6c94d8cb1adfbb4d32e9a4592ff6
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
Thanh Ha [Wed, 28 Feb 2018 01:53:47 +0000 (20:53 -0500)]
Add a description of global-jjb
Change-Id: I10926e554e4c99f6336837f7393d065f8e653599
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 28 Feb 2018 01:53:04 +0000 (01:53 +0000)]
Merge "Add triggers to jenkins-cfg job"
Thanh Ha [Tue, 27 Feb 2018 05:29:49 +0000 (00:29 -0500)]
GIT_URL variable corruption in script
Not sure why but GIT_URL seems to get corrupt inside of this
script. Use GERRIT_URL instead to clone patches.
Additionally also ignore a patch if a patch that matches the
Gerrit that triggered it is passed in.
Issue: RELENG-784
Change-Id: I85de941ad64d64597f69c1c924295b26e1dc1bec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 16 Feb 2018 19:55:55 +0000 (14:55 -0500)]
Add triggers to jenkins-cfg job
Allows the job to run on a timed trigger as well as on patch
merged events. Default timed trigger is run @daily.
Change-Id: I54b04e7814718816fe221a33d80aa1c1574095d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 15 Feb 2018 22:09:05 +0000 (17:09 -0500)]
Add local-{templates}.yaml path to packer pattern
Common packer supports local improvements via local-*.yaml files
so we need to add this to the file paths.
Change-Id: Id6d723a174de5f272cc267496279d7e79cef8b8f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 14 Feb 2018 21:13:11 +0000 (16:13 -0500)]
Git submodule update after fetching patch
For projects that have submodules we need to call
`git submodule update` after fetching the patch so that
submodule updates caused by the patch are pulled in.
Running that command on a repo that does not contain submodules
returns cleanly as a noop.
Change-Id: Iec76e4c42d9e0132571af477f3ae770e5e360781
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 13 Feb 2018 18:21:45 +0000 (13:21 -0500)]
Add a note about requiring jjbini configuration
Document that jjbini needs to include JJB 2.0 style configuration
sections for the "production" and "sandbox" systems.
Change-Id: I102c57774a75bd1545f21a67bb2d98ccb0f270a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Mon, 12 Feb 2018 23:55:07 +0000 (18:55 -0500)]
Bump version to 0.17.0-dev
Change-Id: I9c352b633fcf83a0b60e2351401cd76c42df238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 9 Feb 2018 19:12:42 +0000 (14:12 -0500)]
Release global-jjb v0.16.0
Change-Id: I6acf020cda29198ad930ceeffe08e09ad0c7d6bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 00:24:56 +0000 (19:24 -0500)]
Create job to manage Jenkins Global Variables
Parses a configuration file containing variable listings in the form
"KEY=value" one per line and creates the appropriate groovy
script to push these environment variables to Jenkins Global Config.
Configuration file is stored in
ci-management/jenkins-config/global-vars-SILO.sh
(Where silo is production | sandbox)
While JJB provided us a way to store job configuration in a git repo
we have never had a good way to manage global Jenkins configuration.
This patch enables us to manage one aspect, Global Environment
variables in the ci-management repository.
Issue: RELENG-753
Change-Id: I7d134950b25d469686cace2f79fd8c297727166c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 9 Feb 2018 18:13:01 +0000 (18:13 +0000)]
Merge "Add pip.conf to wrappers"
Andrew Grimberg [Thu, 8 Feb 2018 21:26:14 +0000 (13:26 -0800)]
Update submodule documentation
Production deployments of global-jjb should be using the GitHub mirror
as their primary source as GitHub rarely has outages. This decouples the
master Gerrit instance from downstream consumption such that we are more
free to do maintenance whenever we desire.
Change-Id: I37139965902fa922cbb14f7ad01c22248bc1847b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Thanh Ha [Thu, 8 Feb 2018 04:19:43 +0000 (23:19 -0500)]
set +x around sensitive code docker login code
Call `set +x` as a guard just in case a script elsewhere is calling
`set -x` which could cause the credentials to print to console.
Change-Id: I6802887c7a3c9809d9d13d6b3cc90e3570f120fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jamo Luhrsen [Tue, 6 Feb 2018 03:28:23 +0000 (19:28 -0800)]
Add : to jjb-deploy:
This is more intuitive to me, as the keyword takes an
argument. I realized this when I used the ODL keyword
copy-logs:
Change-Id: Ic321d6be56ef518a2056099cb5690ea6880c16c2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
Thanh Ha [Tue, 6 Feb 2018 16:36:31 +0000 (11:36 -0500)]
Add test to check for double curly braces
This will cause the build to fail if double curly braces are in
JJB output XML. This should help catch the JJB bug that adds
curly braces when using !include-raw-escape.
Issue: RELENG-777
Change-Id: Iaf9a9ef695229fa24dfc639ca60a4b9a9928a234
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Christopher Lott (cl778h) [Tue, 6 Feb 2018 16:11:18 +0000 (11:11 -0500)]
Repair shell-include directive
Change stage macro to use include-raw instead of include-raw-escape to
work around a JJB bug that inserts lftools_activate with double braces.
Change-Id: Iec5e0b12a287f1945eedc895a25dd16e74b47082
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
Thanh Ha [Mon, 5 Feb 2018 20:03:01 +0000 (15:03 -0500)]
Add maven metadata validator tool
Add a tool to validate maven-metadata.xml to catch timestamp issues
in builds and fail the build if a mismatch is detected.
Issue: RELENG-772
Change-Id: I35a7b9c3b12321a3a7af24ab36397e38ebb01de9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 2 Feb 2018 20:46:58 +0000 (15:46 -0500)]
Add pip.conf to wrappers
This is a global-jjb breaking change as it now causes us to require
the pipconf file configured in Config File Provider. This allows us
to configure for projects that have Nexus 3 a PyPi proxy for faster
local downloads.
Contents of pip.conf should look something like:
[global]
timeout = 60
index-url = https://nexus3.opendaylight.org/repository/PyPi/simple
Change-Id: I4ac816f1b78f09c101e6d614bdd3c459fe0e133a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:24:26 +0000 (20:24 -0500)]
Allow goal override for maven-build macro
Splits out the maven-build into a macro that can be used
to allow projects to override the default goals if they
wish to tweak them for their projects.
Change-Id: I8cabbac997d165bfe8b68d76b78cdb4bb7cc4bbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 19 Jan 2018 01:16:13 +0000 (20:16 -0500)]
Split maven-stage script into a reusable macro
Change-Id: If8d2208e2469d295637a9e82545b2289e5a7588b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>