releng/global-jjb.git
6 years agoAdd docker clean macro 13/10613/1
Jeremy Phelps [Fri, 11 May 2018 20:18:06 +0000 (15:18 -0500)]
Add docker clean macro

This macro forcibly removes all docker images on build system.

Change-Id: I750e235b7de13338d816d2f963f0628b74ef0579
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoAdd ALT_NEXUS_URL to create-netrc 06/10606/2
Jeremy Phelps [Fri, 11 May 2018 18:33:03 +0000 (13:33 -0500)]
Add ALT_NEXUS_URL to create-netrc

This change is backwards compatible with existing system configs but
lets the user spec this env var which will take precedence.  This is
useful, for example, to point at nexus3.edgexfoundry.org if you have
NEXUS_URL=nexus.edgexfoundry.org.

Change-Id: Ibbba26670ab374fd98e1bf20f78ffff7f8b7c52a
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoUse --jobs-only option with jjb-deploy 43/10543/1
Anil Belur [Wed, 9 May 2018 01:35:58 +0000 (11:35 +1000)]
Use --jobs-only option with jjb-deploy

JJB 2.0.3 implementation allows views to be managed by
code. The default behaviour is to update the job along with
all the views in the repository. This takes a longer if
the project has many views managed by code.

Therefore, use the flag --jobs-only to updated
on a given job in sandbox.

Change-Id: Ifaaf60f3479e7485e1dbb5618c6cbcce31525278
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoMerge "Remove maven_metadata_validate function"
Andrew Grimberg [Tue, 8 May 2018 23:17:37 +0000 (23:17 +0000)]
Merge "Remove maven_metadata_validate function"

6 years agoRelease global-jjb v0.19.2 36/10536/1 v0.19.2
Anil Belur [Tue, 8 May 2018 21:59:40 +0000 (07:59 +1000)]
Release global-jjb v0.19.2

Create a new tag with v0.19.2 which points to an object that changes
the version number.

Change-Id: I07282a819a14ce2edf37d71d2a0030dbcf2161d1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoRelease global-jjb v0.19.1 11/10511/2
Anil Belur [Tue, 8 May 2018 12:20:04 +0000 (22:20 +1000)]
Release global-jjb v0.19.1

Change-Id: Ie69a77b11ff92a40157a9fa31d70f4a9bca7aa9d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoBug Fix: Replace -type f with -xtype f 60/10460/2
Dimitrios Markou [Sat, 5 May 2018 12:33:48 +0000 (15:33 +0300)]
Bug Fix: Replace -type f with -xtype f

The -type f parameter cannot recognize symbolic link files
so the replacement with the -xtype f parameter solve this problem

https://jira.opendaylight.org/browse/INTPAK-162

Change-Id: I38aaf2ff3d655d44e757c863f83a0b2cb811ab41
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoRelease global-jjb v0.19.0 21/10421/3 v0.19.0
Thanh Ha [Thu, 3 May 2018 22:14:48 +0000 (18:14 -0400)]
Release global-jjb v0.19.0

Change-Id: Ib0e5add67d0b645d55a7b39b6430f2c849c993ed
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd support to log into docker.io 25/10425/9
Jeremy Phelps [Fri, 4 May 2018 00:41:39 +0000 (19:41 -0500)]
Add support to log into docker.io

This follows essentially the same pattern
as logging into the nexus docker registries.

Change-Id: I174c0f27d46d59ddae5abc0fda67a839095c2535
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoMerge "Add override for GT file-paths in Python jobs"
Daniel Farrell [Thu, 3 May 2018 22:15:19 +0000 (22:15 +0000)]
Merge "Add override for GT file-paths in Python jobs"

6 years agoAdd override for GT file-paths in Python jobs 97/10397/2
Thanh Ha [Thu, 3 May 2018 15:48:04 +0000 (11:48 -0400)]
Add override for GT file-paths in Python jobs

Some projects may have small Python sub-projects within their
repos. This would allow them to only trigger builds when there
is a change in the relevant directory.

Change-Id: If54f43eb3f66d0c6b493495a82a65989fc7ed6c3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
6 years agoFix jenkins-cfg GitHub cfg to build head of branch 16/10416/1
Thanh Ha [Thu, 3 May 2018 20:45:00 +0000 (16:45 -0400)]
Fix jenkins-cfg GitHub cfg to build head of branch

There this job was originally misconfigured and was configured as if
it was a verify job. It should be operating instead as a merge job
and not be pulling in the $sha1 setting. This fixes the job to only
build HEAD of branch as one would expect.

Issue: RELENG-844
Change-Id: I8fa6b25a2fd4b598f619ab4c6ae80ce411756cb4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRemove maven_metadata_validate function 94/10394/1
Thanh Ha [Thu, 3 May 2018 14:07:34 +0000 (10:07 -0400)]
Remove maven_metadata_validate function

This function was originally added to detect a bug with Maven 3.5.1
and earlier. At the time the OpenDaylight community was not yet ready
to migrate to 3.5.2 from 3.3.9 so we implemented this function as a
way to detect the metadata issues.

This function ended up causing some edge case issues and is not worth
maintaining. Remove the function and recommend all projects use Maven
3.5.2 as a minimum.

The specific issue in Maven was that sometimes the deploy phase would
generate an off by one timestamp mismatch between the metadata and the
filename of the artifacts. This causes invalid metadata and then
builds against affected artifacts fail.

Issue: RELENG-927
Change-Id: I65f4f6dc73382b91940620aba587f5fe56259eb1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoConfigure tox tests allow serial execution 12/10212/8
Vanessa Rene Valderrama [Tue, 24 Apr 2018 19:58:26 +0000 (14:58 -0500)]
Configure tox tests allow serial execution

Configuring tox tests to allow serial or parallel execution configurable
within JJB by setting the PARALLEL parameter to true or false.

Issue: RELENG-912
Change-Id: If2edba598b47484b1708f1e0f3fb96f035511841
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
6 years agoAdd instructions on how to test script locally 69/9469/3
Thanh Ha [Fri, 16 Mar 2018 18:45:24 +0000 (14:45 -0400)]
Add instructions on how to test script locally

Useful for debugging the jenkins-cfg job if something is not working.

Change-Id: I6062b754fb01a8da60ac73472133aa2dfd4ae2fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrint out heading information 52/8652/2
Thanh Ha [Fri, 2 Feb 2018 18:25:07 +0000 (13:25 -0500)]
Print out heading information

Makes the output a bit more structured.

Change-Id: Ieedcbf97af01cec63604c2907d6f74177271a64d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSort packer macros alphabetically 65/9965/4
Thanh Ha [Fri, 13 Apr 2018 16:25:06 +0000 (12:25 -0400)]
Sort packer macros alphabetically

Change-Id: I382cd173ca7e08cb3d69af874e74b8ce8d92d65b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSimplify packer-parameters macro name to just lf 64/9964/4
Thanh Ha [Fri, 13 Apr 2018 16:21:58 +0000 (12:21 -0400)]
Simplify packer-parameters macro name to just lf

The lf namespace is lf, not need to set lf-infra everywhere.

(We should go through and reduce this for other instances in
the future).

Change-Id: I629f378e1973ad0f7051df1d8aa15c3bb62f676d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSet default packer variable in job-template 63/9963/4
Thanh Ha [Fri, 13 Apr 2018 16:19:30 +0000 (12:19 -0400)]
Set default packer variable in job-template

Also add documentation for the packer parameters macro.

Change-Id: Ib1532c508196ee3fabbac0137aeb0fd2e10904f4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSkip vote for jjb-deploy 04/10204/1
Thanh Ha [Tue, 24 Apr 2018 16:31:59 +0000 (12:31 -0400)]
Skip vote for jjb-deploy

This job should not be voting.

Issue: RELENG-918
Change-Id: Ia53fe0485e4187d85ecca4e6c48aacda6a997786
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add generic push changes to gerrit builder"
Andrew Grimberg [Mon, 23 Apr 2018 22:40:58 +0000 (22:40 +0000)]
Merge "Add generic push changes to gerrit builder"

6 years agoUpdate XC CLM job parameters 62/10162/11
Jessica Wagantall [Fri, 20 Apr 2018 01:03:02 +0000 (18:03 -0700)]
Update XC CLM job parameters

- Remove unused archive-artifacts log patterns
  - Many of these are Maven related and unused in Python.
- Adjust NEXUS_IQ_CLI_VERSION parameter name to unspecify
  CLI format.

Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221

Change-Id: I0dde9b18468d52574b969c1f83c93f8ff0950faa
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoAdd docs for Python XC CLM 60/10160/7
Jessica Wagantall [Fri, 20 Apr 2018 00:44:06 +0000 (17:44 -0700)]
Add docs for Python XC CLM

Add documentation for Python XC CLM:
- Description of the job
- Job templates
- Description of parameters

Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221

Change-Id: I19713d37aa38159f26e437c961b6d1b4fa6f77fc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoMerge "Rename sonar-cli.sh to nexus-iq-cli.sh"
Thanh Ha [Mon, 23 Apr 2018 17:52:39 +0000 (17:52 +0000)]
Merge "Rename sonar-cli.sh to nexus-iq-cli.sh"

6 years agoAdd generic push changes to gerrit builder 78/9878/10
Anil Belur [Mon, 9 Apr 2018 09:22:15 +0000 (19:22 +1000)]
Add generic push changes to gerrit builder

This is a generic version of the script to push a change through
a job to Gerrit in an automated fashion. Projects can reuse this
macros when they have jobs which requires to  push a change to
gerrit.

RELENG-769
Change-Id: I4d269a4dad6ddbd509a134306b61b2214194b479
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoFail Sphinx build even on warnings 85/10185/1
Thanh Ha [Fri, 20 Apr 2018 18:47:16 +0000 (14:47 -0400)]
Fail Sphinx build even on warnings

Resolve warnings caused by the -W flag.

Change-Id: I0c771da88af487e3a6ddb55b01d524d5a274226d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump version to 0.19.0-dev 84/10184/1
Thanh Ha [Fri, 20 Apr 2018 18:46:52 +0000 (14:46 -0400)]
Bump version to 0.19.0-dev

Change-Id: I000964a1bd8a4d7a9ed09fb29b130258e63ba922
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.18.0 01/10101/3 v0.18.0
Thanh Ha [Wed, 18 Apr 2018 21:23:32 +0000 (17:23 -0400)]
Release global-jjb v0.18.0

Change-Id: I0538f3c15e6df43369ef5e7756a76236d52d0a9e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Update JJB version 2.0.5"
Thanh Ha [Fri, 20 Apr 2018 16:24:16 +0000 (16:24 +0000)]
Merge "Update JJB version 2.0.5"

6 years agoUpdate packer version to 1.2.2 71/10171/1
Anil Belur [Fri, 20 Apr 2018 14:19:56 +0000 (00:19 +1000)]
Update packer version to 1.2.2

Change-Id: I188bb7b14e5122afc25b64765d846c4d1298e8f6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoUpdate comment triggers XC CLM 03/9903/7
Jessica Wagantall [Fri, 20 Apr 2018 00:55:42 +0000 (17:55 -0700)]
Update comment triggers XC CLM

Update comment triggers for Python XC CLM
jobs. From "run-xc-clm" to "run-clm" to make it more
consistent with other clm jobs.

Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221

Change-Id: I637d03805e19460c6c9abb20af61ee4d9d34763e
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoRename sonar-cli.sh to nexus-iq-cli.sh 61/10161/3
Jessica Wagantall [Fri, 20 Apr 2018 00:50:49 +0000 (17:50 -0700)]
Rename sonar-cli.sh to nexus-iq-cli.sh

Rename sonar-cli.sh script to nexus-iq-cli.sh since
it is a more appropriated name for this script as Sonar
tasks are not involved on this job. Just Nexus-IQ scans.

Change-Id: I39a48c1cb8e24ad669a9a7f0ab4a7fcdb57ff1d5
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoAdd new odl- flavors to cloud list 42/10142/1
Thanh Ha [Thu, 19 Apr 2018 17:46:29 +0000 (13:46 -0400)]
Add new odl- flavors to cloud list

Change-Id: Icf5551056956f8d10367b3bf1efa106b1ce0b395
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate JJB version 2.0.5 85/10085/1
Anil Belur [Wed, 18 Apr 2018 11:03:06 +0000 (21:03 +1000)]
Update JJB version 2.0.5

JJB version 2.0.5 contains most recent changes required
to update and manage views on Jenkins.

RELENG-76
Change-Id: Ib230f452b060a21ed02229ff292198c6384ce44d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoReplace pipdeptree with pip freeze 99/9999/1
Thanh Ha [Sat, 14 Apr 2018 17:15:07 +0000 (13:15 -0400)]
Replace pipdeptree with pip freeze

While pipdeptree provides more detailed information it's
dependency with pip seems to break things if we don't
install in the correct order. Let's revert to pip freeze
for now until we have a better way to maintain these debugging
packages.

Issue: RELENG-884
Change-Id: Ib6d3008e2d0e195bc9a01a1c4dd476d92a9deace
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPin pip to 9.0.3 98/9998/1
Thanh Ha [Sat, 14 Apr 2018 17:10:25 +0000 (13:10 -0400)]
Pin pip to 9.0.3

Pin pip versions to 9.0.3 in all scripts that try to install pip.

Issue: RELENG-884
Change-Id: I25df8beb412e06d14db88d90debafa46013bb7ac
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add lf_tox_sonar job"
Jessica Wagantall [Thu, 12 Apr 2018 21:53:23 +0000 (21:53 +0000)]
Merge "Add lf_tox_sonar job"

6 years agoAdd lf_tox_sonar job 94/9894/16
Jessica Wagantall [Tue, 10 Apr 2018 22:24:16 +0000 (15:24 -0700)]
Add lf_tox_sonar job

Python jobs uses tox.ini to configure
their project coverage report. Adding a tox call
before the sonar calls makes the proper updates
to the reports based on that coverage.

Change-Id: I4e6787274ae15c1a9b3b866a55e02f3587b906fb
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoMerge "Update RTD to use Generic API v2 webhook"
Thanh Ha [Wed, 11 Apr 2018 18:12:53 +0000 (18:12 +0000)]
Merge "Update RTD to use Generic API v2 webhook"

6 years agoUpdate default jjb version 13/9913/1
Jeremy Phelps [Wed, 11 Apr 2018 18:00:19 +0000 (13:00 -0500)]
Update default jjb version

JJB contains bits in postbuildscript
publisher that require a minimum of
version 2.0.3.

Change-Id: Ibc62684a9b7dec125064fb5ce823e3f6452581db
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoUpdate RTD to use Generic API v2 webhook 56/9656/9
Jeremy Phelps [Tue, 27 Mar 2018 16:45:57 +0000 (11:45 -0500)]
Update RTD to use Generic API v2 webhook

The old tokenless generic trigger url has been deprecated. Update
to using the new v2 API that requires a token.

This is a backwards incompatible change and modifies 2 things:

  * rtd-project is now the rtd-build-url parameter
  * rtd-token is a new required parameter

Issue: RELENG-879
Change-Id: I786240ab14cf95a2896d92d1c87aef9d7815d964
Co-Authored-By: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoForce rm for cleanup macro 91/9891/3
Thanh Ha [Tue, 10 Apr 2018 20:27:23 +0000 (16:27 -0400)]
Force rm for cleanup macro

Using -f (force) rm will return a 0 status and not print a
message if a file is not found.

Issue: RELENG-880
Change-Id: Ia06166362526cf00754b4a21e6b977d57fe91db6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix pipconf name to the default one 90/9890/1
Thanh Ha [Tue, 10 Apr 2018 20:23:50 +0000 (16:23 -0400)]
Fix pipconf name to the default one

In Managed Files we do not give the filename a dot so remove
it to match what we really look for.

Change-Id: Iaa5df87921d7d7333ecb87bc11c707884e4fb277
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Validate packer version before install"
Anil Belur [Sat, 7 Apr 2018 00:30:22 +0000 (00:30 +0000)]
Merge "Validate packer version before install"

6 years agoFix pip version 51/9751/2
Ry Jones [Thu, 5 Apr 2018 15:27:09 +0000 (08:27 -0700)]
Fix pip version

pip has released a beta version which breaks pipdeptree.

RELENG-868
Change-Id: I755a2521f28fc6441a69dd0ed93c0f85502b787b
Signed-off-by: Ry Jones <ry@walledcity.org>
6 years agoValidate packer version before install 29/9629/6
Anil Belur [Mon, 26 Mar 2018 22:03:25 +0000 (15:03 -0700)]
Validate packer version before install

Packer 1.1.3 is the minimum version required to be installed
to build images on vexxhost. The install script does not check
the version and only checks the availability of the binary in the
$PATH before updating packer.

JIRA: RELENG-838
Change-Id: I8c343176d8f39e3e70b04dddbdec94ffed4354b1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoPin tox to <3.0.0 as it breaks detox 20/9720/2
Jeremy Phelps [Tue, 3 Apr 2018 13:40:56 +0000 (08:40 -0500)]
Pin tox to <3.0.0 as it breaks detox

Issue-ID: RELENG-856
Change-Id: Id13aee7244cce6328fd10cbe495b5fb3e7069924
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoMerge "Revert "Update RTD to use custom trigger url""
Thanh Ha [Wed, 28 Mar 2018 16:47:02 +0000 (16:47 +0000)]
Merge "Revert "Update RTD to use custom trigger url""

6 years agoRevert "Update RTD to use custom trigger url" 54/9654/1
Thanh Ha [Wed, 28 Mar 2018 16:40:52 +0000 (16:40 +0000)]
Revert "Update RTD to use custom trigger url"

This reverts commit 12d6179c0e7c208a360a3c61c0b715b49310b39e.

Change-Id: I87a8f3b25ab977cdcfd3c23da6cebd610edaf325
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Export packer binary dir in $PATH"
Andrew Grimberg [Wed, 28 Mar 2018 16:23:13 +0000 (16:23 +0000)]
Merge "Export packer binary dir in $PATH"

6 years agoUpdate RTD to use custom trigger url 34/9634/4
Jeremy Phelps [Tue, 27 Mar 2018 16:45:57 +0000 (11:45 -0500)]
Update RTD to use custom trigger url

The generic trigger url is now deprecated.  Going forward
users will have to use the Generic API incoming webhook
that is defined per project in the read the docs service.

Change-Id: Iac0774266e787705e7fb903712cbfb4b4a41fb55
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoAdd link to release notes 34/9534/1
Thanh Ha [Wed, 21 Mar 2018 17:11:02 +0000 (13:11 -0400)]
Add link to release notes

Issue: RELENG-552
Change-Id: Ifddf4463ac6afa2395be25cddf989fe05dd9fec1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Quit build if submodule not found"
Thanh Ha [Mon, 19 Mar 2018 19:55:02 +0000 (19:55 +0000)]
Merge "Quit build if submodule not found"

6 years agoQuit build if submodule not found 96/9496/1
Thanh Ha [Mon, 19 Mar 2018 19:30:08 +0000 (15:30 -0400)]
Quit build if submodule not found

In the monolithic docs build we only care to build if the
project is really a submodule of the monolithic docs build.
If not then skip the build as the project should be providing
their own docs verify job.

Issue: RELENG-845
Change-Id: I9bc146170e150097b3b9a30ec0456173bba9b1ef
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Support PostBuildScript 2.x"
Andrew Grimberg [Mon, 19 Mar 2018 17:37:46 +0000 (17:37 +0000)]
Merge "Support PostBuildScript 2.x"

6 years agoEnsure setuptools is updated 78/9478/1
Thanh Ha [Sun, 18 Mar 2018 03:55:41 +0000 (23:55 -0400)]
Ensure setuptools is updated

Similar to pip, we should ensure that setuptools is updated as well.
pip 9.0.2 appears to break without setuptools also being updated.

Change-Id: I3b66140a1a5b292a6e44e955b31ddd62cdc6ed03
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd support for VolumeFromImage boot source 70/9470/2
Thanh Ha [Fri, 16 Mar 2018 18:47:18 +0000 (14:47 -0400)]
Add support for VolumeFromImage boot source

Allows us the ability to configure a volume size for images. This
feature requires OpenStack Cloud Plugin 2.32 to use.

Change-Id: Ic557373c16afc3df3af3571e5f3883f5b18e8e8c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Document job-group defaults order of priority"
Anil Belur [Fri, 16 Mar 2018 06:44:07 +0000 (06:44 +0000)]
Merge "Document job-group defaults order of priority"

6 years agoExport packer binary dir in $PATH 61/9461/1
Anil Belur [Thu, 15 Mar 2018 12:55:28 +0000 (22:55 +1000)]
Export packer binary dir in $PATH

Add packer binary path to $PATH to avoid packer being
installed multiple times in builder merge jobs.

JIRA: RELENG-838
Change-Id: Ie414ff39d0829135cc797b187f693930cf45c6d5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoSupport PostBuildScript 2.x 87/9387/3
Thanh Ha [Mon, 12 Mar 2018 01:48:09 +0000 (21:48 -0400)]
Support PostBuildScript 2.x

This is a breaking change that requires consumers of global-jjb
to switch to JJB 2.0.3 and install PostBuildScript 2.x in Jenkins.

It updates lf-infra-publish macro to switch to the PostBuildScript 2.x
YAML definitions.

Issue: RELENG-832
Change-Id: I04020587acfb8b6550c0221ebfb97a501f46b15a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump version to 0.18.0-dev 93/9393/1
Thanh Ha [Mon, 12 Mar 2018 15:15:28 +0000 (11:15 -0400)]
Bump version to 0.18.0-dev

Change-Id: Ib2d45332a9626b0aaf82443e1f37846a00569e46
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.17.0 86/9386/1 v0.17.0
Thanh Ha [Mon, 12 Mar 2018 01:24:16 +0000 (21:24 -0400)]
Release global-jjb v0.17.0

Change-Id: I13cf313e1875eabb50290c2409ef632eaa7183f7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument job-group defaults order of priority 81/7281/3
Thanh Ha [Fri, 3 Nov 2017 19:20:03 +0000 (15:20 -0400)]
Document job-group defaults order of priority

We discovered that job-group variable definitions appear to
have higher precedence than project definitions. This caused a problem
for us in global-jjb as we would like to allow projects to override
default variables.

We should make it best practice that global-jjb stops providing
job-group definitions and deprecating any existing job groups.

Via patch I2b824e3cc89667698db8ebfdd3ce43f551e961d7 we were able to
resolve this for JJB version.

Change-Id: I93c8256193933a04e8732963216f69424cef3a5f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument pyenv usage in the tox job 84/8384/3
Thanh Ha [Fri, 12 Jan 2018 19:10:06 +0000 (14:10 -0500)]
Document pyenv usage in the tox job

Change-Id: Id07a1e4065b03489260dfe1d0b86cacf8d60238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPin JJB to 2.0.2 for tests 85/9385/1
Thanh Ha [Mon, 12 Mar 2018 01:00:15 +0000 (21:00 -0400)]
Pin JJB to 2.0.2 for tests

JJB >2.0.2 requires use to update our shiplogs postbuildscript as
support for the 2.x version of postbuildscript takes over the
default code path.

Change-Id: Iff3cd415f12a54aa3fcbf48d7f10b6df01cd1279
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd CLM support for Python 02/9302/14
Jessica Wagantall [Wed, 7 Mar 2018 01:10:41 +0000 (17:10 -0800)]
Add CLM support for Python

Add template to support CLM scans for python
based projects. This template uses the nexus-iq-cli
package directly and executes an extended report to
scan python based projects.

Change-Id: I5e5c420539ab3a3e5b292620da4418c16d557221
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoAdd explicit links for Packer jobs 04/9304/1
Thanh Ha [Wed, 7 Mar 2018 01:41:00 +0000 (20:41 -0500)]
Add explicit links for Packer jobs

Change-Id: I90e4d89008f0f6550f640a8c03b268d1bde884e9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd script to manage Jenkins cloud cfg 29/8429/18
Thanh Ha [Thu, 18 Jan 2018 16:09:36 +0000 (11:09 -0500)]
Add script to manage Jenkins cloud cfg

A groovy script to manage the Jenkins global cloud cfg
programmatically. This script reads configuration from
the directory jenkins-config/clouds to configure cloud
configuration in Jenkins. Refer to the documentation for
details.

No upgrade consideration is necessary as this script
automatically detects the absence of the jenkins-config/clouds
directory and disables the Cloud configuration.

Issue: RELENG-804
Change-Id: Idad3078942618b7d8fd08a40bf9e4e5ed5a0dc48
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMake rtd jobs verbose 09/9109/2
Lott, Christopher (cl778h) [Thu, 1 Mar 2018 14:40:28 +0000 (09:40 -0500)]
Make rtd jobs verbose

Add set -x flag so these scripts echo steps in Jenkins output.

Change-Id: Ia09f3194407f6c94d8cb1adfbb4d32e9a4592ff6
Signed-off-by: Lott, Christopher (cl778h) <cl778h@att.com>
6 years agoAdd a description of global-jjb 82/9082/2
Thanh Ha [Wed, 28 Feb 2018 01:53:47 +0000 (20:53 -0500)]
Add a description of global-jjb

Change-Id: I10926e554e4c99f6336837f7393d065f8e653599
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add triggers to jenkins-cfg job"
Thanh Ha [Wed, 28 Feb 2018 01:53:04 +0000 (01:53 +0000)]
Merge "Add triggers to jenkins-cfg job"

6 years agoGIT_URL variable corruption in script 57/9057/2
Thanh Ha [Tue, 27 Feb 2018 05:29:49 +0000 (00:29 -0500)]
GIT_URL variable corruption in script

Not sure why but GIT_URL seems to get corrupt inside of this
script. Use GERRIT_URL instead to clone patches.

Additionally also ignore a patch if a patch that matches the
Gerrit that triggered it is passed in.

Issue: RELENG-784
Change-Id: I85de941ad64d64597f69c1c924295b26e1dc1bec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd triggers to jenkins-cfg job 83/8883/1
Thanh Ha [Fri, 16 Feb 2018 19:55:55 +0000 (14:55 -0500)]
Add triggers to jenkins-cfg job

Allows the job to run on a timed trigger as well as on patch
merged events. Default timed trigger is run @daily.

Change-Id: I54b04e7814718816fe221a33d80aa1c1574095d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd local-{templates}.yaml path to packer pattern 78/8878/1
Thanh Ha [Thu, 15 Feb 2018 22:09:05 +0000 (17:09 -0500)]
Add local-{templates}.yaml path to packer pattern

Common packer supports local improvements via local-*.yaml files
so we need to add this to the file paths.

Change-Id: Id6d723a174de5f272cc267496279d7e79cef8b8f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoGit submodule update after fetching patch 59/8859/1
Thanh Ha [Wed, 14 Feb 2018 21:13:11 +0000 (16:13 -0500)]
Git submodule update after fetching patch

For projects that have submodules we need to call
`git submodule update` after fetching the patch so that
submodule updates caused by the patch are pulled in.

Running that command on a repo that does not contain submodules
returns cleanly as a noop.

Change-Id: Iec76e4c42d9e0132571af477f3ae770e5e360781
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd a note about requiring jjbini configuration 39/8839/1
Thanh Ha [Tue, 13 Feb 2018 18:21:45 +0000 (13:21 -0500)]
Add a note about requiring jjbini configuration

Document that jjbini needs to include JJB 2.0 style configuration
sections for the "production" and "sandbox" systems.

Change-Id: I102c57774a75bd1545f21a67bb2d98ccb0f270a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump version to 0.17.0-dev 30/8830/1
Thanh Ha [Mon, 12 Feb 2018 23:55:07 +0000 (18:55 -0500)]
Bump version to 0.17.0-dev

Change-Id: I9c352b633fcf83a0b60e2351401cd76c42df238d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.16.0 86/8786/3 v0.16.0
Thanh Ha [Fri, 9 Feb 2018 19:12:42 +0000 (14:12 -0500)]
Release global-jjb v0.16.0

Change-Id: I6acf020cda29198ad930ceeffe08e09ad0c7d6bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoCreate job to manage Jenkins Global Variables 34/8434/8
Thanh Ha [Fri, 19 Jan 2018 00:24:56 +0000 (19:24 -0500)]
Create job to manage Jenkins Global Variables

Parses a configuration file containing variable listings in the form
"KEY=value" one per line and creates the appropriate groovy
script to push these environment variables to Jenkins Global Config.

Configuration file is stored in
ci-management/jenkins-config/global-vars-SILO.sh

(Where silo is production | sandbox)

While JJB provided us a way to store job configuration in a git repo
we have never had a good way to manage global Jenkins configuration.
This patch enables us to manage one aspect, Global Environment
variables in the ci-management repository.

Issue: RELENG-753
Change-Id: I7d134950b25d469686cace2f79fd8c297727166c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add pip.conf to wrappers"
Thanh Ha [Fri, 9 Feb 2018 18:13:01 +0000 (18:13 +0000)]
Merge "Add pip.conf to wrappers"

6 years agoUpdate submodule documentation 67/8767/2
Andrew Grimberg [Thu, 8 Feb 2018 21:26:14 +0000 (13:26 -0800)]
Update submodule documentation

Production deployments of global-jjb should be using the GitHub mirror
as their primary source as GitHub rarely has outages. This decouples the
master Gerrit instance from downstream consumption such that we are more
free to do maintenance whenever we desire.

Change-Id: I37139965902fa922cbb14f7ad01c22248bc1847b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoset +x around sensitive code docker login code 47/8747/1
Thanh Ha [Thu, 8 Feb 2018 04:19:43 +0000 (23:19 -0500)]
set +x around sensitive code docker login code

Call `set +x` as a guard just in case a script elsewhere is calling
`set -x` which could cause the credentials to print to console.

Change-Id: I6802887c7a3c9809d9d13d6b3cc90e3570f120fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd : to jjb-deploy: 81/8681/3
Jamo Luhrsen [Tue, 6 Feb 2018 03:28:23 +0000 (19:28 -0800)]
Add : to jjb-deploy:

This is more intuitive to me, as the keyword takes an
argument. I realized this when I used the ODL keyword
copy-logs:

Change-Id: Ic321d6be56ef518a2056099cb5690ea6880c16c2
Signed-off-by: Jamo Luhrsen <jluhrsen@redhat.com>
6 years agoAdd test to check for double curly braces 88/8688/1
Thanh Ha [Tue, 6 Feb 2018 16:36:31 +0000 (11:36 -0500)]
Add test to check for double curly braces

This will cause the build to fail if double curly braces are in
JJB output XML. This should help catch the JJB bug that adds
curly braces when using !include-raw-escape.

Issue: RELENG-777
Change-Id: Iaf9a9ef695229fa24dfc639ca60a4b9a9928a234
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRepair shell-include directive 85/8685/2
Christopher Lott (cl778h) [Tue, 6 Feb 2018 16:11:18 +0000 (11:11 -0500)]
Repair shell-include directive

Change stage macro to use include-raw instead of include-raw-escape to
work around a JJB bug that inserts lftools_activate with double braces.

Change-Id: Iec5e0b12a287f1945eedc895a25dd16e74b47082
Signed-off-by: Christopher Lott (cl778h) <clott@research.att.com>
6 years agoAdd maven metadata validator tool 75/8675/3
Thanh Ha [Mon, 5 Feb 2018 20:03:01 +0000 (15:03 -0500)]
Add maven metadata validator tool

Add a tool to validate maven-metadata.xml to catch timestamp issues
in builds and fail the build if a mismatch is detected.

Issue: RELENG-772
Change-Id: I35a7b9c3b12321a3a7af24ab36397e38ebb01de9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd pip.conf to wrappers 58/8658/3
Thanh Ha [Fri, 2 Feb 2018 20:46:58 +0000 (15:46 -0500)]
Add pip.conf to wrappers

This is a global-jjb breaking change as it now causes us to require
the pipconf file configured in Config File Provider. This allows us
to configure for projects that have Nexus 3 a PyPi proxy for faster
local downloads.

Contents of pip.conf should look something like:

[global]
timeout = 60
index-url = https://nexus3.opendaylight.org/repository/PyPi/simple

Change-Id: I4ac816f1b78f09c101e6d614bdd3c459fe0e133a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAllow goal override for maven-build macro 38/8438/2
Thanh Ha [Fri, 19 Jan 2018 01:24:26 +0000 (20:24 -0500)]
Allow goal override for maven-build macro

Splits out the maven-build into a macro that can be used
to allow projects to override the default goals if they
wish to tweak them for their projects.

Change-Id: I8cabbac997d165bfe8b68d76b78cdb4bb7cc4bbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSplit maven-stage script into a reusable macro 37/8437/2
Thanh Ha [Fri, 19 Jan 2018 01:16:13 +0000 (20:16 -0500)]
Split maven-stage script into a reusable macro

Change-Id: If8d2208e2469d295637a9e82545b2289e5a7588b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add sphinx link to rtd jobs page"
Thanh Ha [Fri, 2 Feb 2018 00:56:50 +0000 (00:56 +0000)]
Merge "Add sphinx link to rtd jobs page"

6 years agoMerge "Add Links to Plugins mentioned in README"
Thanh Ha [Thu, 1 Feb 2018 20:12:03 +0000 (20:12 +0000)]
Merge "Add Links to Plugins mentioned in README"

6 years agoFix local platform file path 37/8637/2
Thanh Ha [Thu, 1 Feb 2018 18:50:47 +0000 (13:50 -0500)]
Fix local platform file path

The local vars path is incorrect in the if-statement but
correct in the declaration below it. Update to match.

Change-Id: I1e8ec19adf842668fb46e54aaf8beebfcef9c34d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDisable unbound variable checking for activate 36/8636/1
Thanh Ha [Thu, 1 Feb 2018 18:15:04 +0000 (13:15 -0500)]
Disable unbound variable checking for activate

virtualenv activate contains unbound variables so must be disabled
when calling `source activate`.

Change-Id: I8af6b55962580778fbb349c8164f661c4c462928
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd sphinx link to rtd jobs page 35/8635/1
Thanh Ha [Thu, 1 Feb 2018 02:26:16 +0000 (21:26 -0500)]
Add sphinx link to rtd jobs page

Change-Id: I67bf0e81fd3e6156cd31dbb4700c8909cf2bf87d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agodeploy cleanup not removing all unmodified files 23/8623/1
Thanh Ha [Wed, 31 Jan 2018 22:00:23 +0000 (17:00 -0500)]
deploy cleanup not removing all unmodified files

The linting patch If87fceb79e384e26f021a9c85a2e9d7413ce421e
broke the cleanup script so unmodified maven-metadata.xml files
were not properly being cleaned up before upload to Nexus. This
caused the maven-merge job to update maven-metadata.xml files
outside of what was actually modified. So when 2 maven-merge jobs
running on different streams are run at the same time they would
overwrite each other with old data.

Issue: RELENG-766
Change-Id: I18da721bfb5db6eef9c15ffabd4482e0aa24e3a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoupdate docs to use minutes over seconds 13/8613/1
Sam Hague [Wed, 31 Jan 2018 13:31:56 +0000 (08:31 -0500)]
update docs to use minutes over seconds

Change-Id: Ia1e7b101ee6a3605d6c0ec4ac163a6f8c362921b
Signed-off-by: Sam Hague <shague@redhat.com>
6 years agoAdd Links to Plugins mentioned in README 92/8592/2
Trevor Bramwell [Tue, 30 Jan 2018 18:41:12 +0000 (10:41 -0800)]
Add Links to Plugins mentioned in README

Includes a link to the download location of the PostBuildScript plugin
since it is no longer being released.

Change-Id: Ia2d34921fa9d870fd5792d938f9b2844853a38e9
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoAdd script to update Java alternatives 93/8493/15
Jessica Wagantall [Wed, 24 Jan 2018 00:31:47 +0000 (16:31 -0800)]
Add script to update Java alternatives

Use ${java-version} to set the correct java, javac
and java_sdk_openjdk alternative for lf-maven-jobs.

Issue-ID: RELENG-752
Change-Id: Iff0c2e7d92c4cc802925ae67cdda1f4247db52be
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoRemove jdk variable from lf-maven-jobs 71/8471/3
Jessica Wagantall [Tue, 23 Jan 2018 00:14:53 +0000 (16:14 -0800)]
Remove jdk variable from lf-maven-jobs

Setting this variable to {java-version} creates some issues for
projects using the Ubuntu nodes as they need to use explicitly
'System' as their JDK version.

Change-Id: I0a12bc83f7c8c1c8fcdf8f2a1d5f47b8360b94c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoBump default timeout to 15 minutes for tox 80/8580/1
Thanh Ha [Mon, 29 Jan 2018 22:20:55 +0000 (17:20 -0500)]
Bump default timeout to 15 minutes for tox

Increase tox jobs default timeout to 15 minutes. Considering many
things appear to be taking longer in Vexxhost this is likely
necessary.

Change-Id: I592146b1f0d47a9aedfdc91c1878a6f94b3d363c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>