releng/global-jjb.git
5 years agoFix API breakage caused by OS Plugin version scan 02/11702/1 v0.21.x v0.21.5
Thanh Ha [Mon, 9 Jul 2018 22:14:07 +0000 (18:14 -0400)]
Fix API breakage caused by OS Plugin version scan

Patch I3384c86c64c3aff7404ddec77aa85463e5fbac2a caused an unexpected
API change in get_minion_options which now requires a $silo
variable. However the change was not passed down to all instances
where the function was called causing breakage.

Change-Id: If4a0cec0232d1381413da3f6279f23bc426e1ace
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoFix empty variable when run in Jenkins 44/11544/1 v0.21.4
Thanh Ha [Mon, 25 Jun 2018 16:37:58 +0000 (12:37 -0400)]
Fix empty  variable when run in Jenkins

Change-Id: Ic6e2b1424e8e59611e021c4a506ba556e8e2111e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoAdd support for OS Plugin v2.35 43/11543/1 v0.21.3
Thanh Ha [Thu, 21 Jun 2018 21:29:30 +0000 (17:29 -0400)]
Add support for OS Plugin v2.35

The SlaveOptions() API in OS Plugin v2.35 was changed to include a
new minimum instance cap configuration.

Issue: RELENG-1041
Change-Id: I3384c86c64c3aff7404ddec77aa85463e5fbac2a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoRvrt "Add pre-commit hook for trailing-whitespace" 15/11515/2 v0.21.2
Thanh Ha [Fri, 22 Jun 2018 13:50:13 +0000 (13:50 +0000)]
Rvrt "Add pre-commit hook for trailing-whitespace"

This reverts commit f325f0dc4d34cb79e9c15813140db1e18ed2a185.

Change-Id: Iaf8fbe8a9760670bd7dc94da89e1cac145be8fb4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoFix missing parameters in tox-verify job 13/11513/1
Thanh Ha [Fri, 22 Jun 2018 13:34:22 +0000 (09:34 -0400)]
Fix missing parameters in tox-verify job

Patch If2edba598b47484b1708f1e0f3fb96f035511841 broke parameters in
the tox-verify job by overriding all the existing parameters with
only the PARALLEL parameter. This patch fixes it by moving the
parallel parameter definition so that it is declared along with
the other parameters the job requires.

Issue: RELENG-1042
Change-Id: I6fdd8876235843101bc175ff91ed872aab88279d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoAdd pre-commit hook for trailing-whitespace 77/11477/1
Thanh Ha [Thu, 21 Jun 2018 00:25:44 +0000 (20:25 -0400)]
Add pre-commit hook for trailing-whitespace

Install using tox:

    tox -e check-hooks

ref: https://pre-commit.com

Change-Id: Ie060a9d1c843ce3889df10535d0a87e41d4b4e76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoChange project to clone by jjb-deploy 73/11473/2 v0.21.1
Luis Gomez [Wed, 20 Jun 2018 21:11:04 +0000 (14:11 -0700)]
Change project to clone by jjb-deploy

When "jjb-deploy" is invoked from a gerrit patch, we do not
want to clone the patch project code ($GERRIT_PROJECT) but
the releng/builder code ($PROJECT).

Change-Id: I329b3c756826250358b20aeb2454cb5650d87f59
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
5 years agoRelease global-jjb v0.21.0 69/11369/1 v0.21.0
Thanh Ha [Sun, 17 Jun 2018 20:17:16 +0000 (16:17 -0400)]
Release global-jjb v0.21.0

Change-Id: Ia9cdcfe2112ee60499c6ba35f959dc1e169b8220
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoRemove unnecessary github trigger macro 21/11321/4
Thanh Ha [Thu, 14 Jun 2018 22:30:00 +0000 (18:30 -0400)]
Remove unnecessary github trigger macro

This trigger macro was essentially redefining everything the trigger
directly supports. We might as well just call the trigger directly.

Change-Id: I1fc77b501678f213767a70c99119a56a418910fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoSet minimal packer version to 1.2.3 23/11323/4
Anil Belur [Fri, 15 Jun 2018 00:26:44 +0000 (10:26 +1000)]
Set minimal packer version to 1.2.3

Patch Ia195bd99d55f23b4f39acf590520637e54fc006a introduced
`instance_name` which requires a minimum Packer version of
1.2.3 in order to be used.

ref: https://github.com/hashicorp/packer/blob/v1.2.3/CHANGELOG.md

Change-Id: I6219855f8de35519f1ea07cc04385acf91bf90f1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 years agoAdd INFO.yaml verify jobs 24/10924/31
Jessica Wagantall [Fri, 1 Jun 2018 03:02:38 +0000 (20:02 -0700)]
Add INFO.yaml verify jobs

Add '{project-name}-info-yaml-jobs' and
'{project-name}-github-info-yaml-jobs' to validate that
INFO.yaml file changes are kept isolated from other file
changes.

The addition of or changes to an INFO.yaml should be kept
on its own gerrit change and should not be combined with other
changes.

Issue: RELENG-973
Change-Id: Id7ddb55c34a741d92b1e126f1237fb9753a4aa75
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Co-Authored-By: Trevor Bramwell <tbramwell@linuxfoundation.org>
5 years agoMerge "Set docs version from git"
Thanh Ha [Thu, 14 Jun 2018 22:24:59 +0000 (22:24 +0000)]
Merge "Set docs version from git"

5 years agoMerge "Configurable Timed Trigger for Packer Merge Jobs"
Thanh Ha [Thu, 14 Jun 2018 22:11:14 +0000 (22:11 +0000)]
Merge "Configurable Timed Trigger for Packer Merge Jobs"

5 years agoConfigurable Timed Trigger for Packer Merge Jobs 59/11259/2
Trevor Bramwell [Thu, 26 Apr 2018 18:58:08 +0000 (11:58 -0700)]
Configurable Timed Trigger for Packer Merge Jobs

This change add the optional parameter 'cron' to packer builds so users
can configure when packer images can be rebuilt. It also switches the
timer from '00 10 1 * *' to '@monthly' to take advantage of Jenkins cron
hash system so the jobs are splayed over the month and don't all start
on the same minute.

Change-Id: I5bc29dab281d8ad1a4260994c1b1d6fb81b5a488
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
5 years agoSet docs version from git 58/11158/5
Thanh Ha [Mon, 11 Jun 2018 02:46:03 +0000 (22:46 -0400)]
Set docs version from git

Removes the need to modify conf.py every time we release.

Change-Id: I010c5a4eaf2f2c88156db561218919aa470eaea0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMerge "Use include-regions to limit node build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:34 +0000 (21:00 +0000)]
Merge "Use include-regions to limit node build paths"

5 years agoMerge "Use include-regions to limit Py build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:29 +0000 (21:00 +0000)]
Merge "Use include-regions to limit Py build paths"

5 years agoMerge "Use include-regions to limit JenkinsCFG build path"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:26 +0000 (21:00 +0000)]
Merge "Use include-regions to limit JenkinsCFG build path"

5 years agoMerge "Use include-regions to limit packer build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:23 +0000 (21:00 +0000)]
Merge "Use include-regions to limit packer build paths"

5 years agoMerge "Use include-regions to limit JJB build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:20 +0000 (21:00 +0000)]
Merge "Use include-regions to limit JJB build paths"

5 years agoMerge "Use include-regions to limit MVN build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:15 +0000 (21:00 +0000)]
Merge "Use include-regions to limit MVN build paths"

5 years agoMerge "Use include-regions to limit RTD build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:02 +0000 (21:00 +0000)]
Merge "Use include-regions to limit RTD build paths"

5 years agoOnly create package diff if start and end exist 42/11242/1
Andrew Grimberg [Wed, 13 Jun 2018 18:22:15 +0000 (11:22 -0700)]
Only create package diff if start and end exist

Issue: RELENG-798
Change-Id: I01b513073b720c7fdabf1638684af9c27eda9f8a
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
5 years agoMake package listing script smarter 22/11222/2
Andrew Grimberg [Wed, 13 Jun 2018 15:19:21 +0000 (08:19 -0700)]
Make package listing script smarter

We have extra knowledge of what should be created just by the
environment variables or files that exist. We should use that to
determine if we a diff file should be created.

Issue: RELENG-798
Change-Id: I7dd5baaa669d5e1cc84e94686c7ff6eee303cd6f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
5 years agoUse include-regions to limit RTD build paths 89/11189/3
Thanh Ha [Tue, 12 Jun 2018 01:41:42 +0000 (21:41 -0400)]
Use include-regions to limit RTD build paths

Issue: RELENG-1022
Change-Id: I4e5ed50d399b49470a95937a2b17cade210b768c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoUse include-regions to limit MVN build paths 92/11192/1
Thanh Ha [Tue, 12 Jun 2018 02:22:39 +0000 (22:22 -0400)]
Use include-regions to limit MVN build paths

Also move trigger definitions to more specific template rather
than anchor.

Issue: RELENG-1022
Change-Id: I73162326251f6ef1e656e06d68062c4ec0d45992
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoUse include-regions to limit node build paths 91/11191/1
Thanh Ha [Tue, 12 Jun 2018 02:08:52 +0000 (22:08 -0400)]
Use include-regions to limit node build paths

Issue: RELENG-1022
Change-Id: I31faddc8f567127ed3d3fa648451c4150cc94c0a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoUse include-regions to limit Py build paths 90/11190/3
Thanh Ha [Tue, 12 Jun 2018 01:56:39 +0000 (21:56 -0400)]
Use include-regions to limit Py build paths

Limit python build paths for GitHub builds similar to what is already
happening with Gerrit versions of these jobs.

Also reorganize the code structure so that the common anchor does not
contain job specific config.

Issue: RELENG-1022
Change-Id: Ieb16ca14cfda425a3efdad0beb346839f6b4aa84
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoUse include-regions to limit JenkinsCFG build path 88/11188/2
Thanh Ha [Tue, 12 Jun 2018 01:32:08 +0000 (21:32 -0400)]
Use include-regions to limit JenkinsCFG build path

Issue: RELENG-1022
Change-Id: I0682fcdcc90e94b7f0f7752eea6fbff8125845a4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoUse include-regions to limit JJB build paths 85/11185/2
Thanh Ha [Tue, 12 Jun 2018 01:06:14 +0000 (21:06 -0400)]
Use include-regions to limit JJB build paths

Issue: RELENG-1022
Change-Id: I6c50a864ea85ac2ff41df1ab91a531b55468ed3f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoUse include-regions to limit packer build paths 84/11184/6
Thanh Ha [Mon, 11 Jun 2018 23:04:14 +0000 (19:04 -0400)]
Use include-regions to limit packer build paths

Issue: RELENG-1022
Change-Id: I283400e5ac2473e2eabb883c44a2a1e705b312ee
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoAdd CSS and HTML to rtd build pattern 56/11156/1
Thanh Ha [Sun, 10 Jun 2018 04:38:30 +0000 (00:38 -0400)]
Add CSS and HTML to rtd build pattern

Ensure we build the docs when CSS / HTML is modified as well as docs
can contain those file types.

Change-Id: Idc779739d61dd3c3a10860298561b1f3d838ad85
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMerge "Add package lists to job logs"
Thanh Ha [Sat, 9 Jun 2018 15:31:03 +0000 (15:31 +0000)]
Merge "Add package lists to job logs"

5 years agoAdd documentation for CFP files 37/10637/16
Trevor Bramwell [Tue, 15 May 2018 14:24:57 +0000 (07:24 -0700)]
Add documentation for CFP files

* jjbini
* jenkins-log-archives-settings
* packer-cloud-env

Change-Id: I316e4f1b93605029b5956fb1f5d1fd45b1d00c0d
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
5 years agoAdd package lists to job logs 21/11121/3
Andrew Grimberg [Thu, 7 Jun 2018 21:35:02 +0000 (14:35 -0700)]
Add package lists to job logs

A listing of packages that are on the system is useful for debugging
changes that happen during a job run

Issue: RELENG-798
Change-Id: I88bc2eca175bbef1b7581b26199aff9a13f1910d
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
5 years agoMerge "Document lf-infra-push-gerrit-patch macro in RTD"
Thanh Ha [Fri, 8 Jun 2018 03:58:39 +0000 (03:58 +0000)]
Merge "Document lf-infra-push-gerrit-patch macro in RTD"

5 years agoDocument lf-infra-push-gerrit-patch macro in RTD 43/11043/4
Anil Belur [Wed, 6 Jun 2018 03:28:47 +0000 (13:28 +1000)]
Document lf-infra-push-gerrit-patch macro in RTD

JIRA: RELENG-945
Change-Id: I709aec08a10bb6a55b1c84c71c32c303bc1fdce5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 years agoMerge "Handle missing CREDENTIAL when creating .netrc"
Andrew Grimberg [Thu, 7 Jun 2018 15:13:14 +0000 (15:13 +0000)]
Merge "Handle missing CREDENTIAL when creating .netrc"

5 years agoMerge "DO NOT fail if global-vars-.sh is not configured"
Anil Belur [Thu, 7 Jun 2018 03:04:54 +0000 (03:04 +0000)]
Merge "DO NOT fail if global-vars-.sh is not configured"

5 years agoUpdate OpenStack plugin supported versions list 92/11092/1
Thanh Ha [Thu, 7 Jun 2018 02:36:30 +0000 (22:36 -0400)]
Update OpenStack plugin supported versions list

Confirmed that we work with 2.33 and 2.34 OpenStack plugin versions.

Change-Id: I3612cb242824e438b8bf0df576e951ed753ea8fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoDO NOT fail if global-vars-.sh is not configured 91/11091/1
Thanh Ha [Thu, 7 Jun 2018 02:29:49 +0000 (22:29 -0400)]
DO NOT fail if global-vars-.sh is not configured

All configurations in jenkins-cfg job should be optional. If a project
does not configure a setting then skip it and continue.

Issue: RELENG-962
Change-Id: I386a6371ce3f1ff1b5cc024760f6d316d5008d63
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoHandle missing CREDENTIAL when creating .netrc 83/11083/1
Thanh Ha [Wed, 6 Jun 2018 20:57:55 +0000 (16:57 -0400)]
Handle missing CREDENTIAL when creating .netrc

Move the `set -eu -o pipefail` to after CREDENTIAL is set so that
we can properly error handle. Otherwise the script will exit too
soon.

Change-Id: I58edd3deb5b928a9ebaa4e00f6ed83d652e62d70
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoDisable -x to prevent printing passwords 82/11082/1
Thanh Ha [Wed, 6 Jun 2018 20:54:06 +0000 (16:54 -0400)]
Disable -x to prevent printing passwords

Change-Id: I9b8254aa8d514ca8513f6c9c7872b4abf287cbd1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoClear log credential files with force (-f) 74/11074/1
Thanh Ha [Wed, 6 Jun 2018 20:27:01 +0000 (16:27 -0400)]
Clear log credential files with force (-f)

Prevents Jenkins from printing file not found if the files are
already cleaned up for whatever reason. Eg. If the project is not
shipping logs to a log server.

Change-Id: I7b2f614ded8defcbfe014b44febe210381206675
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoAdd sha1 parameter for GitHub jobs 54/11054/2
Thanh Ha [Wed, 6 Jun 2018 16:47:34 +0000 (12:47 -0400)]
Add sha1 parameter for GitHub jobs

This allows us to override the sha1 parameter for GitHub verify
job in manual builds. Thus allowing us to manually trigger verify
jobs in Jenkins for GitHub based projects.

Also updates all the existing GERRIT_* descriptions to try to detail
the difference for GitHub PR Triggers vs. Gerrit Triggers.

Change-Id: Ia514955eb2f22f71668e3a3a0cc94bb124f2544a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoConsolidate keypair default names to jenkins-ssh 40/11040/3
Thanh Ha [Wed, 6 Jun 2018 01:39:01 +0000 (21:39 -0400)]
Consolidate keypair default names to jenkins-ssh

BREAKING-CHANGE: Minion SSH default KeyPair name is now jenkins-ssh
    Either override in cloud.cfg or rename the Credential in Jenkins.

This is an attempt to consolidate all our different instances
of the ssh-keypair name all over the place. By default we will
consolidate on `jenkins-ssh` as the default keypair name. This
can be overrided of course and applies to the following config
locations in Jenkins / CIMAN:

1. defaults.yaml's `jenkins-ssh-credential`
2. Jenkins > Credentials > ID > jenkins-ssh
3. jenkins-config/clouds controlling both local private key name
   and public key name inside the cloud which now need to match

On a new infra if we are not overriding any values all of these should
accept the default value of `jenkins-ssh`.

Change-Id: I9fe691bbb59d81a1e861261be33cbda00de7a061
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMerge "Add labels for linking in configuration.rst"
Andrew Grimberg [Tue, 5 Jun 2018 18:35:22 +0000 (18:35 +0000)]
Merge "Add labels for linking in configuration.rst"

5 years agoAdd jenkins-init-scripts to global-jjb 88/10988/4
Thanh Ha [Tue, 5 Jun 2018 03:43:25 +0000 (23:43 -0400)]
Add jenkins-init-scripts to global-jjb

These are the minion initialization scripts that start running
when our cloud plugin spawns a new minion. They are responsible
for prepping the minion for Jenkins to take over and run the job.

Issue: RELENG-994
Change-Id: I68e242297db03752fcc415e5465e7bfa8ab66d79
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoAdd labels for linking in configuration.rst 84/10984/1
Thanh Ha [Tue, 5 Jun 2018 01:35:35 +0000 (21:35 -0400)]
Add labels for linking in configuration.rst

Change-Id: Ieb17fcddb83f8c12d6331dadbcd6ee6581ea1588
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMerge "Setup tools in global-jjb tox.ini"
Andrew Grimberg [Mon, 4 Jun 2018 18:59:41 +0000 (18:59 +0000)]
Merge "Setup tools in global-jjb tox.ini"

5 years agoSetup tools in global-jjb tox.ini 27/10727/5
Thanh Ha [Tue, 8 May 2018 16:36:26 +0000 (12:36 -0400)]
Setup tools in global-jjb tox.ini

Use -q to hide tox output.

Creates a global tox.ini which can be used by projects to use common
PyPi tools. This replaces the need to "source /path/to/venv"
everywhere in our scripts to jump to different tools.
Instead we replace it with one of:

    tox -q -c jjb/global-jjb/tox.ini -e openstack -- {parameters}
    tox -q -c jjb/global-jjb/tox.ini -e openstack {parameters}

Non-CI management jobs can wget the tox.ini from global-jjb to pull
the configuration.

By default the version installed will be the latest patch version in
semvar. The version comparison operator can be overrided via the
*_VERSION_OP environment variable for each tool type. Install versions
are also overridable via the *_VERSION environment variable.

Ex:

    JJB_VERSION=2.0.6
    JJB_VERSION_OP=">="

https://www.python.org/dev/peps/pep-0440/#version-specifiers

Change-Id: I8b1a0936220ddbeb7f5e051ce15c421fec27c1a0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoRedirect README documentation to RTD 14/10914/10
Thanh Ha [Thu, 31 May 2018 20:36:31 +0000 (16:36 -0400)]
Redirect README documentation to RTD

Change-Id: Ie125cb72acc518f2c74463b376e73d44d068971f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMerge "Allow any project/branch to deploy jjb jobs"
Andrew Grimberg [Mon, 4 Jun 2018 17:15:44 +0000 (17:15 +0000)]
Merge "Allow any project/branch to deploy jjb jobs"

5 years agoMerge "Migrate README to RTD"
Andrew Grimberg [Mon, 4 Jun 2018 17:13:43 +0000 (17:13 +0000)]
Merge "Migrate README to RTD"

5 years agoMerge "REM security notice about PostBuildScript plugin"
Andrew Grimberg [Mon, 4 Jun 2018 17:06:17 +0000 (17:06 +0000)]
Merge "REM security notice about PostBuildScript plugin"

5 years agoAllow any project/branch to deploy jjb jobs 64/10964/2
Luis Gomez [Mon, 4 Jun 2018 16:20:34 +0000 (09:20 -0700)]
Allow any project/branch to deploy jjb jobs

This allows users to trigger the jjb-deploy job from any Gerrit
patch. It works in 2 different ways:

1. Triggered from ci-management patch
2. Triggered from non-ci-management patch

In case 1) it will deploy whatever is from the ci-management patch.

In case 2) it will instead deploy from HEAD of master in the
ci-management repo.

Change-Id: I414b053a68a105aa4cdc1ab99df9cd9962a080b9
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
5 years agoBump version to 0.21.0-dev 66/10966/1
Thanh Ha [Mon, 4 Jun 2018 16:52:02 +0000 (12:52 -0400)]
Bump version to 0.21.0-dev

Change-Id: Ib7069f20ec0238e723c8c9bedfad35f34cd7488c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoRelease global-jjb v0.20.0 33/10933/3 v0.20.0
Thanh Ha [Fri, 1 Jun 2018 17:18:42 +0000 (13:18 -0400)]
Release global-jjb v0.20.0

Change-Id: Ia24912694223d4e8df81f591829dfb4b4ed5ff22
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMigrate README to RTD 04/10904/11
Thanh Ha [Thu, 31 May 2018 01:02:57 +0000 (21:02 -0400)]
Migrate README to RTD

Migrate the contents of the README (legacy) into RTD so that we can
properly link to the data there through Sphinx.

Issue: RELENG-981
Change-Id: I22b21eddb008a6f0c98c3f1ac3d3543372b72752
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoRemove echo statement 61/10961/1
Thanh Ha [Sat, 2 Jun 2018 05:33:43 +0000 (01:33 -0400)]
Remove echo statement

Sphinx already prints 'The HTML pages are in docs/_build/html.' at the
end of a build. This is redundent and not cross platform compatible
(fails on Windows).

Change-Id: I6e4098aaaed492138d8056495c6db69d3799de1a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoMerge "Simplify conditional statement for ALT_NEXUS_REPO"
Anil Belur [Thu, 31 May 2018 23:42:42 +0000 (23:42 +0000)]
Merge "Simplify conditional statement for ALT_NEXUS_REPO"

5 years agoAdd *.groovy as a filetype trigger to ci-verify 35/10635/2
Zack Williams [Tue, 15 May 2018 03:38:48 +0000 (20:38 -0700)]
Add *.groovy as a filetype trigger to ci-verify

Add support for Jenkinsfile to trigger ci-verify jobs.

Change-Id: I36986889ecea9a72b238a886146bb5faa10c9672
Signed-off-by: Zack Williams <zdw@opennetworking.org>
5 years agoSimplify conditional statement for ALT_NEXUS_REPO 06/10906/1
Thanh Ha [Thu, 31 May 2018 15:47:20 +0000 (11:47 -0400)]
Simplify conditional statement for ALT_NEXUS_REPO

Change-Id: I72cecef2c52e1c1e2688437a18dfa02bc1b4c3e6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoREM security notice about PostBuildScript plugin 02/10902/3
Thanh Ha [Thu, 31 May 2018 00:22:50 +0000 (20:22 -0400)]
REM security notice about PostBuildScript plugin

This notice is no longer true and we support using the latest
2.x version of PostBuildScript.

Change-Id: I0cf9559f6bf86570465ab45d49943fb07b2afbe9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoFix echo when removing venv in jjb-cleanup.sh 17/10717/2
Trevor Bramwell [Thu, 17 May 2018 22:55:23 +0000 (15:55 -0700)]
Fix echo when removing venv in jjb-cleanup.sh

Missing 'echo' call causes this script to fail when it in truth
succeeds.

Change-Id: I95d798a34442fcf3ca172b3bdd43260db8a09f3c
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
5 years agoUse a temporary directory for jjb-installs 00/10700/2
Trevor Bramwell [Thu, 17 May 2018 19:01:40 +0000 (12:01 -0700)]
Use a temporary directory for jjb-installs

When jjb-verify and jjb-merge jobs get scheduled on the same static
node only one can run at a time. So when jjb-merge is running any
jjb-verify jobs triggered during that time fail.

Change-Id: I2ba93417614977741999151cd155a4a165b0229a
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
5 years agoSupport the .yml YAML File Suffix for CI Jobs 89/10689/1
Trevor Bramwell [Wed, 16 May 2018 23:35:42 +0000 (16:35 -0700)]
Support the .yml YAML File Suffix for CI Jobs

Change-Id: I410ba824c0d1d1fbeb763fe994a9a4a667b157e3
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
5 years agoMerge "Add docker clean macro"
Andrew Grimberg [Tue, 15 May 2018 14:42:37 +0000 (14:42 +0000)]
Merge "Add docker clean macro"

5 years agoPrevent unbound variable error on create-netrc.sh 32/10632/2
Jeremy Phelps [Mon, 14 May 2018 22:09:55 +0000 (17:09 -0500)]
Prevent unbound variable error on create-netrc.sh

Change-Id: I15498ccf8a16fb93d307408f515751ea98c0003b
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
5 years agoAdd lf-infra-parameters XC CLM 27/10627/2
Jessica Wagantall [Mon, 14 May 2018 20:50:58 +0000 (13:50 -0700)]
Add lf-infra-parameters XC CLM

Add lf-infra-parameters for branch and project
details. XC CLM job needs one extra parameter
(nexus-iq-cli-version) apart from the default
ones in lf_python_common.

Change-Id: I75b3f62c5469498d539db9e2c55ffc6d974e88dc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
5 years agoAdd docker clean macro 13/10613/1
Jeremy Phelps [Fri, 11 May 2018 20:18:06 +0000 (15:18 -0500)]
Add docker clean macro

This macro forcibly removes all docker images on build system.

Change-Id: I750e235b7de13338d816d2f963f0628b74ef0579
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
5 years agoAdd ALT_NEXUS_URL to create-netrc 06/10606/2
Jeremy Phelps [Fri, 11 May 2018 18:33:03 +0000 (13:33 -0500)]
Add ALT_NEXUS_URL to create-netrc

This change is backwards compatible with existing system configs but
lets the user spec this env var which will take precedence.  This is
useful, for example, to point at nexus3.edgexfoundry.org if you have
NEXUS_URL=nexus.edgexfoundry.org.

Change-Id: Ibbba26670ab374fd98e1bf20f78ffff7f8b7c52a
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
5 years agoUse --jobs-only option with jjb-deploy 43/10543/1
Anil Belur [Wed, 9 May 2018 01:35:58 +0000 (11:35 +1000)]
Use --jobs-only option with jjb-deploy

JJB 2.0.3 implementation allows views to be managed by
code. The default behaviour is to update the job along with
all the views in the repository. This takes a longer if
the project has many views managed by code.

Therefore, use the flag --jobs-only to updated
on a given job in sandbox.

Change-Id: Ifaaf60f3479e7485e1dbb5618c6cbcce31525278
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 years agoMerge "Remove maven_metadata_validate function"
Andrew Grimberg [Tue, 8 May 2018 23:17:37 +0000 (23:17 +0000)]
Merge "Remove maven_metadata_validate function"

5 years agoRelease global-jjb v0.19.2 36/10536/1 v0.19.2
Anil Belur [Tue, 8 May 2018 21:59:40 +0000 (07:59 +1000)]
Release global-jjb v0.19.2

Create a new tag with v0.19.2 which points to an object that changes
the version number.

Change-Id: I07282a819a14ce2edf37d71d2a0030dbcf2161d1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 years agoRelease global-jjb v0.19.1 11/10511/2
Anil Belur [Tue, 8 May 2018 12:20:04 +0000 (22:20 +1000)]
Release global-jjb v0.19.1

Change-Id: Ie69a77b11ff92a40157a9fa31d70f4a9bca7aa9d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 years agoBug Fix: Replace -type f with -xtype f 60/10460/2
Dimitrios Markou [Sat, 5 May 2018 12:33:48 +0000 (15:33 +0300)]
Bug Fix: Replace -type f with -xtype f

The -type f parameter cannot recognize symbolic link files
so the replacement with the -xtype f parameter solve this problem

https://jira.opendaylight.org/browse/INTPAK-162

Change-Id: I38aaf2ff3d655d44e757c863f83a0b2cb811ab41
Signed-off-by: Dimitrios Markou <mardim@intracom-telecom.com>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 years agoRelease global-jjb v0.19.0 21/10421/3 v0.19.0
Thanh Ha [Thu, 3 May 2018 22:14:48 +0000 (18:14 -0400)]
Release global-jjb v0.19.0

Change-Id: Ib0e5add67d0b645d55a7b39b6430f2c849c993ed
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoAdd support to log into docker.io 25/10425/9
Jeremy Phelps [Fri, 4 May 2018 00:41:39 +0000 (19:41 -0500)]
Add support to log into docker.io

This follows essentially the same pattern
as logging into the nexus docker registries.

Change-Id: I174c0f27d46d59ddae5abc0fda67a839095c2535
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
5 years agoMerge "Add override for GT file-paths in Python jobs"
Daniel Farrell [Thu, 3 May 2018 22:15:19 +0000 (22:15 +0000)]
Merge "Add override for GT file-paths in Python jobs"

5 years agoAdd override for GT file-paths in Python jobs 97/10397/2
Thanh Ha [Thu, 3 May 2018 15:48:04 +0000 (11:48 -0400)]
Add override for GT file-paths in Python jobs

Some projects may have small Python sub-projects within their
repos. This would allow them to only trigger builds when there
is a change in the relevant directory.

Change-Id: If54f43eb3f66d0c6b493495a82a65989fc7ed6c3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
5 years agoFix jenkins-cfg GitHub cfg to build head of branch 16/10416/1
Thanh Ha [Thu, 3 May 2018 20:45:00 +0000 (16:45 -0400)]
Fix jenkins-cfg GitHub cfg to build head of branch

There this job was originally misconfigured and was configured as if
it was a verify job. It should be operating instead as a merge job
and not be pulling in the $sha1 setting. This fixes the job to only
build HEAD of branch as one would expect.

Issue: RELENG-844
Change-Id: I8fa6b25a2fd4b598f619ab4c6ae80ce411756cb4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoRemove maven_metadata_validate function 94/10394/1
Thanh Ha [Thu, 3 May 2018 14:07:34 +0000 (10:07 -0400)]
Remove maven_metadata_validate function

This function was originally added to detect a bug with Maven 3.5.1
and earlier. At the time the OpenDaylight community was not yet ready
to migrate to 3.5.2 from 3.3.9 so we implemented this function as a
way to detect the metadata issues.

This function ended up causing some edge case issues and is not worth
maintaining. Remove the function and recommend all projects use Maven
3.5.2 as a minimum.

The specific issue in Maven was that sometimes the deploy phase would
generate an off by one timestamp mismatch between the metadata and the
filename of the artifacts. This causes invalid metadata and then
builds against affected artifacts fail.

Issue: RELENG-927
Change-Id: I65f4f6dc73382b91940620aba587f5fe56259eb1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
5 years agoConfigure tox tests allow serial execution 12/10212/8
Vanessa Rene Valderrama [Tue, 24 Apr 2018 19:58:26 +0000 (14:58 -0500)]
Configure tox tests allow serial execution

Configuring tox tests to allow serial or parallel execution configurable
within JJB by setting the PARALLEL parameter to true or false.

Issue: RELENG-912
Change-Id: If2edba598b47484b1708f1e0f3fb96f035511841
Signed-off-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
5 years agoAdd instructions on how to test script locally 69/9469/3
Thanh Ha [Fri, 16 Mar 2018 18:45:24 +0000 (14:45 -0400)]
Add instructions on how to test script locally

Useful for debugging the jenkins-cfg job if something is not working.

Change-Id: I6062b754fb01a8da60ac73472133aa2dfd4ae2fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrint out heading information 52/8652/2
Thanh Ha [Fri, 2 Feb 2018 18:25:07 +0000 (13:25 -0500)]
Print out heading information

Makes the output a bit more structured.

Change-Id: Ieedcbf97af01cec63604c2907d6f74177271a64d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSort packer macros alphabetically 65/9965/4
Thanh Ha [Fri, 13 Apr 2018 16:25:06 +0000 (12:25 -0400)]
Sort packer macros alphabetically

Change-Id: I382cd173ca7e08cb3d69af874e74b8ce8d92d65b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSimplify packer-parameters macro name to just lf 64/9964/4
Thanh Ha [Fri, 13 Apr 2018 16:21:58 +0000 (12:21 -0400)]
Simplify packer-parameters macro name to just lf

The lf namespace is lf, not need to set lf-infra everywhere.

(We should go through and reduce this for other instances in
the future).

Change-Id: I629f378e1973ad0f7051df1d8aa15c3bb62f676d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSet default packer variable in job-template 63/9963/4
Thanh Ha [Fri, 13 Apr 2018 16:19:30 +0000 (12:19 -0400)]
Set default packer variable in job-template

Also add documentation for the packer parameters macro.

Change-Id: Ib1532c508196ee3fabbac0137aeb0fd2e10904f4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSkip vote for jjb-deploy 04/10204/1
Thanh Ha [Tue, 24 Apr 2018 16:31:59 +0000 (12:31 -0400)]
Skip vote for jjb-deploy

This job should not be voting.

Issue: RELENG-918
Change-Id: Ia53fe0485e4187d85ecca4e6c48aacda6a997786
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add generic push changes to gerrit builder"
Andrew Grimberg [Mon, 23 Apr 2018 22:40:58 +0000 (22:40 +0000)]
Merge "Add generic push changes to gerrit builder"

6 years agoUpdate XC CLM job parameters 62/10162/11
Jessica Wagantall [Fri, 20 Apr 2018 01:03:02 +0000 (18:03 -0700)]
Update XC CLM job parameters

- Remove unused archive-artifacts log patterns
  - Many of these are Maven related and unused in Python.
- Adjust NEXUS_IQ_CLI_VERSION parameter name to unspecify
  CLI format.

Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221

Change-Id: I0dde9b18468d52574b969c1f83c93f8ff0950faa
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoAdd docs for Python XC CLM 60/10160/7
Jessica Wagantall [Fri, 20 Apr 2018 00:44:06 +0000 (17:44 -0700)]
Add docs for Python XC CLM

Add documentation for Python XC CLM:
- Description of the job
- Job templates
- Description of parameters

Changes made in response to the comments in
I5e5c420539ab3a3e5b292620da4418c16d557221

Change-Id: I19713d37aa38159f26e437c961b6d1b4fa6f77fc
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoMerge "Rename sonar-cli.sh to nexus-iq-cli.sh"
Thanh Ha [Mon, 23 Apr 2018 17:52:39 +0000 (17:52 +0000)]
Merge "Rename sonar-cli.sh to nexus-iq-cli.sh"

6 years agoAdd generic push changes to gerrit builder 78/9878/10
Anil Belur [Mon, 9 Apr 2018 09:22:15 +0000 (19:22 +1000)]
Add generic push changes to gerrit builder

This is a generic version of the script to push a change through
a job to Gerrit in an automated fashion. Projects can reuse this
macros when they have jobs which requires to  push a change to
gerrit.

RELENG-769
Change-Id: I4d269a4dad6ddbd509a134306b61b2214194b479
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoFail Sphinx build even on warnings 85/10185/1
Thanh Ha [Fri, 20 Apr 2018 18:47:16 +0000 (14:47 -0400)]
Fail Sphinx build even on warnings

Resolve warnings caused by the -W flag.

Change-Id: I0c771da88af487e3a6ddb55b01d524d5a274226d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoBump version to 0.19.0-dev 84/10184/1
Thanh Ha [Fri, 20 Apr 2018 18:46:52 +0000 (14:46 -0400)]
Bump version to 0.19.0-dev

Change-Id: I000964a1bd8a4d7a9ed09fb29b130258e63ba922
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.18.0 01/10101/3 v0.18.0
Thanh Ha [Wed, 18 Apr 2018 21:23:32 +0000 (17:23 -0400)]
Release global-jjb v0.18.0

Change-Id: I0538f3c15e6df43369ef5e7756a76236d52d0a9e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Update JJB version 2.0.5"
Thanh Ha [Fri, 20 Apr 2018 16:24:16 +0000 (16:24 +0000)]
Merge "Update JJB version 2.0.5"

6 years agoUpdate packer version to 1.2.2 71/10171/1
Anil Belur [Fri, 20 Apr 2018 14:19:56 +0000 (00:19 +1000)]
Update packer version to 1.2.2

Change-Id: I188bb7b14e5122afc25b64765d846c4d1298e8f6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>