releng/global-jjb.git
6 years agoUse eval so that $cmake_opts is properly parsed 28/12028/1
Thanh Ha [Sat, 28 Jul 2018 22:09:08 +0000 (18:09 -0400)]
Use eval so that $cmake_opts is properly parsed

Without eval bash inserts single quotes and breaks parameters passed
if they have quotes in the parameters. For example
`-D CMAKE_CXX_FLAGS="-fPIC -std=gnu++11"`

Issue: RELENG-1075
Change-Id: I77046a7edc0516f0ae28dd2b8cd2c8994ad5079e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Validate only template/platform that is built"
Andrew Grimberg [Thu, 26 Jul 2018 19:16:13 +0000 (19:16 +0000)]
Merge "Validate only template/platform that is built"

6 years agoValidate only template/platform that is built 00/12000/1
Thanh Ha [Thu, 26 Jul 2018 02:25:44 +0000 (22:25 -0400)]
Validate only template/platform that is built

No point validating every combination of template/platform in a
merge job that is only interested in building a single combo.

Change-Id: I0ad760b3247ac18aba79a9bca25d887e09b987fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix GitHub templates override lf-infra-properties 54/11954/2
Thanh Ha [Tue, 24 Jul 2018 17:03:56 +0000 (13:03 -0400)]
Fix GitHub templates override lf-infra-properties

When redefining any Jenkins section we must redefine everything
that is being overrided otherwise previous configuration will
be lost. This patch fixes the build-days-to-keep parameter that
is lost in the GitHub jobs due to the github property override.

Change-Id: I8a127344189215367c3546d0b3222d989ea74800
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd cmake-verify job template 40/11940/6
Thanh Ha [Tue, 24 Jul 2018 00:54:58 +0000 (20:54 -0400)]
Add cmake-verify job template

CMake verify job template for building CMake based projects.

Issue: RELENG-1074
Change-Id: Iccd3bab1d9f17071583a03e84b35bcd729161195
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add Node / NPM cache & metrics to .gitignore"
Andrew Grimberg [Thu, 19 Jul 2018 15:02:02 +0000 (15:02 +0000)]
Merge "Add Node / NPM cache & metrics to .gitignore"

6 years agoAdd Best Practice for Shell scripts 29/11829/1
Thanh Ha [Wed, 18 Jul 2018 00:51:56 +0000 (20:51 -0400)]
Add Best Practice for Shell scripts

Change-Id: Ia6370964e34af94eceb9797596a048a5df3aea2a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd Node / NPM cache & metrics to .gitignore 28/11828/1
Thanh Ha [Wed, 18 Jul 2018 00:43:30 +0000 (20:43 -0400)]
Add Node / NPM cache & metrics to .gitignore

Change-Id: I7eaff8749e45c1699da0000ba4f446c4f37d3df8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix global-vars fail to instantiate instance 02/11802/1 v0.22.1
Thanh Ha [Mon, 16 Jul 2018 20:31:54 +0000 (16:31 -0400)]
Fix global-vars fail to instantiate instance

Not sure why this is suddenly a problem. Jenkins was not upgraded
as far as I am aware but adding Jenkins. seems to resolve the
issue we suddenly started seeing.

Change-Id: I76b7e01c7f1d377e7c4b63d5adde1b4fc29c6933
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd global-jjb v0.22.0 release notes 78/11778/3 v0.22.0
Thanh Ha [Fri, 13 Jul 2018 16:28:48 +0000 (12:28 -0400)]
Add global-jjb v0.22.0 release notes

Change-Id: I763e15fc63482d51a2f6a7878641c5738b881e30
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "project-pattern configurable for license-check"
Jessica Wagantall [Fri, 13 Jul 2018 16:39:30 +0000 (16:39 +0000)]
Merge "project-pattern configurable for license-check"

6 years agoMerge "Remove Unused Jenkins-Admin Groovy Scripts"
Thanh Ha [Fri, 13 Jul 2018 16:35:51 +0000 (16:35 +0000)]
Merge "Remove Unused Jenkins-Admin Groovy Scripts"

6 years agoproject-pattern configurable for license-check 69/11769/2
Thanh Ha [Thu, 12 Jul 2018 22:47:03 +0000 (18:47 -0400)]
project-pattern configurable for license-check

Allow the project-pattern to be configurable for the license-check
job. In an ideal world we would have have a single job that will
enforce for all projects but initially we will need flexibility to
allow us to adjust as we enforce against existing projects.

Change-Id: Ibf83868bacf520c69ef729566207ce7cc7ecf57e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Support recheck and reverify in global-jjb"
Andrew Grimberg [Fri, 13 Jul 2018 15:30:47 +0000 (15:30 +0000)]
Merge "Support recheck and reverify in global-jjb"

6 years agoPull default USER_DATA_ID from cloud.cfg 75/11775/1
Thanh Ha [Fri, 13 Jul 2018 15:11:15 +0000 (11:11 -0400)]
Pull default USER_DATA_ID from cloud.cfg

Sets the default USER_DATA_ID for minion templates to be
what is defined in cloud.cfg. If cloud.cfg does not define
one then default to "jenkins-init-script".

RELENG-1069
Change-Id: I135c9a6c1d0ee11e627a66d1cc87e60eb7db1b20
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSigul install location has changed 74/11774/1
Andrew Grimberg [Fri, 13 Jul 2018 01:06:48 +0000 (18:06 -0700)]
Sigul install location has changed

The location to install sigul from has changed since initial testing was
done.

Change-Id: I911d748aa662d68bcc1e4ecc304b04268dc995d7
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoPull default KEY_PAIR_NAME from cloud.cfg 50/11750/1
Thanh Ha [Thu, 12 Jul 2018 17:38:03 +0000 (13:38 -0400)]
Pull default KEY_PAIR_NAME from cloud.cfg

Sets the default KEY_PAIR_NAME for minion templates to be
what is defined in cloud.cfg. If cloud.cfg does not define
one then default to "jenkins-ssh".

Issue: RELENG-1066
Change-Id: I72bddf861174139048e1843a3631b3998ac32bef
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd support for JNLP based minions 33/11733/3
Thanh Ha [Wed, 11 Jul 2018 18:14:59 +0000 (14:14 -0400)]
Add support for JNLP based minions

Issue: RELENG-939
Change-Id: I05a4fa92387425932bbc28cadadbb44acbc190bb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRevert "Print out OS Cloud Plugin version" 30/11730/1
Thanh Ha [Wed, 11 Jul 2018 16:59:26 +0000 (12:59 -0400)]
Revert "Print out OS Cloud Plugin version"

This reverts commit dfb2c6ca52a4c885e42d6c2252706bd824c75068.

Change-Id: If217ac6caf7b33c54e61d3a090c1062c666e63b9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSupport recheck and reverify in global-jjb 05/10705/6
Aric Gardner [Thu, 17 May 2018 20:05:51 +0000 (16:05 -0400)]
Support recheck and reverify in global-jjb

In OPNFV we are using reverify as a convention (we also support recheck)
This was previously deprecated in global-jjb
But I'm adding it back to not confuse our users

Change-Id: Ie794636e49f97ff2ac2735e81c407b57a3470f55
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
6 years agoMake toxworkdir configurable and default to /tmp/v 28/11728/1
Trevor Bramwell [Wed, 11 Jul 2018 16:01:45 +0000 (09:01 -0700)]
Make toxworkdir configurable and default to /tmp/v

By default tox environment will now be installed under /tmp/v/{envname},
but configurable through the CLI environment by specifying TOX_WORK_DIR.

This will allow users dynamically specify where the toxworkdir should
live, like so:

> TOX_WORK_DIR=$(mktemp -d -t gjjb-XXX) tox -e ...

Change-Id: I3daa4dc3538c61fb80a464a1b7e07d7b48fd7a1c
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoDocument support for os-cloud-plugin 2.37 20/11720/1
Thanh Ha [Tue, 10 Jul 2018 23:15:35 +0000 (19:15 -0400)]
Document support for os-cloud-plugin 2.37

Change-Id: I4ea15a75d6f98ac95bf352fe0b7ca386e6874723
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrint out OS Cloud Plugin version 03/11703/1
Thanh Ha [Mon, 9 Jul 2018 23:09:12 +0000 (19:09 -0400)]
Print out OS Cloud Plugin version

Change-Id: I974667afb03f5aa4a00c4098ce93ca96c4a388ec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix API breakage caused by OS Plugin version scan 01/11701/3
Thanh Ha [Mon, 9 Jul 2018 22:14:07 +0000 (18:14 -0400)]
Fix API breakage caused by OS Plugin version scan

Patch I3384c86c64c3aff7404ddec77aa85463e5fbac2a caused an unexpected
API change in get_minion_options which now requires a $silo
variable. However the change was not passed down to all instances
where the function was called causing breakage.

Change-Id: If4a0cec0232d1381413da3f6279f23bc426e1ace
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate build-timeout parameter documentation 99/11699/2
Trevor Bramwell [Mon, 9 Jul 2018 20:52:01 +0000 (13:52 -0700)]
Update build-timeout parameter documentation

All build-timeout documentation incorrectly lists seconds instead of
minutes, while the the license scanning jobs did not have build-timeout
documented, and the packer merge job had the wrong value listed.

Change-Id: I6e3f2b934bcda92fb14ab9cd996434ff83277408
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoDocument support for OS Cloud plugin 2.36 48/11548/1
Thanh Ha [Mon, 25 Jun 2018 20:36:17 +0000 (16:36 -0400)]
Document support for OS Cloud plugin 2.36

Change-Id: I662e1a479f10d9040eb75dd5a29c0c0b25d0dcf8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix empty variable when run in Jenkins 47/11547/1
Thanh Ha [Mon, 25 Jun 2018 16:37:58 +0000 (12:37 -0400)]
Fix empty  variable when run in Jenkins

Change-Id: Ic6e2b1424e8e59611e021c4a506ba556e8e2111e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge changes from topic '10422'
Andrew Grimberg [Sat, 23 Jun 2018 15:10:35 +0000 (15:10 +0000)]
Merge changes from topic '10422'

* changes:
  Enable ensure-documented check
  Document undocumented macros
  Document undocumented ci-jobs macros
  Document undocumented maven macros

6 years agoMerge "Document undocumented Python macros"
Andrew Grimberg [Sat, 23 Jun 2018 15:07:46 +0000 (15:07 +0000)]
Merge "Document undocumented Python macros"

6 years agoMerge "Add license check job using new lhc"
Andrew Grimberg [Sat, 23 Jun 2018 15:02:18 +0000 (15:02 +0000)]
Merge "Add license check job using new lhc"

6 years agoMerge "Add support for OS Plugin v2.35"
Andrew Grimberg [Sat, 23 Jun 2018 14:58:13 +0000 (14:58 +0000)]
Merge "Add support for OS Plugin v2.35"

6 years agoMerge "Use a more exact grep for fetching cfg options"
Andrew Grimberg [Sat, 23 Jun 2018 14:56:30 +0000 (14:56 +0000)]
Merge "Use a more exact grep for fetching cfg options"

6 years agoMerge "Global-JJB Jenkins scripts require recurse"
Thanh Ha [Sat, 23 Jun 2018 13:10:04 +0000 (13:10 +0000)]
Merge "Global-JJB Jenkins scripts require recurse"

6 years agoGlobal-JJB Jenkins scripts require recurse 37/11537/2
Andrew Grimberg [Sat, 23 Jun 2018 00:29:41 +0000 (17:29 -0700)]
Global-JJB Jenkins scripts require recurse

If a project is switching to using the global-jjb provided
jenkins-init-scripts then the clone that they need to do requires that
they do a submodule recurse clone.

Change-Id: I748205f58b016e27bdd1c95df6b67d47b16bb6aa
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoMerge "Support Windows Scripts in JJB and Packer Jobs"
Anil Belur [Sat, 23 Jun 2018 10:29:53 +0000 (10:29 +0000)]
Merge "Support Windows Scripts in JJB and Packer Jobs"

6 years agoMerge "Make version string optional."
Anil Belur [Fri, 22 Jun 2018 23:10:16 +0000 (23:10 +0000)]
Merge "Make version string optional."

6 years agoMerge "Remove extra parameter quotes"
Anil Belur [Fri, 22 Jun 2018 23:07:55 +0000 (23:07 +0000)]
Merge "Remove extra parameter quotes"

6 years agoSupport Windows Scripts in JJB and Packer Jobs 36/11536/1
Trevor Bramwell [Fri, 22 Jun 2018 22:18:11 +0000 (15:18 -0700)]
Support Windows Scripts in JJB and Packer Jobs

This change enables verification builds to be triggered for changes to
Powershell and Batch scripts in jenkins-job-builder repositories.

Change-Id: Ifb8ca3a59cce116b3a41cb143f080c5a4d488646
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoMake version string optional. 32/11532/3
Aric Gardner [Fri, 22 Jun 2018 20:23:00 +0000 (16:23 -0400)]
Make version string optional.

versions is not yet documented for INFO.yaml
We do not yet have version in OPNFV's INFO files.

Change-Id: I1aa2f4a323fe9296bf9bfdc3a1d9043e32d24b8f
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
6 years agoEnable ensure-documented check 22/10422/4
Thanh Ha [Thu, 3 May 2018 22:16:53 +0000 (18:16 -0400)]
Enable ensure-documented check

This script is a dumb script that checks that there is an equivalent
marking in docs/ for each yaml section. This patch also resolves a
bug in the script where it was not detecting all undocumented items.

Change-Id: Id33c8eae06e47256d53457eaa57c21cf7634ee19
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument undocumented macros 13/11413/3
Thanh Ha [Tue, 19 Jun 2018 17:22:26 +0000 (13:22 -0400)]
Document undocumented macros

Change-Id: I1726c5c122a2d4b73d17f62dc9f3458f1ab8d731
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument undocumented ci-jobs macros 11/11411/3
Thanh Ha [Tue, 19 Jun 2018 17:13:41 +0000 (13:13 -0400)]
Document undocumented ci-jobs macros

Change-Id: Iad4d692f393802716378dabc9770ba0f38967d92
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument undocumented Python macros 09/11409/3
Thanh Ha [Tue, 19 Jun 2018 16:51:35 +0000 (12:51 -0400)]
Document undocumented Python macros

Change-Id: I597822be7e47373efb407ca6ff3b0a788b784c76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument undocumented maven macros 10/11410/3
Thanh Ha [Tue, 19 Jun 2018 17:08:21 +0000 (13:08 -0400)]
Document undocumented maven macros

Change-Id: I1c052e377402080adca951e3f785ac795e08b124
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRvrt "Add pre-commit hook for trailing-whitespace" 15/11515/2 v0.21.2
Thanh Ha [Fri, 22 Jun 2018 13:50:13 +0000 (13:50 +0000)]
Rvrt "Add pre-commit hook for trailing-whitespace"

This reverts commit f325f0dc4d34cb79e9c15813140db1e18ed2a185.

Change-Id: Iaf8fbe8a9760670bd7dc94da89e1cac145be8fb4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix missing parameters in tox-verify job 13/11513/1
Thanh Ha [Fri, 22 Jun 2018 13:34:22 +0000 (09:34 -0400)]
Fix missing parameters in tox-verify job

Patch If2edba598b47484b1708f1e0f3fb96f035511841 broke parameters in
the tox-verify job by overriding all the existing parameters with
only the PARALLEL parameter. This patch fixes it by moving the
parallel parameter definition so that it is declared along with
the other parameters the job requires.

Issue: RELENG-1042
Change-Id: I6fdd8876235843101bc175ff91ed872aab88279d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd license check job using new lhc 07/6607/10
Thanh Ha [Thu, 28 Sep 2017 15:26:37 +0000 (11:26 -0400)]
Add license check job using new lhc

Create a job using
https://gerrit.linuxfoundation.org/infra/#/admin/projects/releng/license-checker
as the license checker tool for projects.

This job is meant to be managed by LFRE to ensure projects are
providing the appropriate license headers.

Change-Id: I5ca6da61dc6ee250a2c6d451b09a0075fb1ff0b0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd support for OS Plugin v2.35 05/11505/2
Thanh Ha [Thu, 21 Jun 2018 21:29:30 +0000 (17:29 -0400)]
Add support for OS Plugin v2.35

The SlaveOptions() API in OS Plugin v2.35 was changed to include a
new minimum instance cap configuration.

Issue: RELENG-1041
Change-Id: I3384c86c64c3aff7404ddec77aa85463e5fbac2a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse a more exact grep for fetching cfg options 04/11504/1
Thanh Ha [Thu, 21 Jun 2018 21:21:07 +0000 (17:21 -0400)]
Use a more exact grep for fetching cfg options

Use an exact grep command to fetch cfg options so that an
option containing the same characters in another option does
not get parsed accidently.

Change-Id: I40f3fd883ab5245da35b911aef3fe9edbda88fe2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd pre-commit hook for trailing-whitespace 77/11477/1
Thanh Ha [Thu, 21 Jun 2018 00:25:44 +0000 (20:25 -0400)]
Add pre-commit hook for trailing-whitespace

Install using tox:

    tox -e check-hooks

ref: https://pre-commit.com

Change-Id: Ie060a9d1c843ce3889df10535d0a87e41d4b4e76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoChange project to clone by jjb-deploy 73/11473/2 v0.21.1
Luis Gomez [Wed, 20 Jun 2018 21:11:04 +0000 (14:11 -0700)]
Change project to clone by jjb-deploy

When "jjb-deploy" is invoked from a gerrit patch, we do not
want to clone the patch project code ($GERRIT_PROJECT) but
the releng/builder code ($PROJECT).

Change-Id: I329b3c756826250358b20aeb2454cb5650d87f59
Signed-off-by: Luis Gomez <ecelgp@gmail.com>
6 years agoRemove extra parameter quotes 42/11442/1
Anil Belur [Wed, 20 Jun 2018 02:54:40 +0000 (12:54 +1000)]
Remove extra parameter quotes

The quotes should only be used in place where the macro
is called.

Change-Id: Ia76a113aa5cb2d07577d099be5585e4530bdeaf5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoRelease global-jjb v0.21.0 69/11369/1 v0.21.0
Thanh Ha [Sun, 17 Jun 2018 20:17:16 +0000 (16:17 -0400)]
Release global-jjb v0.21.0

Change-Id: Ia9cdcfe2112ee60499c6ba35f959dc1e169b8220
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRemove unnecessary github trigger macro 21/11321/4
Thanh Ha [Thu, 14 Jun 2018 22:30:00 +0000 (18:30 -0400)]
Remove unnecessary github trigger macro

This trigger macro was essentially redefining everything the trigger
directly supports. We might as well just call the trigger directly.

Change-Id: I1fc77b501678f213767a70c99119a56a418910fc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSet minimal packer version to 1.2.3 23/11323/4
Anil Belur [Fri, 15 Jun 2018 00:26:44 +0000 (10:26 +1000)]
Set minimal packer version to 1.2.3

Patch Ia195bd99d55f23b4f39acf590520637e54fc006a introduced
`instance_name` which requires a minimum Packer version of
1.2.3 in order to be used.

ref: https://github.com/hashicorp/packer/blob/v1.2.3/CHANGELOG.md

Change-Id: I6219855f8de35519f1ea07cc04385acf91bf90f1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoAdd INFO.yaml verify jobs 24/10924/31
Jessica Wagantall [Fri, 1 Jun 2018 03:02:38 +0000 (20:02 -0700)]
Add INFO.yaml verify jobs

Add '{project-name}-info-yaml-jobs' and
'{project-name}-github-info-yaml-jobs' to validate that
INFO.yaml file changes are kept isolated from other file
changes.

The addition of or changes to an INFO.yaml should be kept
on its own gerrit change and should not be combined with other
changes.

Issue: RELENG-973
Change-Id: Id7ddb55c34a741d92b1e126f1237fb9753a4aa75
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Co-Authored-By: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoMerge "Set docs version from git"
Thanh Ha [Thu, 14 Jun 2018 22:24:59 +0000 (22:24 +0000)]
Merge "Set docs version from git"

6 years agoMerge "Configurable Timed Trigger for Packer Merge Jobs"
Thanh Ha [Thu, 14 Jun 2018 22:11:14 +0000 (22:11 +0000)]
Merge "Configurable Timed Trigger for Packer Merge Jobs"

6 years agoConfigurable Timed Trigger for Packer Merge Jobs 59/11259/2
Trevor Bramwell [Thu, 26 Apr 2018 18:58:08 +0000 (11:58 -0700)]
Configurable Timed Trigger for Packer Merge Jobs

This change add the optional parameter 'cron' to packer builds so users
can configure when packer images can be rebuilt. It also switches the
timer from '00 10 1 * *' to '@monthly' to take advantage of Jenkins cron
hash system so the jobs are splayed over the month and don't all start
on the same minute.

Change-Id: I5bc29dab281d8ad1a4260994c1b1d6fb81b5a488
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoSet docs version from git 58/11158/5
Thanh Ha [Mon, 11 Jun 2018 02:46:03 +0000 (22:46 -0400)]
Set docs version from git

Removes the need to modify conf.py every time we release.

Change-Id: I010c5a4eaf2f2c88156db561218919aa470eaea0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Use include-regions to limit node build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:34 +0000 (21:00 +0000)]
Merge "Use include-regions to limit node build paths"

6 years agoMerge "Use include-regions to limit Py build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:29 +0000 (21:00 +0000)]
Merge "Use include-regions to limit Py build paths"

6 years agoMerge "Use include-regions to limit JenkinsCFG build path"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:26 +0000 (21:00 +0000)]
Merge "Use include-regions to limit JenkinsCFG build path"

6 years agoMerge "Use include-regions to limit packer build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:23 +0000 (21:00 +0000)]
Merge "Use include-regions to limit packer build paths"

6 years agoMerge "Use include-regions to limit JJB build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:20 +0000 (21:00 +0000)]
Merge "Use include-regions to limit JJB build paths"

6 years agoMerge "Use include-regions to limit MVN build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:15 +0000 (21:00 +0000)]
Merge "Use include-regions to limit MVN build paths"

6 years agoMerge "Use include-regions to limit RTD build paths"
Jeremy Phelps [Wed, 13 Jun 2018 21:00:02 +0000 (21:00 +0000)]
Merge "Use include-regions to limit RTD build paths"

6 years agoOnly create package diff if start and end exist 42/11242/1
Andrew Grimberg [Wed, 13 Jun 2018 18:22:15 +0000 (11:22 -0700)]
Only create package diff if start and end exist

Issue: RELENG-798
Change-Id: I01b513073b720c7fdabf1638684af9c27eda9f8a
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoMake package listing script smarter 22/11222/2
Andrew Grimberg [Wed, 13 Jun 2018 15:19:21 +0000 (08:19 -0700)]
Make package listing script smarter

We have extra knowledge of what should be created just by the
environment variables or files that exist. We should use that to
determine if we a diff file should be created.

Issue: RELENG-798
Change-Id: I7dd5baaa669d5e1cc84e94686c7ff6eee303cd6f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoUse include-regions to limit RTD build paths 89/11189/3
Thanh Ha [Tue, 12 Jun 2018 01:41:42 +0000 (21:41 -0400)]
Use include-regions to limit RTD build paths

Issue: RELENG-1022
Change-Id: I4e5ed50d399b49470a95937a2b17cade210b768c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-regions to limit MVN build paths 92/11192/1
Thanh Ha [Tue, 12 Jun 2018 02:22:39 +0000 (22:22 -0400)]
Use include-regions to limit MVN build paths

Also move trigger definitions to more specific template rather
than anchor.

Issue: RELENG-1022
Change-Id: I73162326251f6ef1e656e06d68062c4ec0d45992
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-regions to limit node build paths 91/11191/1
Thanh Ha [Tue, 12 Jun 2018 02:08:52 +0000 (22:08 -0400)]
Use include-regions to limit node build paths

Issue: RELENG-1022
Change-Id: I31faddc8f567127ed3d3fa648451c4150cc94c0a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-regions to limit Py build paths 90/11190/3
Thanh Ha [Tue, 12 Jun 2018 01:56:39 +0000 (21:56 -0400)]
Use include-regions to limit Py build paths

Limit python build paths for GitHub builds similar to what is already
happening with Gerrit versions of these jobs.

Also reorganize the code structure so that the common anchor does not
contain job specific config.

Issue: RELENG-1022
Change-Id: Ieb16ca14cfda425a3efdad0beb346839f6b4aa84
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-regions to limit JenkinsCFG build path 88/11188/2
Thanh Ha [Tue, 12 Jun 2018 01:32:08 +0000 (21:32 -0400)]
Use include-regions to limit JenkinsCFG build path

Issue: RELENG-1022
Change-Id: I0682fcdcc90e94b7f0f7752eea6fbff8125845a4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-regions to limit JJB build paths 85/11185/2
Thanh Ha [Tue, 12 Jun 2018 01:06:14 +0000 (21:06 -0400)]
Use include-regions to limit JJB build paths

Issue: RELENG-1022
Change-Id: I6c50a864ea85ac2ff41df1ab91a531b55468ed3f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-regions to limit packer build paths 84/11184/6
Thanh Ha [Mon, 11 Jun 2018 23:04:14 +0000 (19:04 -0400)]
Use include-regions to limit packer build paths

Issue: RELENG-1022
Change-Id: I283400e5ac2473e2eabb883c44a2a1e705b312ee
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd CSS and HTML to rtd build pattern 56/11156/1
Thanh Ha [Sun, 10 Jun 2018 04:38:30 +0000 (00:38 -0400)]
Add CSS and HTML to rtd build pattern

Ensure we build the docs when CSS / HTML is modified as well as docs
can contain those file types.

Change-Id: Idc779739d61dd3c3a10860298561b1f3d838ad85
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add package lists to job logs"
Thanh Ha [Sat, 9 Jun 2018 15:31:03 +0000 (15:31 +0000)]
Merge "Add package lists to job logs"

6 years agoAdd documentation for CFP files 37/10637/16
Trevor Bramwell [Tue, 15 May 2018 14:24:57 +0000 (07:24 -0700)]
Add documentation for CFP files

* jjbini
* jenkins-log-archives-settings
* packer-cloud-env

Change-Id: I316e4f1b93605029b5956fb1f5d1fd45b1d00c0d
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoAdd package lists to job logs 21/11121/3
Andrew Grimberg [Thu, 7 Jun 2018 21:35:02 +0000 (14:35 -0700)]
Add package lists to job logs

A listing of packages that are on the system is useful for debugging
changes that happen during a job run

Issue: RELENG-798
Change-Id: I88bc2eca175bbef1b7581b26199aff9a13f1910d
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoMerge "Document lf-infra-push-gerrit-patch macro in RTD"
Thanh Ha [Fri, 8 Jun 2018 03:58:39 +0000 (03:58 +0000)]
Merge "Document lf-infra-push-gerrit-patch macro in RTD"

6 years agoDocument lf-infra-push-gerrit-patch macro in RTD 43/11043/4
Anil Belur [Wed, 6 Jun 2018 03:28:47 +0000 (13:28 +1000)]
Document lf-infra-push-gerrit-patch macro in RTD

JIRA: RELENG-945
Change-Id: I709aec08a10bb6a55b1c84c71c32c303bc1fdce5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoMerge "Handle missing CREDENTIAL when creating .netrc"
Andrew Grimberg [Thu, 7 Jun 2018 15:13:14 +0000 (15:13 +0000)]
Merge "Handle missing CREDENTIAL when creating .netrc"

6 years agoMerge "DO NOT fail if global-vars-.sh is not configured"
Anil Belur [Thu, 7 Jun 2018 03:04:54 +0000 (03:04 +0000)]
Merge "DO NOT fail if global-vars-.sh is not configured"

6 years agoUpdate OpenStack plugin supported versions list 92/11092/1
Thanh Ha [Thu, 7 Jun 2018 02:36:30 +0000 (22:36 -0400)]
Update OpenStack plugin supported versions list

Confirmed that we work with 2.33 and 2.34 OpenStack plugin versions.

Change-Id: I3612cb242824e438b8bf0df576e951ed753ea8fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDO NOT fail if global-vars-.sh is not configured 91/11091/1
Thanh Ha [Thu, 7 Jun 2018 02:29:49 +0000 (22:29 -0400)]
DO NOT fail if global-vars-.sh is not configured

All configurations in jenkins-cfg job should be optional. If a project
does not configure a setting then skip it and continue.

Issue: RELENG-962
Change-Id: I386a6371ce3f1ff1b5cc024760f6d316d5008d63
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoHandle missing CREDENTIAL when creating .netrc 83/11083/1
Thanh Ha [Wed, 6 Jun 2018 20:57:55 +0000 (16:57 -0400)]
Handle missing CREDENTIAL when creating .netrc

Move the `set -eu -o pipefail` to after CREDENTIAL is set so that
we can properly error handle. Otherwise the script will exit too
soon.

Change-Id: I58edd3deb5b928a9ebaa4e00f6ed83d652e62d70
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDisable -x to prevent printing passwords 82/11082/1
Thanh Ha [Wed, 6 Jun 2018 20:54:06 +0000 (16:54 -0400)]
Disable -x to prevent printing passwords

Change-Id: I9b8254aa8d514ca8513f6c9c7872b4abf287cbd1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoClear log credential files with force (-f) 74/11074/1
Thanh Ha [Wed, 6 Jun 2018 20:27:01 +0000 (16:27 -0400)]
Clear log credential files with force (-f)

Prevents Jenkins from printing file not found if the files are
already cleaned up for whatever reason. Eg. If the project is not
shipping logs to a log server.

Change-Id: I7b2f614ded8defcbfe014b44febe210381206675
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd sha1 parameter for GitHub jobs 54/11054/2
Thanh Ha [Wed, 6 Jun 2018 16:47:34 +0000 (12:47 -0400)]
Add sha1 parameter for GitHub jobs

This allows us to override the sha1 parameter for GitHub verify
job in manual builds. Thus allowing us to manually trigger verify
jobs in Jenkins for GitHub based projects.

Also updates all the existing GERRIT_* descriptions to try to detail
the difference for GitHub PR Triggers vs. Gerrit Triggers.

Change-Id: Ia514955eb2f22f71668e3a3a0cc94bb124f2544a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoConsolidate keypair default names to jenkins-ssh 40/11040/3
Thanh Ha [Wed, 6 Jun 2018 01:39:01 +0000 (21:39 -0400)]
Consolidate keypair default names to jenkins-ssh

BREAKING-CHANGE: Minion SSH default KeyPair name is now jenkins-ssh
    Either override in cloud.cfg or rename the Credential in Jenkins.

This is an attempt to consolidate all our different instances
of the ssh-keypair name all over the place. By default we will
consolidate on `jenkins-ssh` as the default keypair name. This
can be overrided of course and applies to the following config
locations in Jenkins / CIMAN:

1. defaults.yaml's `jenkins-ssh-credential`
2. Jenkins > Credentials > ID > jenkins-ssh
3. jenkins-config/clouds controlling both local private key name
   and public key name inside the cloud which now need to match

On a new infra if we are not overriding any values all of these should
accept the default value of `jenkins-ssh`.

Change-Id: I9fe691bbb59d81a1e861261be33cbda00de7a061
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add labels for linking in configuration.rst"
Andrew Grimberg [Tue, 5 Jun 2018 18:35:22 +0000 (18:35 +0000)]
Merge "Add labels for linking in configuration.rst"

6 years agoAdd jenkins-init-scripts to global-jjb 88/10988/4
Thanh Ha [Tue, 5 Jun 2018 03:43:25 +0000 (23:43 -0400)]
Add jenkins-init-scripts to global-jjb

These are the minion initialization scripts that start running
when our cloud plugin spawns a new minion. They are responsible
for prepping the minion for Jenkins to take over and run the job.

Issue: RELENG-994
Change-Id: I68e242297db03752fcc415e5465e7bfa8ab66d79
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd labels for linking in configuration.rst 84/10984/1
Thanh Ha [Tue, 5 Jun 2018 01:35:35 +0000 (21:35 -0400)]
Add labels for linking in configuration.rst

Change-Id: Ieb17fcddb83f8c12d6331dadbcd6ee6581ea1588
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Setup tools in global-jjb tox.ini"
Andrew Grimberg [Mon, 4 Jun 2018 18:59:41 +0000 (18:59 +0000)]
Merge "Setup tools in global-jjb tox.ini"

6 years agoSetup tools in global-jjb tox.ini 27/10727/5
Thanh Ha [Tue, 8 May 2018 16:36:26 +0000 (12:36 -0400)]
Setup tools in global-jjb tox.ini

Use -q to hide tox output.

Creates a global tox.ini which can be used by projects to use common
PyPi tools. This replaces the need to "source /path/to/venv"
everywhere in our scripts to jump to different tools.
Instead we replace it with one of:

    tox -q -c jjb/global-jjb/tox.ini -e openstack -- {parameters}
    tox -q -c jjb/global-jjb/tox.ini -e openstack {parameters}

Non-CI management jobs can wget the tox.ini from global-jjb to pull
the configuration.

By default the version installed will be the latest patch version in
semvar. The version comparison operator can be overrided via the
*_VERSION_OP environment variable for each tool type. Install versions
are also overridable via the *_VERSION environment variable.

Ex:

    JJB_VERSION=2.0.6
    JJB_VERSION_OP=">="

https://www.python.org/dev/peps/pep-0440/#version-specifiers

Change-Id: I8b1a0936220ddbeb7f5e051ce15c421fec27c1a0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRedirect README documentation to RTD 14/10914/10
Thanh Ha [Thu, 31 May 2018 20:36:31 +0000 (16:36 -0400)]
Redirect README documentation to RTD

Change-Id: Ie125cb72acc518f2c74463b376e73d44d068971f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Allow any project/branch to deploy jjb jobs"
Andrew Grimberg [Mon, 4 Jun 2018 17:15:44 +0000 (17:15 +0000)]
Merge "Allow any project/branch to deploy jjb jobs"

6 years agoMerge "Migrate README to RTD"
Andrew Grimberg [Mon, 4 Jun 2018 17:13:43 +0000 (17:13 +0000)]
Merge "Migrate README to RTD"

6 years agoMerge "REM security notice about PostBuildScript plugin"
Andrew Grimberg [Mon, 4 Jun 2018 17:06:17 +0000 (17:06 +0000)]
Merge "REM security notice about PostBuildScript plugin"