releng/global-jjb.git
6 years agoBump packer build timeout to 90 minutes 90/8390/2
Thanh Ha [Sat, 13 Jan 2018 04:09:06 +0000 (23:09 -0500)]
Bump packer build timeout to 90 minutes

With all of the consolidation of packaging into the new baseline
scripts as well as known slowness in Vexxhost builds for baseline
are now taking around 60 minutes to run. Bump to 90 minutes so that
there is a buffer for us to continue developing baseline.

Change-Id: I195a74d902111c937bebf7c8e599a3d641e74a37
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd a check for missing vars/*.json 88/8388/3
Thanh Ha [Fri, 12 Jan 2018 21:18:03 +0000 (16:18 -0500)]
Add a check for missing vars/*.json

If a project does not have any then we should detect it and skip
trying to parse those files.

Change-Id: I9fd1fee88a68e745709779de9fec3f2013b7483f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate expected xml to JJB 2.0 format 89/8389/1
Thanh Ha [Fri, 12 Jan 2018 21:56:34 +0000 (16:56 -0500)]
Update expected xml to JJB 2.0 format

Change-Id: I73ac8158a85559ec8d09682b8192aecb7f78ba8b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Install git-review outside of loop"
Jamo Luhrsen [Fri, 12 Jan 2018 06:08:46 +0000 (06:08 +0000)]
Merge "Install git-review outside of loop"

6 years agoFix detox logs not being archived 79/8379/6
Thanh Ha [Fri, 12 Jan 2018 02:23:45 +0000 (21:23 -0500)]
Fix detox logs not being archived

Since we immediately fail on any shell errors we miss log
collection at the end of the build. Fix detox part of script to
allow the log collection code to run.

Change-Id: I50bcd337224adcecbf028f08b56cfebe2e10a3d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAllow tox-install to handle base python ver 80/8380/3
Thanh Ha [Fri, 12 Jan 2018 03:26:39 +0000 (22:26 -0500)]
Allow tox-install to handle base python ver

Turns tox-install.sh into a proper macro allowing the user to choose
which base Python version to use in the tox virtualenv.

Issue: RT-50802
Change-Id: Iff578f4cfa39ce6b2540be45537931e6a3b48d22
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoEnable pyenv if available in image 70/8370/2
Thanh Ha [Thu, 11 Jan 2018 23:27:16 +0000 (18:27 -0500)]
Enable pyenv if available in image

We need pyenv so that tox can pull in Python versions provided by
the pyenv setup.

Issue: RT-50802
Change-Id: I406f28e10e2d701f5f8fd396fea10d81bffd61a8
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoInstall tox-pyenv 65/8365/3
Thanh Ha [Thu, 11 Jan 2018 20:21:21 +0000 (15:21 -0500)]
Install tox-pyenv

Need tox-pyenv so that tox can automatically pick up pyenv
installations.

Issue: RT-50802
Change-Id: I601f8d7a21cab0a215947ff1d882c6666be0cf65
Co-authored-by: Vanessa Rene Valderrama <vvalderrama@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoInstall git-review outside of loop 51/8351/2
Thanh Ha [Wed, 10 Jan 2018 22:39:23 +0000 (17:39 -0500)]
Install git-review outside of loop

Mistakenly put the virtualenv bits inside of a loop. Minor
issue and code still works without this patch but should move
it as best practice.

Change-Id: I047ec5f67daea10ef71bc151a2999f6a2235e44f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd Gerrit trigger to clm job 66/8366/8
Jessica Wagantall [Thu, 11 Jan 2018 20:25:34 +0000 (12:25 -0800)]
Add Gerrit trigger to clm job

Add Gerrit trigger on comment "run-clm" for Gerrit and Github
clm jobs.

Change-Id: I220bc93e147d278fab09420cabf7c14feb874b97
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoMerge "Add script to print all creds in Jenkins"
Thanh Ha [Wed, 10 Jan 2018 22:29:45 +0000 (22:29 +0000)]
Merge "Add script to print all creds in Jenkins"

6 years agoAdd script to print all creds in Jenkins 42/8342/3
Jessica Wagantall [Wed, 10 Jan 2018 20:22:25 +0000 (12:22 -0800)]
Add script to print all creds in Jenkins

Add groovy script to run in the script console
that will display all credentials registered in Jenkins in
an Id : Password format.

Change-Id: I81d74a72a1bb5558c7230a6da7a5de055de809c9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoBump version to v0.15.0-dev 49/8349/1
Thanh Ha [Wed, 10 Jan 2018 21:41:57 +0000 (16:41 -0500)]
Bump version to v0.15.0-dev

Change-Id: I0fff3b7dd581d1a5cd50382c551d0f9681211ce2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.14.1 48/8348/1 v0.14.1
Thanh Ha [Wed, 10 Jan 2018 21:31:08 +0000 (16:31 -0500)]
Release global-jjb v0.14.1

Change-Id: Ice69cad332a65f91db0d558130f6ae2d51767a57
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDon't try to pushd into dir that doesn't exist 47/8347/3
Daniel Farrell [Wed, 10 Jan 2018 20:58:27 +0000 (15:58 -0500)]
Don't try to pushd into dir that doesn't exist

Just download packer into WORKSPACE vs bothering with a tmp packer dir.

Change-Id: Id97f3ae4635dc7a685a0d1e58effd24ee312c703
Signed-off-by: Daniel Farrell <dfarrell@redhat.com>
6 years agoRelease global-jjb v0.14.0 44/8344/1 v0.14.0
Thanh Ha [Wed, 10 Jan 2018 20:46:11 +0000 (15:46 -0500)]
Release global-jjb v0.14.0

Change-Id: Ic0a55eba3dac5759af7d8f276f30af8690d4e30f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate remote gerrit to use GERRIT_URL 35/8335/3
Thanh Ha [Wed, 10 Jan 2018 18:40:39 +0000 (13:40 -0500)]
Update remote gerrit to use GERRIT_URL

Because GIT_BASE and GIT_URL now point to a git mirror
that is not a Gerrit system we need to set it up with
GERRIT_URL anonymous http.

Change-Id: I8f4eccf89dc14d7c27d353b00a7595fdcded70b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Use detox to run tox in parallel"
Andrew Grimberg [Wed, 10 Jan 2018 18:40:13 +0000 (18:40 +0000)]
Merge "Use detox to run tox in parallel"

6 years agoUpdate merge job to work with common-packer 14/8314/4
Thanh Ha [Tue, 9 Jan 2018 18:01:59 +0000 (13:01 -0500)]
Update merge job to work with common-packer

This patch requires that projects upgrading to the next global-jjb
release to now require common-packer.

Change-Id: I4d85452801e4eff78f33b86afba4c7d23dd3d678
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate packer file_path triggers 11/8311/4
Thanh Ha [Tue, 9 Jan 2018 17:49:21 +0000 (12:49 -0500)]
Update packer file_path triggers

Changes to migrate our scripts to ansible now requires us to update
these filepath triggers.

Issue: RELENG-288
Change-Id: I82e457aa2453c6446e30ddb9c567ecd8ad71878c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoImprove packer-validate debugging output 05/8305/5
Anil Belur [Tue, 9 Jan 2018 09:21:14 +0000 (19:21 +1000)]
Improve packer-validate debugging output

This patch achieves 3 tasks:

1. Improves the debugging output provided by printing out the
   details about which vars and templates files are being tested.
2. Fixes an issue where packer was not actually testing every
   combination of varfile and template file due to cloud-env.json.
3. Includes common-packer vars files if available (should silently
   ignore if it does not exist).

Issue: RELENG-744
Change-Id: Id6e1f2423a378cbe376ccefe2568c22669fb7859
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse detox to run tox in parallel 03/8203/3
Thanh Ha [Thu, 4 Jan 2018 02:10:02 +0000 (21:10 -0500)]
Use detox to run tox in parallel

Rather than hacking something together with parallel use a tool
supported by the tox project called detox.

Change-Id: I04fc3a083c420f71938b99f942b682093822ddda
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix ShellCheck v0.4.7 lint issues 21/8321/5
Anil Belur [Tue, 9 Jan 2018 23:37:00 +0000 (09:37 +1000)]
Fix ShellCheck v0.4.7 lint issues

v0.4.7 introduces some new rules which now need to be handled.

Change-Id: If87fceb79e384e26f021a9c85a2e9d7413ce421e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoMerge "Base sigul macros and scripts"
Andrew Grimberg [Tue, 9 Jan 2018 14:44:07 +0000 (14:44 +0000)]
Merge "Base sigul macros and scripts"

6 years agoMerge "Allow SONAR_MAVEN_GOAL to be configurable"
Andrew Grimberg [Wed, 3 Jan 2018 16:22:37 +0000 (16:22 +0000)]
Merge "Allow SONAR_MAVEN_GOAL to be configurable"

6 years agoBump version to v0.14.0-dev 78/8178/1
Thanh Ha [Thu, 28 Dec 2017 17:48:51 +0000 (12:48 -0500)]
Bump version to v0.14.0-dev

Change-Id: Idbda87687afcfc631e409a4e53d2e6045c1bddf9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.13.1 77/8177/1 v0.13.1
Thanh Ha [Thu, 28 Dec 2017 17:41:41 +0000 (12:41 -0500)]
Release global-jjb v0.13.1

Change-Id: Ib1b5dbcf8d941c70c4aadc36f936701ea0e7953b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrioritize MAVEN_PARAMS to override OPTIONS 76/8176/2
Thanh Ha [Thu, 28 Dec 2017 17:21:27 +0000 (12:21 -0500)]
Prioritize MAVEN_PARAMS to override OPTIONS

MAVEN_PARAMS (user defined) can override MAVEN_OPTIONS (gjjb defined)
but only if it comes last on the CLI. Re-shuffle the variables so that
the desired prioritization can take affect.

RT 50181
Change-Id: Ib79cf11625e9b2d1f279b721f3a90a31e04020dc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAllow SONAR_MAVEN_GOAL to be configurable 72/8172/5
Thanh Ha [Thu, 28 Dec 2017 01:48:36 +0000 (20:48 -0500)]
Allow SONAR_MAVEN_GOAL to be configurable

Per reports on the mailing list Sonar jobs are broken in OpenDaylight.
This is because Sonar release a new plugin which only works with newer
versions of Sonar so until we can upgrade we need to allow flexibility
to configure the Sonar job to override the default sonar:sonar goal.

With this patch it is now possible to override the Sonar goal in JJB
and force an older version of the Sonar plugin to run using a JJB
defaults config or projects variable like this:

  sonar-mvn-goal: org.codehaus.mojo:sonar-maven-plugin:3.3.0.603:sonar

Unfortunately due to the defaults priority of JJB since we are
defining the sonar-mvn-goal parameter inside of the job template it
can only be overrided via a project section.

Reports:
https://lists.opendaylight.org/pipermail/release/2017-December/013119.html
https://lists.opendaylight.org/pipermail/release/2017-December/013223.html

Change-Id: I04512613f39e7c328e0f2f18d9c4729667e86909
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Make sysstat script more readable"
Thanh Ha [Wed, 27 Dec 2017 22:15:41 +0000 (22:15 +0000)]
Merge "Make sysstat script more readable"

7 years agoMake sysstat script more readable 61/8061/1
Anil Belur [Tue, 19 Dec 2017 09:35:12 +0000 (19:35 +1000)]
Make sysstat script more readable

Change-Id: I10415a461d57ad8c0e7f95b4bfea5327a6b14e72
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoUpdate packer version to 1.1.3 18/8018/2
Anil Belur [Fri, 15 Dec 2017 15:51:54 +0000 (01:51 +1000)]
Update packer version to 1.1.3

Change-Id: I7c0b4255d9b06ffd8833146be68982099768676c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoBump CLM job timeout to 30 00/8000/2
Thanh Ha [Wed, 13 Dec 2017 22:24:53 +0000 (17:24 -0500)]
Bump CLM job timeout to 30

Noticed today that many OpenDaylight CLM jobs are failing the
CLM 15 minute timeout. With the move to Vex where we have less
cores in our builds too bumping the timeout to 30 to account for
longer build times.

Change-Id: I69e2d32d10a04584bb2d66fab73583b70a3fc066
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to v0.14.0-dev 20/7920/1
Thanh Ha [Mon, 11 Dec 2017 18:14:22 +0000 (13:14 -0500)]
Bump version to v0.14.0-dev

Change-Id: I39d13bf084223b38f2da70158651f14a7ae13e59
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.13.0 19/7919/2 v0.13.0
Thanh Ha [Mon, 11 Dec 2017 18:10:32 +0000 (13:10 -0500)]
Release global-jjb v0.13.0

Also fix previous release notes titles.

Change-Id: I967131a7f89c56d132a6d8eae0411c1d6cf2b003
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMigrate Maven Merge job to global-jjb 68/6968/17
Thanh Ha [Sun, 15 Oct 2017 20:44:08 +0000 (16:44 -0400)]
Migrate Maven Merge job to global-jjb

Provide a Maven Merge job that is generically reusable by other
projects. This new job uses cURL to upload artifacts to Nexus and uses
`wget -r` to mirror existing maven-metadata.xml files in order to update
them when pushing SNAPSHOTs.

This job uses the following strategy to deploy jobs to Nexus:

1. `wget -r` to fetch maven-metadata.xml from Nexus
2. `mvn deploy -DaltDeploymentRepository` to prepare files for upload
3. Removes untouched maven-metadata.xml files before upload
4. Use lftools (cURL) upload script to push artifacts to Nexus

Issue: RELENG-61
Change-Id: I7663731d0eb750e4ccc1b07bcf5ad39c6135900c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBase sigul macros and scripts 56/6556/6
Andrew Grimberg [Fri, 22 Sep 2017 14:23:19 +0000 (07:23 -0700)]
Base sigul macros and scripts

Before any jobs can be created using sigul we need to have some basic
scaffolding for setting up the sigul enviroment.

Changes to lftools to extend the signing command to leverage sigul will
then allow us to create a meta macro which combines this scaffolding
into a single cohesive macro.

Change-Id: I080c1eb7271a2a64559b2c2f7b1011be1e9a8b16
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoFix branch on verify and merge jobs 28/7528/2
Jeremy Phelps [Wed, 15 Nov 2017 00:39:57 +0000 (18:39 -0600)]
Fix branch on verify and merge jobs

This fixes the branch parameter
on verify and merge jobs to be
refs/heads/{branch} and $sha1
respectively.

Change-Id: I230e04fda467848c5e764c90bf9190416b72dac4
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoFix branch variable in github scm 13/7513/2
Jeremy Phelps [Tue, 14 Nov 2017 20:44:21 +0000 (14:44 -0600)]
Fix branch variable in github scm

The branch variable should not be
concatenated with refs/heads.
GHPRB makes use of variables to
put here.

Change-Id: I54c6f3f51b734b894abb090d4473683a3e34fa06
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoBump to v0.13.0-dev 09/7509/1
Andrew Grimberg [Tue, 14 Nov 2017 19:01:34 +0000 (11:01 -0800)]
Bump to v0.13.0-dev

Change-Id: I92a54cc34ad23a666f90aa76e1168a87235a686c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoRelease global-jjb v0.12.0 08/7508/1 v0.12.0
Andrew Grimberg [Tue, 14 Nov 2017 18:50:36 +0000 (10:50 -0800)]
Release global-jjb v0.12.0

Change-Id: I706b80fcdc695d3fb2b25984d65d352ba688b559
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoMerge "Add npm config script"
Andrew Grimberg [Tue, 14 Nov 2017 18:41:24 +0000 (18:41 +0000)]
Merge "Add npm config script"

7 years agoAdd branches parameter to github scm macro 04/7504/4
Jeremy Phelps [Tue, 14 Nov 2017 16:11:03 +0000 (10:11 -0600)]
Add branches parameter to github scm macro

Make sure that the github scm macro accepts
branches as a configuration option like the
gerrit version of the macro.

Change-Id: Ife15943fa3fc094e20981f804f7036133d881f46
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoEnable maven jobs to archive artifacts 92/7492/1
Anil Belur [Mon, 13 Nov 2017 02:02:52 +0000 (12:02 +1000)]
Enable maven jobs to archive artifacts

Projects which use the maven jobs in global-jjb may
require to archive additional logs such as surefire
reports. This needs to be handled by globstar patterns
passed through the projects using these templates.

Change-Id: I97dc8801a0fb05cccf75f32ad7ad621cb6e974bf
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAdd npm config script 67/7367/5
Jeremy Phelps [Mon, 6 Nov 2017 20:20:55 +0000 (14:20 -0600)]
Add npm config script

Change-Id: I12a9af7f6926660143e40b2382b44e7af606ff00
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Move jjb-version to templates"
Jeremy Phelps [Tue, 7 Nov 2017 20:24:44 +0000 (20:24 +0000)]
Merge "Move jjb-version to templates"

7 years agoMerge "Add install goal to javadoc job"
Jeremy Phelps [Tue, 7 Nov 2017 17:46:35 +0000 (17:46 +0000)]
Merge "Add install goal to javadoc job"

7 years agoMove jjb-version to templates 74/7274/1
Thanh Ha [Fri, 3 Nov 2017 18:13:07 +0000 (14:13 -0400)]
Move jjb-version to templates

It appears that `job-group` definitions take priority over `project`
definitions. Move it to the template so that we can override the
parameter correctly.

Change-Id: I2b824e3cc89667698db8ebfdd3ce43f551e961d7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add npmrc config file to lf-infra-wrappers"
Jeremy Phelps [Fri, 3 Nov 2017 15:26:06 +0000 (15:26 +0000)]
Merge "Add npmrc config file to lf-infra-wrappers"

7 years agoAdd npmrc config file to lf-infra-wrappers 57/6957/11
Jeremy Phelps [Wed, 18 Oct 2017 17:55:14 +0000 (12:55 -0500)]
Add npmrc config file to lf-infra-wrappers

Change-Id: I2bafb9a9787f6820243e1ee19861fb8fc45670d7
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Add note on JJB defaults"
Anil Shashikumar Belur [Fri, 3 Nov 2017 14:52:53 +0000 (14:52 +0000)]
Merge "Add note on JJB defaults"

7 years agoAdd install goal to javadoc job 44/7244/4
Thanh Ha [Thu, 2 Nov 2017 14:36:59 +0000 (10:36 -0400)]
Add install goal to javadoc job

It turns out javadoc needs to have the artifacts available to them in
order to run javadoc:aggregate. In some cases this means artifacts
installed to the local maven repo. This patch adds the install goal as
well as ensuring we continue to skip tests, checkstyle, and findbugs to
keep the jobs running quick.

Change-Id: I3ffa36b207a1412e0489d6c20a91ffcd3ac93c27
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump to v0.12.0-dev 55/7155/1
Thanh Ha [Mon, 30 Oct 2017 16:30:17 +0000 (12:30 -0400)]
Bump to v0.12.0-dev

Change-Id: I5eaaa3d84e66a0216225c9b4a16baedf4393d461
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.11.0 54/7154/3 v0.11.0
Thanh Ha [Mon, 30 Oct 2017 16:10:54 +0000 (12:10 -0400)]
Release global-jjb v0.11.0

Change-Id: Ieaf88baf73a8a1563164879555d25732303ebf8d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoCat the failed tox-envs 53/7153/3
Thanh Ha [Mon, 30 Oct 2017 15:50:18 +0000 (11:50 -0400)]
Cat the failed tox-envs

Before failing the build we should print the problematic tox
environments into the console to make it easier for folks to
troubleshoot. We are still archiving the individual tox runs but the
console logs will now also contain the errors.

Issue: RELENG-611
Change-Id: Ie6fd132c0de69e8448d320d23daaed811a0d47a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd note on JJB defaults 78/7078/7
Thanh Ha [Wed, 25 Oct 2017 23:52:19 +0000 (09:52 +1000)]
Add note on JJB defaults

This patch provides additional clarification on how defaults are used in
JJB and when to expect the prioritization of variable expansion with
JJB.

Additionally add in intersphinx linking to jjb so that we can link
directly to JJB upstream documentation.

This documentation is based on details provided by Thanh Ha on the
OpenDaylight dev mailing list.

https://lists.opendaylight.org/pipermail/dev/2017-October/004184.html

Issue: RELENG-591
Change-Id: I65aaf933b88519dfbd1daaf8e00661146bc8c38f
Co-Authored-By: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd linting for RST files 34/7134/2
Thanh Ha [Fri, 27 Oct 2017 17:44:33 +0000 (13:44 -0400)]
Add linting for RST files

We should be linting our reStructuredText documentation as well.

Change-Id: Iff5c8f142a8dbc58550cc749c2742094bf13954d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix WriteGood lint errors 33/7133/1
Thanh Ha [Fri, 27 Oct 2017 18:42:48 +0000 (14:42 -0400)]
Fix WriteGood lint errors

Change-Id: I5e8331c42fa1dcfefac62f03d3e1f57eb8713c16
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPin nodeenv version to 1.1.2 32/7132/1
Thanh Ha [Fri, 27 Oct 2017 17:49:25 +0000 (13:49 -0400)]
Pin nodeenv version to 1.1.2

This fixes an issue where you cannot run tox -e coala more than once.

Change-Id: Ied59caddfea7fe237007d987310f0ce35cd71ef4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake javadoc-verify jobs run concurrently 11/7111/3
Thanh Ha [Fri, 27 Oct 2017 16:10:18 +0000 (12:10 -0400)]
Make javadoc-verify jobs run concurrently

We forgot to enable concurrency for the javadoc-verify job when we
created it. This patch fixes that.

Issue: RELENG-607
Change-Id: I622939f418ff254b6714eb28d296199cf86d9589
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Remove port from NEXUS_URL for netrc"
Thanh Ha [Mon, 23 Oct 2017 15:57:07 +0000 (15:57 +0000)]
Merge "Remove port from NEXUS_URL for netrc"

7 years agoMerge "Let NEXUSPROXY override NEXUS_URL if both are set"
Thanh Ha [Mon, 23 Oct 2017 15:55:34 +0000 (15:55 +0000)]
Merge "Let NEXUSPROXY override NEXUS_URL if both are set"

7 years agoRemove port from NEXUS_URL for netrc 29/7029/2
Trevor Bramwell [Wed, 18 Oct 2017 17:42:17 +0000 (10:42 -0700)]
Remove port from NEXUS_URL for netrc

If the NEXUS_URL or NEXUSPROXY contains a port, curl commands
will fail with 401 Unauthorized errors.

Change-Id: I611a7d88f35426b950f12534fba7e9e26618198d
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
7 years agoLet NEXUSPROXY override NEXUS_URL if both are set 30/7030/1
Trevor Bramwell [Mon, 23 Oct 2017 03:12:02 +0000 (20:12 -0700)]
Let NEXUSPROXY override NEXUS_URL if both are set

NEXUS_URL will never be overridden by NEXUSPROXY when creating a netrc,
or deploy logs, unless NEXUS_URL is not explicitly set.

Change-Id: I0f22775d29f4c8cc577df70cc016a1db0ac578f1
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
7 years agoMerge "Revert refspec change breaking submodule build"
Thanh Ha [Fri, 20 Oct 2017 20:44:01 +0000 (20:44 +0000)]
Merge "Revert refspec change breaking submodule build"

7 years agoMerge "Migrate Global JJB docs to RST"
Thanh Ha [Fri, 20 Oct 2017 20:43:32 +0000 (20:43 +0000)]
Merge "Migrate Global JJB docs to RST"

7 years agoUpdate packer version to 1.1.1 88/6988/1
Anil Belur [Fri, 20 Oct 2017 06:45:18 +0000 (16:45 +1000)]
Update packer version to 1.1.1

Change-Id: I95607aad0739700323fc36566e89ddf193dba576
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoRevert refspec change breaking submodule build 78/6978/1
Thanh Ha [Thu, 19 Oct 2017 14:02:22 +0000 (10:02 -0400)]
Revert refspec change breaking submodule build

Reverts change I65ef5886af59ec85841734f03bfac781194f780a which
introduced a breaking change for submodule projects inside a docs
project. Docs builds have a separate script which handles fetching
patches from Gerrit so should not be setting the refspec in the SCM
plugin.

Change-Id: I657a473a274b2831ad1470bb4895a2c8bcf3c92f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
(cherry picked from commit 85ebe3be68d3cc20f990e1f4adfd254b08f8c1f8)

7 years agoAdd M2_HOME to Maven parameters 75/6975/1
Thanh Ha [Thu, 19 Oct 2017 12:28:15 +0000 (08:28 -0400)]
Add M2_HOME to Maven parameters

Change-Id: I8557dbc46e742fbc5eeafecd3e23b060ceb200f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
(cherry picked from commit b00fefb9ade05788816a1b802644fc68614cdc64)

7 years agoMigrate Global JJB docs to RST 96/6896/6
Thanh Ha [Sun, 15 Oct 2017 20:44:08 +0000 (16:44 -0400)]
Migrate Global JJB docs to RST

This moves Global JJB documentation into RST docs and adds a
new checker which parses YAML files for items that are missing
documentation to ensure that every new template addition comes with
supporting documentation.

Tried to update documentation where it made sense too but we should
probably go back later and review all the items to make sure they are
all sufficiently documented. Especially macros which in many places are
lacking in required parameter documentation.

Change-Id: I6551e14f934a904378771262d1491cb5b3df5854
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd note to release notes v0.9.0 34/6934/1
Jessica Wagantall [Tue, 17 Oct 2017 18:25:03 +0000 (11:25 -0700)]
Add note to release notes v0.9.0

A new commit (74befe2) in global-jjb v0.9.0 introduced
the usage of crudini package. Add a note in the
release notes to make sure this package is installed.

Change-Id: If14c8f15d749cd95db3c5708aa897ec4a5f4b0e9
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
7 years agoIgnore binary files when grepping 12/6912/2
Thanh Ha [Mon, 16 Oct 2017 18:16:08 +0000 (14:16 -0400)]
Ignore binary files when grepping

Change-Id: I798bda2e55036c3b4aab1cde2a07aca9d2191431
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Convert packer file-paths cfg to {obj:var}"
Andrew Grimberg [Mon, 16 Oct 2017 17:40:41 +0000 (17:40 +0000)]
Merge "Convert packer file-paths cfg to {obj:var}"

7 years agoUpdate RTD Gerrit job to check GERRIT_* variables 09/6909/4
Thanh Ha [Mon, 16 Oct 2017 17:14:07 +0000 (13:14 -0400)]
Update RTD Gerrit job to check GERRIT_* variables

This allows the job to handle branch '*' more easily..

Change-Id: I65ef5886af59ec85841734f03bfac781194f780a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Fix jjb-verify job to ignore the docs directory"
Andrew Grimberg [Mon, 16 Oct 2017 16:57:24 +0000 (16:57 +0000)]
Merge "Fix jjb-verify job to ignore the docs directory"

7 years agoFix jjb-verify job to ignore the docs directory 06/6906/2
Thanh Ha [Mon, 16 Oct 2017 16:31:01 +0000 (12:31 -0400)]
Fix jjb-verify job to ignore the docs directory

The non-ascii checker should not check the docs directory as that
directory does not contain jjb code.

Change-Id: I3ec988a308c67346f4ebe6cdd6e933a2f4637f5b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to v0.11.0-dev 03/6903/1
Thanh Ha [Mon, 16 Oct 2017 15:54:32 +0000 (11:54 -0400)]
Bump version to v0.11.0-dev

Change-Id: I6ea1d089e82fcbdc287751783344942651e7b495
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.10.0 85/6885/5 v0.10.0
Thanh Ha [Sun, 15 Oct 2017 18:15:26 +0000 (14:15 -0400)]
Release global-jjb v0.10.0

Change-Id: If8918550d84c703a6704b0e955e0a430bcb74250
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoMerge "Add Maven job to build dependencies with patches"
Thanh Ha [Mon, 16 Oct 2017 15:31:33 +0000 (15:31 +0000)]
Merge "Add Maven job to build dependencies with patches"

7 years agoConvert packer file-paths cfg to {obj:var} 99/6899/2
Thanh Ha [Mon, 16 Oct 2017 02:56:06 +0000 (22:56 -0400)]
Convert packer file-paths cfg to {obj:var}

This is a standard we are using in most jobs so let's follow it with the
CI jobs as well. Looks like the packer jobs were already documented for
this but never actually implemented the feature.

The merge job unfortunately cannot be converted to the format due to
it's use of {platform} and {template} variables unless we want to make
it use the same file-paths as the verify job is now using.

Change-Id: Ie2976506e109f0e90ae26b4b6e4492d6b112b73a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Migrate node-verify job to global-jjb"
Thanh Ha [Mon, 16 Oct 2017 02:05:02 +0000 (02:05 +0000)]
Merge "Migrate node-verify job to global-jjb"

7 years agoAdd missing documentation to rtd jobs 93/6893/4
Thanh Ha [Sun, 15 Oct 2017 19:03:02 +0000 (15:03 -0400)]
Add missing documentation to rtd jobs

Change-Id: I1e0f97f3824aef4c18c4975931b388a41686e8bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing documentation for Python jobs 92/6892/4
Thanh Ha [Sun, 15 Oct 2017 19:00:27 +0000 (15:00 -0400)]
Add missing documentation for Python jobs

Change-Id: I985f14b50187b70d5d12872318c68acfcca5378b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing stream documentation to maven docs 91/6891/2
Thanh Ha [Sun, 15 Oct 2017 18:57:29 +0000 (14:57 -0400)]
Add missing stream documentation to maven docs

Change-Id: I653707b9384c7b4170a53f738500bcecf72a8423
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRemove doc for unused parameter 90/6890/2
Thanh Ha [Sun, 15 Oct 2017 18:55:46 +0000 (14:55 -0400)]
Remove doc for unused parameter

Change-Id: If2d6d5ee2b6c7f6e221ff3499f3060cb018772f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing documentation from maven jobs 88/6888/1
Thanh Ha [Sun, 15 Oct 2017 18:49:33 +0000 (14:49 -0400)]
Add missing documentation from maven jobs

Change-Id: I71b7774c01e8e7ddb0ac8768d9ec7b0e7714ddc7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoStandardize gerrit_[merge|verify]_triggers 87/6887/1
Thanh Ha [Sun, 15 Oct 2017 18:40:43 +0000 (14:40 -0400)]
Standardize gerrit_[merge|verify]_triggers

It turns out you can override per job definition inside of a projects
declaration so let's standardize the trigger wording so that they are
the same everywhere.

Change-Id: Id489a3b04242183a35d56bb938c66b4b486a1d1f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake staging-profile-id optional 86/6886/1
Thanh Ha [Sun, 15 Oct 2017 18:36:09 +0000 (14:36 -0400)]
Make staging-profile-id optional

Only the release job needs staging-profile-id so set a default of empty
for all other Maven templates.

Change-Id: Id53073377af415a0345f2aeef6637c5bb4a9d559
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoSleep between 1 - 10 seconds for tox 82/6882/2
Thanh Ha [Sat, 14 Oct 2017 19:52:03 +0000 (15:52 -0400)]
Sleep between 1 - 10 seconds for tox

Adds a random 1 - 10 second sleep to workaround parallel tox runs using
the same sdist directory to build a package and failing due to tripping
over itself.

Change-Id: I5054c839dabc3fac3cc814c08bc6568f99485d0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMigrate node-verify job to global-jjb 81/6681/6
Anil Belur [Tue, 3 Oct 2017 21:10:52 +0000 (07:10 +1000)]
Migrate node-verify job to global-jjb

Add a NodeJS verify job which uses nodeenv (Python project) to install
NodeJS and then runs `npm install` & `npm test`.

Issue: RELENG-241
Change-Id: Ia120cf804e530ab7d940b96d48ba6524fcf51f0f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Maven job to build dependencies with patches 41/6841/5
Thanh Ha [Fri, 13 Oct 2017 03:34:15 +0000 (23:34 -0400)]
Add Maven job to build dependencies with patches

Provide a Maven job that can verify a patch including firstly building
projects it depends on with their patches first. This allows projects to
validate a patch that has upstream project dependencies which need to be
merged first.

Requires a new global variable to be defined in Jenkins GERRIT_URL
containing the base path to the Gerrit Web UI.

Issue: RELENG-526
Change-Id: Ie9ccb88c21ab5674d0156566da1daee4aa43d641
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump Sphinx minimal dependencies to latest 76/6876/1
Thanh Ha [Sat, 14 Oct 2017 15:05:38 +0000 (11:05 -0400)]
Bump Sphinx minimal dependencies to latest

Change-Id: I5c032ea889b7a17be9614516e3e51a2963b068c6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd LF Logo 73/6873/1
Thanh Ha [Sat, 14 Oct 2017 14:59:35 +0000 (10:59 -0400)]
Add LF Logo

Change-Id: Ia82ca35196630689f67f8b1b6fb5f2091a6e5c6d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd custom navbar ala OpenDaylight docs 70/6870/1
Thanh Ha [Sat, 14 Oct 2017 14:50:06 +0000 (10:50 -0400)]
Add custom navbar ala OpenDaylight docs

Change-Id: I2af32b6847a6dd1242efd6b9c320a22eff0d8d76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix packer verify file path triggering 60/6860/2
Andrew Grimberg [Fri, 13 Oct 2017 20:38:21 +0000 (13:38 -0700)]
Fix packer verify file path triggering

Packer verifies are not properly triggering because the generated ANT
paths are non-resolvable

Change-Id: I3938ca653ab0fba7190ea8caf3715bf7757be4f7
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoFix cross link 52/6852/1
Thanh Ha [Fri, 13 Oct 2017 17:29:33 +0000 (13:29 -0400)]
Fix cross link

Change-Id: I4eaefa4f8e0e64299a98f8bd1519831704be5fcb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMove best practices to global-jjb 51/6851/2
Thanh Ha [Fri, 13 Oct 2017 17:45:35 +0000 (13:45 -0400)]
Move best practices to global-jjb

Change-Id: I0fb2743438658f775fd321cd27422ceee017be78
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBootstrap global-jjb docs 50/6850/3
Thanh Ha [Fri, 13 Oct 2017 17:29:33 +0000 (13:29 -0400)]
Bootstrap global-jjb docs

Just initialize the docs. Content to come in the next patch.

Change-Id: I2d85ee37e2fca3039b12438220401e6f24e69dbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd more required Jenkins plugins 44/6844/1
Andrew Grimberg [Fri, 13 Oct 2017 14:58:43 +0000 (07:58 -0700)]
Add more required Jenkins plugins

* Git plugin is required by all Jenkins systems using global-jjb

* Create new Gerrit and GitHub sections which details plugins that are
required for a Jenkins that services requests from that SCM service

Change-Id: If0f3f3a5bfd313aa15da96fd2247c9b1fe1b7c6a
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agostaging-profile-id unnecessary for javadoc jobs 40/6840/1
Thanh Ha [Fri, 13 Oct 2017 01:37:58 +0000 (21:37 -0400)]
staging-profile-id unnecessary for javadoc jobs

This parameter is not used at all in javadoc jobs so set to a blank
default so that projects do not have to define this if they want to use
the javadoc jobs.

Change-Id: If97fff08c72d32798cd724d84c29b9cdafe11c0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>