releng/global-jjb.git
7 years agoIgnore binary files when grepping 13/6913/2
Thanh Ha [Mon, 16 Oct 2017 18:16:08 +0000 (14:16 -0400)]
Ignore binary files when grepping

Change-Id: I798bda2e55036c3b4aab1cde2a07aca9d2191431
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.10.1 08/6908/2 v0.10.1
Thanh Ha [Mon, 16 Oct 2017 16:58:09 +0000 (12:58 -0400)]
Release global-jjb v0.10.1

Change-Id: I8f0977e80de289a899312d7759c71f38fd68c30d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUpdate RTD Gerrit job to check GERRIT_* variables 10/6910/2
Thanh Ha [Mon, 16 Oct 2017 17:14:07 +0000 (13:14 -0400)]
Update RTD Gerrit job to check GERRIT_* variables

This allows the job to handle branch '*' more easily..

Change-Id: I65ef5886af59ec85841734f03bfac781194f780a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix jjb-verify job to ignore the docs directory 07/6907/1
Thanh Ha [Mon, 16 Oct 2017 16:31:01 +0000 (12:31 -0400)]
Fix jjb-verify job to ignore the docs directory

The non-ascii checker should not check the docs directory as that
directory does not contain jjb code.

Change-Id: I3ec988a308c67346f4ebe6cdd6e933a2f4637f5b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.10.0 85/6885/5 v0.10.0
Thanh Ha [Sun, 15 Oct 2017 18:15:26 +0000 (14:15 -0400)]
Release global-jjb v0.10.0

Change-Id: If8918550d84c703a6704b0e955e0a430bcb74250
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoMerge "Add Maven job to build dependencies with patches"
Thanh Ha [Mon, 16 Oct 2017 15:31:33 +0000 (15:31 +0000)]
Merge "Add Maven job to build dependencies with patches"

7 years agoMerge "Migrate node-verify job to global-jjb"
Thanh Ha [Mon, 16 Oct 2017 02:05:02 +0000 (02:05 +0000)]
Merge "Migrate node-verify job to global-jjb"

7 years agoAdd missing documentation to rtd jobs 93/6893/4
Thanh Ha [Sun, 15 Oct 2017 19:03:02 +0000 (15:03 -0400)]
Add missing documentation to rtd jobs

Change-Id: I1e0f97f3824aef4c18c4975931b388a41686e8bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing documentation for Python jobs 92/6892/4
Thanh Ha [Sun, 15 Oct 2017 19:00:27 +0000 (15:00 -0400)]
Add missing documentation for Python jobs

Change-Id: I985f14b50187b70d5d12872318c68acfcca5378b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing stream documentation to maven docs 91/6891/2
Thanh Ha [Sun, 15 Oct 2017 18:57:29 +0000 (14:57 -0400)]
Add missing stream documentation to maven docs

Change-Id: I653707b9384c7b4170a53f738500bcecf72a8423
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRemove doc for unused parameter 90/6890/2
Thanh Ha [Sun, 15 Oct 2017 18:55:46 +0000 (14:55 -0400)]
Remove doc for unused parameter

Change-Id: If2d6d5ee2b6c7f6e221ff3499f3060cb018772f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing documentation from maven jobs 88/6888/1
Thanh Ha [Sun, 15 Oct 2017 18:49:33 +0000 (14:49 -0400)]
Add missing documentation from maven jobs

Change-Id: I71b7774c01e8e7ddb0ac8768d9ec7b0e7714ddc7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoStandardize gerrit_[merge|verify]_triggers 87/6887/1
Thanh Ha [Sun, 15 Oct 2017 18:40:43 +0000 (14:40 -0400)]
Standardize gerrit_[merge|verify]_triggers

It turns out you can override per job definition inside of a projects
declaration so let's standardize the trigger wording so that they are
the same everywhere.

Change-Id: Id489a3b04242183a35d56bb938c66b4b486a1d1f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake staging-profile-id optional 86/6886/1
Thanh Ha [Sun, 15 Oct 2017 18:36:09 +0000 (14:36 -0400)]
Make staging-profile-id optional

Only the release job needs staging-profile-id so set a default of empty
for all other Maven templates.

Change-Id: Id53073377af415a0345f2aeef6637c5bb4a9d559
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoSleep between 1 - 10 seconds for tox 82/6882/2
Thanh Ha [Sat, 14 Oct 2017 19:52:03 +0000 (15:52 -0400)]
Sleep between 1 - 10 seconds for tox

Adds a random 1 - 10 second sleep to workaround parallel tox runs using
the same sdist directory to build a package and failing due to tripping
over itself.

Change-Id: I5054c839dabc3fac3cc814c08bc6568f99485d0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMigrate node-verify job to global-jjb 81/6681/6
Anil Belur [Tue, 3 Oct 2017 21:10:52 +0000 (07:10 +1000)]
Migrate node-verify job to global-jjb

Add a NodeJS verify job which uses nodeenv (Python project) to install
NodeJS and then runs `npm install` & `npm test`.

Issue: RELENG-241
Change-Id: Ia120cf804e530ab7d940b96d48ba6524fcf51f0f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Maven job to build dependencies with patches 41/6841/5
Thanh Ha [Fri, 13 Oct 2017 03:34:15 +0000 (23:34 -0400)]
Add Maven job to build dependencies with patches

Provide a Maven job that can verify a patch including firstly building
projects it depends on with their patches first. This allows projects to
validate a patch that has upstream project dependencies which need to be
merged first.

Requires a new global variable to be defined in Jenkins GERRIT_URL
containing the base path to the Gerrit Web UI.

Issue: RELENG-526
Change-Id: Ie9ccb88c21ab5674d0156566da1daee4aa43d641
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump Sphinx minimal dependencies to latest 76/6876/1
Thanh Ha [Sat, 14 Oct 2017 15:05:38 +0000 (11:05 -0400)]
Bump Sphinx minimal dependencies to latest

Change-Id: I5c032ea889b7a17be9614516e3e51a2963b068c6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd LF Logo 73/6873/1
Thanh Ha [Sat, 14 Oct 2017 14:59:35 +0000 (10:59 -0400)]
Add LF Logo

Change-Id: Ia82ca35196630689f67f8b1b6fb5f2091a6e5c6d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd custom navbar ala OpenDaylight docs 70/6870/1
Thanh Ha [Sat, 14 Oct 2017 14:50:06 +0000 (10:50 -0400)]
Add custom navbar ala OpenDaylight docs

Change-Id: I2af32b6847a6dd1242efd6b9c320a22eff0d8d76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix packer verify file path triggering 60/6860/2
Andrew Grimberg [Fri, 13 Oct 2017 20:38:21 +0000 (13:38 -0700)]
Fix packer verify file path triggering

Packer verifies are not properly triggering because the generated ANT
paths are non-resolvable

Change-Id: I3938ca653ab0fba7190ea8caf3715bf7757be4f7
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoFix cross link 52/6852/1
Thanh Ha [Fri, 13 Oct 2017 17:29:33 +0000 (13:29 -0400)]
Fix cross link

Change-Id: I4eaefa4f8e0e64299a98f8bd1519831704be5fcb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMove best practices to global-jjb 51/6851/2
Thanh Ha [Fri, 13 Oct 2017 17:45:35 +0000 (13:45 -0400)]
Move best practices to global-jjb

Change-Id: I0fb2743438658f775fd321cd27422ceee017be78
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBootstrap global-jjb docs 50/6850/3
Thanh Ha [Fri, 13 Oct 2017 17:29:33 +0000 (13:29 -0400)]
Bootstrap global-jjb docs

Just initialize the docs. Content to come in the next patch.

Change-Id: I2d85ee37e2fca3039b12438220401e6f24e69dbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd more required Jenkins plugins 44/6844/1
Andrew Grimberg [Fri, 13 Oct 2017 14:58:43 +0000 (07:58 -0700)]
Add more required Jenkins plugins

* Git plugin is required by all Jenkins systems using global-jjb

* Create new Gerrit and GitHub sections which details plugins that are
required for a Jenkins that services requests from that SCM service

Change-Id: If0f3f3a5bfd313aa15da96fd2247c9b1fe1b7c6a
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agostaging-profile-id unnecessary for javadoc jobs 40/6840/1
Thanh Ha [Fri, 13 Oct 2017 01:37:58 +0000 (21:37 -0400)]
staging-profile-id unnecessary for javadoc jobs

This parameter is not used at all in javadoc jobs so set to a blank
default so that projects do not have to define this if they want to use
the javadoc jobs.

Change-Id: If97fff08c72d32798cd724d84c29b9cdafe11c0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUpdate required plugins list 33/6833/1
Andrew Grimberg [Thu, 12 Oct 2017 21:45:17 +0000 (14:45 -0700)]
Update required plugins list

The Environment Injector Plugin is a required plugin for log shipping
purposes.

Change-Id: I71551c59291e4db69a5b9dc92a351f9449e9af13
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoDo not trigger on drafts before Publish 16/6716/5
Vratko Polak [Fri, 6 Oct 2017 15:51:12 +0000 (17:51 +0200)]
Do not trigger on drafts before Publish

This way, uploading drafts will tie less resources.
Contributors can still recheck drafts manually
if they want them verified before hitting the Publish button.

Change-Id: Ifeddbb2fcde7d56b768ca8d31bcc3eeb1050ff1d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
7 years agoFix unescaped * in if-statement 61/6661/2 v0.9.1
Thanh Ha [Mon, 2 Oct 2017 21:34:58 +0000 (17:34 -0400)]
Fix unescaped * in if-statement

Change-Id: I8e45a1adc13f4da0e7386371678f6364670f5c38
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease global-jjb v0.9.0 33/6633/2 v0.9.0
Thanh Ha [Fri, 29 Sep 2017 17:04:46 +0000 (13:04 -0400)]
Release global-jjb v0.9.0

Change-Id: If902162ff4a18828a23ab3dfedf05a70c7acdd79
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "DO NOT hardcode mvn staging server id"
Jeremy Phelps [Fri, 29 Sep 2017 12:29:42 +0000 (12:29 +0000)]
Merge "DO NOT hardcode mvn staging server id"

7 years agoMerge "Add maven-javadoc jobs"
Jeremy Phelps [Fri, 29 Sep 2017 12:29:37 +0000 (12:29 +0000)]
Merge "Add maven-javadoc jobs"

7 years agoAdd timed parameter to lf-maven-release anchor 08/6608/4
Jeremy Phelps [Thu, 28 Sep 2017 19:22:43 +0000 (14:22 -0500)]
Add timed parameter to lf-maven-release anchor

Timed parameter is to specify a cron schedule
for the job to run.

Change-Id: Ic08983b4ceed2f05896471fa50797e0351e191f8
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoDO NOT hardcode mvn staging server id 05/6605/1
Thanh Ha [Thu, 28 Sep 2017 17:34:36 +0000 (13:34 -0400)]
DO NOT hardcode mvn staging server id

This needs to be configured in defaults.yaml to get the right one.

Change-Id: I8d54118999eb912c3074c4bb2f9b5237bea93ebe
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd maven-javadoc jobs 76/6576/4
Thanh Ha [Wed, 27 Sep 2017 18:31:23 +0000 (14:31 -0400)]
Add maven-javadoc jobs

Create jobs that run javadoc:aggregate to generate javadocs and publish
them to Nexus via the javadoc repo.

Issue: RELENG-482
Change-Id: I07f62abfdd3a63b48838d2421dacfc876c9a007c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Run tox envs separately and capture logs"
Jeremy Phelps [Thu, 28 Sep 2017 16:33:12 +0000 (16:33 +0000)]
Merge "Run tox envs separately and capture logs"

7 years agoMerge "RTD Merge job GTriggers should be overridable"
Andrew Grimberg [Thu, 28 Sep 2017 16:23:33 +0000 (16:23 +0000)]
Merge "RTD Merge job GTriggers should be overridable"

7 years agoRun tox envs separately and capture logs 60/6160/7
Thanh Ha [Fri, 25 Aug 2017 17:54:33 +0000 (13:54 -0400)]
Run tox envs separately and capture logs

Run the tox envlist as separate tox runs so that we can capture the logs
in separate files for easier troubleshooting.

This patch requires the vm to have the 'crudini' package installed.

Change-Id: I05e01668af6b84c38c10b24353a2157bfa8d5b23
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoDocs needs to be built from the $WORKSPACE 39/6539/4
Thanh Ha [Tue, 19 Sep 2017 17:59:34 +0000 (13:59 -0400)]
Docs needs to be built from the $WORKSPACE

Otherwise it will build from the submodule because of the if-statement
above. This breaks the job in cases where a project has submodules.

Change-Id: I06d6291d3329da142ecdbebfb4ac1a866108ef0b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRTD Merge job GTriggers should be overridable 37/6537/1
Thanh Ha [Sun, 17 Sep 2017 04:32:10 +0000 (00:32 -0400)]
RTD Merge job GTriggers should be overridable

Change-Id: I2193129790709c2232ebcd283e25cca8efb978e3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix RTD Verify job Gerrit Triggers 29/6529/4
Thanh Ha [Sun, 17 Sep 2017 04:32:10 +0000 (00:32 -0400)]
Fix RTD Verify job Gerrit Triggers

The verify job was incorrectly setup as a merge job trigger causing
RTD builds to not trigger as expected.

Change-Id: I2502eff209deb7b077e64c620c77d4ecbfbc9a8e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix bug that removed custom docker registry 61/6461/1
Jeremy Phelps [Mon, 11 Sep 2017 22:32:14 +0000 (17:32 -0500)]
Fix bug that removed custom docker registry

Inadvertently removed the custom docker
param in an ealier bug fix that was not related.

Change-Id: Ie4f3673be8f636ee1200ed6c308a42a05078ae51
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoAdd job to deploy to sandbox 19/6419/8
Thanh Ha [Fri, 8 Sep 2017 01:40:56 +0000 (21:40 -0400)]
Add job to deploy to sandbox

This job allows a contributor to leave a comment for example
'jjb-deploy builder-jjb-*' to deploy a job (or several jobs if wildcards
are used) to the Jenkins Sandbox.

This allows jjb contributors to no longer have to install jjb on their
local systems in order to push the job to the Jenkins Sandbox.

ATTN: GitHub version of the job is untested and likely does NOT work as
      currently designed.

Issue: RELENG-373
Change-Id: I4f26c640804a0b7db1a0087cbd805b9263821326
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd trigger for launching release job via comment 55/6355/2
Thanh Ha [Wed, 6 Sep 2017 23:23:28 +0000 (19:23 -0400)]
Add trigger for launching release job via comment

Allows the release job to be triggered via Gerrit / GitHub PR comment.
This allows contributors to initiate a release build without needing
permissions via Jenkins directly.

Issue: RELENG-426
Change-Id: I2c75f607cc57471afb49fa0347bb130af214ea4b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Create job to lock|unlock branches via Gerrit"
Andrew Grimberg [Thu, 7 Sep 2017 14:07:09 +0000 (14:07 +0000)]
Merge "Create job to lock|unlock branches via Gerrit"

7 years agoMerge "Allow project-pattern to be overridable" v0.8.2
Jeremy Phelps [Thu, 7 Sep 2017 00:20:08 +0000 (00:20 +0000)]
Merge "Allow project-pattern to be overridable"

7 years agoRemove rtd-project incorrectly labelled required 65/6365/1
Thanh Ha [Wed, 6 Sep 2017 23:56:29 +0000 (19:56 -0400)]
Remove rtd-project incorrectly labelled required

rtd-project is not a required parameter for the rtd-verify job. In fact
it's not used at all in the job.

Change-Id: Iea9ba7a6101c130e77d60cfb6536c9be7f12d5b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAllow project-pattern to be overridable 64/6364/2
Thanh Ha [Wed, 6 Sep 2017 23:49:27 +0000 (19:49 -0400)]
Allow project-pattern to be overridable

While the ** pattern is good for global docs projects like the
OpenDaylight docs project. If projects have their own standalone
documentation such as lftools we need to be able to set project-pattern
to the exact project. This ensures that Gerrit won't start a lftools
build when a trigger happens on any other project in the Gerrit system.

Change-Id: I46c7d0d45eb7ea82230437648ff23e81baab07f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoCreate job to lock|unlock branches via Gerrit 45/6245/6
Thanh Ha [Wed, 30 Aug 2017 21:56:55 +0000 (17:56 -0400)]
Create job to lock|unlock branches via Gerrit

A contributor can leave a comment "lock|unlock branch" in Gerrit comment
which triggers a job to submit a patch to Gerrit for the project to lock
or unlock their branch.

Locking refers to removing the permission to click the Submit button in
the project's branch effectively disallowing new patches to be merged
into the repo. This job simply generates and submits a patch. A project
committer still needs to approve it.

Issue: RELENG-424
Change-Id: Id489d931037c76bdcad032ec44b0ce748bdffe81
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Fix docker-login to conditionally use -e" v0.8.1
Andrew Grimberg [Tue, 5 Sep 2017 18:51:47 +0000 (18:51 +0000)]
Merge "Fix docker-login to conditionally use -e"

7 years agoFix docker-login to conditionally use -e 18/6318/1
Jeremy Phelps [Tue, 5 Sep 2017 18:37:57 +0000 (13:37 -0500)]
Fix docker-login to conditionally use -e

The -e/--email flag was removed in docker version
17.06.0.  Do not use if equal or less than that version.

Change-Id: I69335d8ff068fbb180de284317d02f21b8b7e552
JIRA: RELENG-452
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoRelease global-jjb v0.8.0 13/6313/2 v0.8.0
Thanh Ha [Tue, 5 Sep 2017 16:01:03 +0000 (12:01 -0400)]
Release global-jjb v0.8.0

Change-Id: Ife11163e99194bd9b43efee47f9601e3adbc5710
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoGeneralize odl rtd jobs for global-jjb 43/5643/51
Jeremy Phelps [Wed, 26 Jul 2017 21:25:05 +0000 (16:25 -0500)]
Generalize odl rtd jobs for global-jjb

Change-Id: I35bdd1629c4f1079131048a8a8f41f09949796ff
JIRA: RELENG-240
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add update-expected-xml call"
Anil Shashikumar Belur [Fri, 1 Sep 2017 04:10:24 +0000 (04:10 +0000)]
Merge "Add update-expected-xml call"

7 years agoMerge "Add lf-pip-install macro to handle pypi packages"
Anil Shashikumar Belur [Fri, 1 Sep 2017 04:08:48 +0000 (04:08 +0000)]
Merge "Add lf-pip-install macro to handle pypi packages"

7 years agoAdd update-expected-xml call 70/6270/1
Thanh Ha [Thu, 31 Aug 2017 21:43:32 +0000 (17:43 -0400)]
Add update-expected-xml call

Simplify the process of updating the expected-xml by adding a command to
tox.

Change-Id: I02a9f07272baab3fd0dd4407cdb0afb3ffd6e3c7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRe-order maven jobs alphabetically 46/6246/1
Thanh Ha [Thu, 31 Aug 2017 02:54:52 +0000 (22:54 -0400)]
Re-order maven jobs alphabetically

Change-Id: Ibc3d91e21d59614fc8e0ed3402e43b986a185759
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd lf-pip-install macro to handle pypi packages 44/6244/1
Thanh Ha [Wed, 30 Aug 2017 23:08:53 +0000 (19:08 -0400)]
Add lf-pip-install macro to handle pypi packages

This creates a generically reusable pip-install macro that can be used
to install pypi packages into a virtualenv. The script uses the first
package name from {pip-packages} as the name of the virtualenv it
creates.

Change-Id: Iabe4005efcb0a79af48d3c83d854f4e101414737
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Fix tox-run.sh print statement"
Andrew Grimberg [Tue, 29 Aug 2017 16:04:13 +0000 (16:04 +0000)]
Merge "Fix tox-run.sh print statement"

7 years agoMigrate sonar job 19/6119/4
Thanh Ha [Wed, 23 Aug 2017 23:15:38 +0000 (19:15 -0400)]
Migrate sonar job

This patch uses OpenDaylight Maven Sonar job as a base and modifies it
to be more generic for use in global-jjb.

Changes from original:

- Support overriding Sonar Gerrit Triggers.
- Use maven deploy goal rather than install. End result is the same but
  deploy sends artifacts to a staging repo which we can check if needed.

Issue: RELENG-243
Change-Id: Ided78015ced8b2d4b42ed452b704e1fe65770a01
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix tox-run.sh print statement 59/6159/2
Thanh Ha [Fri, 25 Aug 2017 17:42:53 +0000 (13:42 -0400)]
Fix tox-run.sh print statement

Change-Id: I11721f0e292cddfd7eb05c26866ed274fa7116c8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Update .gitignore"
Andrew Grimberg [Tue, 29 Aug 2017 15:39:57 +0000 (15:39 +0000)]
Merge "Update .gitignore"

7 years agoDont prefix PATH with hash built-in command. 59/6059/5
Anil Belur [Fri, 18 Aug 2017 23:03:11 +0000 (09:03 +1000)]
Dont prefix PATH with hash built-in command.

The changes are tested with the below job
https://jenkins.hyperledger.org/job/ci-management-packer-verify/4/console

Also supress wget verbose output.

Jira: releng-442
Change-Id: Icab1214c19e68346a84c37179a1d8c1540ffc657
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoUpdate .gitignore 20/6120/1
Anil Belur [Thu, 24 Aug 2017 04:39:03 +0000 (14:39 +1000)]
Update .gitignore

Remove path/to/files not to ignore

Change-Id: I844cc63779c29f85f4d57e7a8bd180a30c9ad085
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoRelease global-jjb v0.7.0 75/5875/8 v0.7.0
Thanh Ha [Fri, 11 Aug 2017 17:15:09 +0000 (13:15 -0400)]
Release global-jjb v0.7.0

Change-Id: Ia57686ff8dc8ca45048d81211463052a96ee7be9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd .jjb-test to tox jjb command 46/6046/1
Thanh Ha [Fri, 18 Aug 2017 19:22:27 +0000 (15:22 -0400)]
Add .jjb-test to tox jjb command

This directory needs to be explicitly added for tests to run when
calling `tox -e jjb`.

Change-Id: I38fc6fff2bab79d03298acff768ecffbb6c25c9a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRevert "Exclude the jjb-test directory" 42/6042/2
Thanh Ha [Fri, 18 Aug 2017 19:10:27 +0000 (15:10 -0400)]
Revert "Exclude the jjb-test directory"

No longer necessary due to I9bd85a43d76cf1dfcb02e327f097cd6551366d1b.

This reverts commit 854da1e33dd03f1569d0766dbedda123dd5af4ea.

Change-Id: Iba0569d8fb1931af6dbacbd0bec8fd03b5d4e775
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMove tests to .jjb-test 39/6039/1
Thanh Ha [Fri, 18 Aug 2017 18:56:32 +0000 (14:56 -0400)]
Move tests to .jjb-test

JJB by default ignores paths that start with '.' so take advantage of
that and move our tests there. This way end users do not need to make
any changes to their local environment to handle the new jjb-test
directory.

Change-Id: I9bd85a43d76cf1dfcb02e327f097cd6551366d1b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd all release notes up to date 36/5936/1
Thanh Ha [Wed, 16 Aug 2017 18:38:04 +0000 (14:38 -0400)]
Add all release notes up to date

Keeping a history for our release notes would be useful for folks to
understand what changes since the version they are currently using.

Change-Id: Ic0e06f742ec1609664329cdd70c809655d3c9db2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUpdate expected-xml due to missing changes 32/5932/1
Thanh Ha [Wed, 16 Aug 2017 18:11:03 +0000 (14:11 -0400)]
Update expected-xml due to missing changes

The patch I52d05808f1f84fee37e41f68677136ee105ba48c was merged after
patch I165c8309d4aaded6830f21eea10bc5a64cad2dff so is missing the
lftools changes in it's expected-xml.

Change-Id: I6a524cf9a0ba4251e3e2b2ad1036de52c4f2a48b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Migrate Maven Verify job template"
Andrew Grimberg [Tue, 15 Aug 2017 15:17:07 +0000 (15:17 +0000)]
Merge "Migrate Maven Verify job template"

7 years agoMerge "Verify JJB when global-jjb is updated"
Anil Shashikumar Belur [Tue, 15 Aug 2017 00:38:19 +0000 (00:38 +0000)]
Merge "Verify JJB when global-jjb is updated"

7 years agoMerge changes I7d7323b8,Ib796cfee
Anil Shashikumar Belur [Tue, 15 Aug 2017 00:38:04 +0000 (00:38 +0000)]
Merge changes I7d7323b8,Ib796cfee

* changes:
  Add default refspec reference
  Refactor packer ci templates

7 years agoMerge "Refactor jjb ci templates"
Anil Shashikumar Belur [Tue, 15 Aug 2017 00:37:02 +0000 (00:37 +0000)]
Merge "Refactor jjb ci templates"

7 years agoVerify JJB when global-jjb is updated 96/5896/2
Thanh Ha [Mon, 14 Aug 2017 15:53:27 +0000 (11:53 -0400)]
Verify JJB when global-jjb is updated

Change-Id: Ic9b9bb7f8869a4580dc0f6c69290c1c76f96ecba
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd default refspec reference 83/5883/1
Thanh Ha [Fri, 11 Aug 2017 21:52:09 +0000 (17:52 -0400)]
Add default refspec reference

Missed this when we ported over the infra-parameters. Refspec should
default to refs/heads/{branch} so that a manual run of a job will always
work against the specified branch for verify jobs. Merge jobs ignore
this by defining a blank refspec.

Change-Id: I7d7323b85b61639eef0e1b4491d6ba94d934b714
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRefactor packer ci templates 82/5882/1
Thanh Ha [Fri, 11 Aug 2017 21:26:32 +0000 (17:26 -0400)]
Refactor packer ci templates

Improve maintainability by refactoring some common code.

- Improve documentation
- Reorganize anchors for better maintainability
- Remove dependency on jjb_common anchor
  (updates to jjb code should not not break packer code)
- Do not run packer merge jobs concurrently
  (merge jobs should not be configured to run concurrently)

Change-Id: Ib796cfee44ae7b01b42ee400a04be79b243cac3b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRefactor jjb ci templates 81/5881/1
Thanh Ha [Fri, 11 Aug 2017 21:02:46 +0000 (17:02 -0400)]
Refactor jjb ci templates

- Add Documentation
- Rearrange anchors for improved maintainability

Change-Id: If69127cb4a26942bcc3f57c5bfc407964c817393
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMigrate Maven Verify job template 37/5837/5
Thanh Ha [Thu, 10 Aug 2017 20:54:34 +0000 (16:54 -0400)]
Migrate Maven Verify job template

This patch uses the OpenDaylight Maven Verify job as the original base
and modifies it to be more generically used in global-jjb.

Changes from original template:

- Support overriding the default Gerrit Triggers.
- Use the mvn deploy goal rather than install goal. End result is the
  same only the job copies artifacts to a staging directory in case we
  need it.
- File paths can now be overrided in case a project wants to be more
  specific on which files to build against.

Issue: RELENG-244
Change-Id: I52d05808f1f84fee37e41f68677136ee105ba48c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake lftools version configurable 69/5869/7
Thanh Ha [Fri, 11 Aug 2017 16:40:04 +0000 (12:40 -0400)]
Make lftools version configurable

Add a new global default variable 'lftools-version' which can be used to
specify a version of lftools to install.

Issue: RELENG-391
Change-Id: I165c8309d4aaded6830f21eea10bc5a64cad2dff
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd method to test dev versions of lftools 16/5816/7
Thanh Ha [Wed, 9 Aug 2017 20:48:11 +0000 (16:48 -0400)]
Add method to test dev versions of lftools

Can be used to test dev versions of lftools. Instructions are purposely
only documented in lftools install script such that end consumers of
global-jjb should not see this and do not need to know about it's
existance.

Issue: RELENG-362
Change-Id: I95605d578f0295edc34d6f782fb0a6b44b2f295a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Maven CLM tests 45/5845/2
Thanh Ha [Fri, 11 Aug 2017 03:35:03 +0000 (23:35 -0400)]
Add Maven CLM tests

Change-Id: Ib38677b946f6b50c165a571cecd1ab93468afd78
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRemove lftools install step from clm job 44/5844/2
Thanh Ha [Fri, 11 Aug 2017 03:26:57 +0000 (23:26 -0400)]
Remove lftools install step from clm job

Missed this in code review. The CLM job does not do anything with
lftools so it shouldn't waste cycles installing it.

Change-Id: I6ecb765c03f10a03397af7583cc2bde5c990b348
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoReorganize template definition structure 43/5843/2
Thanh Ha [Fri, 11 Aug 2017 02:48:56 +0000 (22:48 -0400)]
Reorganize template definition structure

Having maintained this repo for awhile we can now see some common
patterns emerge from our yaml structures. Typically for a given job
there is a common builder anchor followed by 2 template sections, 1
for Gerrit and 1 for GitHub. Plus some common macros / anchors that
may be used by multiple job types.

This patch reorganizes the structure to treat a set of
anchor-gerrit-github job definitions as a single job definition. This
allows us to keep the job template close to their anchor definition so
that looking up what the main anchor does will not cause as much back
scroll.

Additionally this patch refactors the confusingly named verify_merge
anchors to a more understandable 'common' name.

Change-Id: I95eb4609274ec21b50aef059b03ac4598894f671
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Make Merge and Verify job triggers overrideable"
Andrew Grimberg [Thu, 10 Aug 2017 20:56:36 +0000 (20:56 +0000)]
Merge "Make Merge and Verify job triggers overrideable"

7 years agoMake Merge and Verify job triggers overrideable 35/5835/2
Thanh Ha [Thu, 10 Aug 2017 20:32:01 +0000 (16:32 -0400)]
Make Merge and Verify job triggers overrideable

This makes merge and verify jobs that use Gerrit Trigger be able to
override the default trigger defined by the job. This is useful in cases
where a project may have topic branches that they do not wish to
configure their build rules differently. For example in OpenDaylight the
NetVirt project has a need for topic branches but they  don't want to
run testing against every patch submission in the topic branches and
would prefer to run them manually. This patch would allow them to
reconfigure the triggers in that case for the topic branch.

Based on a POC from:
https://git.opendaylight.org/gerrit/61385

Change-Id: Idf1d301572bb33f5b540f1011658cdd3f3fc69f5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix python-tox incorrect default stream setting 23/5823/5
Thanh Ha [Thu, 10 Aug 2017 03:43:41 +0000 (23:43 -0400)]
Fix python-tox incorrect default stream setting

Change-Id: Ief29e966267efac9634e51bec3c201c3ee4351c9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRefactor tests into jjb-tests directory 22/5822/5
Thanh Ha [Wed, 9 Aug 2017 23:01:52 +0000 (19:01 -0400)]
Refactor tests into jjb-tests directory

Issue: RELENG-250
Change-Id: Idc2ddc9c28a8ab835b3558f4076305053ee43235
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoExclude the jjb-test directory 21/5821/2
Thanh Ha [Wed, 9 Aug 2017 23:24:01 +0000 (19:24 -0400)]
Exclude the jjb-test directory

When running jenkins-jobs we should exclude the jjb-test directory. That
way global-jjb can maintain tests in that directory while not affecting
users of global-jjb's tests jobs from picking up the tests.

Change-Id: I5101e4627291817d5cf9538f85a9f3db3e6d7b28
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Generalize deploy maven-file builder"
Thanh Ha [Thu, 10 Aug 2017 03:17:12 +0000 (03:17 +0000)]
Merge "Generalize deploy maven-file builder"

7 years agoGeneralize deploy maven-file builder 53/5753/6
Anil Belur [Sun, 6 Aug 2017 23:59:48 +0000 (09:59 +1000)]
Generalize deploy maven-file builder

The builder hard codes the URL path which makes the builder
limit deploy capabilites only to external nexus repos and not
local file systems.

The change fixes the above issue by allowing the calling job
to define the repository path.
ex:

    "${NEXUS_URL}/content/repositories/$REPO_ID"
    "file://$WORKSPACE/m2repo"

Renamed variables:
'files-dir' to 'upload-files-dir'
'nexus-url-path' to 'maven-repo-url'
'$NEXUS_URL_PATH' to '$MAVEN_REPO_URL'

Change-Id: If0beb7f6dff76c18988c9a75b52c80358f16dff6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAdd license header test for shell scripts 34/5734/2
Thanh Ha [Thu, 3 Aug 2017 21:23:32 +0000 (17:23 -0400)]
Add license header test for shell scripts

Add a test to check license headers exist in shell scripts.

Change-Id: I4f6f9874f79d55f5ab52b17a4dafa9d836f90d34
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd timer to packer merge job to build new images 25/5725/1 v0.6.0
Anil Belur [Thu, 3 Aug 2017 02:20:05 +0000 (12:20 +1000)]
Add timer to packer merge job to build new images

Change-Id: I5d3d76ba4350d71e051a3f1642060ebb0bd0aa2d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoMerge "Make packer-cloud-env variable configurable"
Thanh Ha [Wed, 2 Aug 2017 18:58:50 +0000 (18:58 +0000)]
Merge "Make packer-cloud-env variable configurable"

7 years agoMake packer-cloud-env variable configurable 99/5699/3
Anil Belur [Mon, 31 Jul 2017 05:30:30 +0000 (15:30 +1000)]
Make packer-cloud-env variable configurable

The packer-cloud-env can have a default in job templates but we should
allow it to be configurable in case a downstream consumer names their
configuration file differently.

Jira: releng-341
Change-Id: Ifc89dec39d3b93b75df58d8d37c7299a9dccf29d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agopacker should validate only .json files 06/5706/2
Anil Belur [Tue, 1 Aug 2017 05:39:55 +0000 (15:39 +1000)]
packer should validate only .json files

Some of the projects could have README or .txt file
which should be excluded, without which packer validate
would fail.

Change-Id: I6cc388a851ae2731a113d47e3719da7edf519c63
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoMerge "Rename settings-file to mvn-settings"
Thanh Ha [Wed, 2 Aug 2017 13:49:54 +0000 (13:49 +0000)]
Merge "Rename settings-file to mvn-settings"

7 years agoRename settings-file to mvn-settings 16/5716/1
Thanh Ha [Wed, 2 Aug 2017 13:42:40 +0000 (09:42 -0400)]
Rename settings-file to mvn-settings

I7970aae80a807e359dd34c52353007f13642fb01 did not rename the test
settings and caused some build failures.

Issue: RELENG-345
Change-Id: Ief9b45a000eb43600531a9ac923d12b4e4aa8c91
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Pass common maven options to deploy file builder"
Thanh Ha [Fri, 28 Jul 2017 01:00:31 +0000 (01:00 +0000)]
Merge "Pass common maven options to deploy file builder"

7 years agoRename settings-file to mvn-settings in templates 37/5637/3 v0.5.5
Thanh Ha [Wed, 26 Jul 2017 15:30:57 +0000 (11:30 -0400)]
Rename settings-file to mvn-settings in templates

For Maven Templates we should be using mvn-* when referring to settings
files (and any other variables provided by user related to mvn cli).

Issue: RELENG-345
Change-Id: I7970aae80a807e359dd34c52353007f13642fb01
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>