releng/global-jjb.git
6 years agoDeprecate lftools-install.sh script 99/12599/1
Thanh Ha [Fri, 14 Sep 2018 02:18:23 +0000 (22:18 -0400)]
Deprecate lftools-install.sh script

This script if used without calling `deactivate` gets in the way of
our post-build scripts and causes UNSTABLE build. Deprecate it as
we are no longer using it in global-jjb.

Change-Id: I84654b20490d5aa7e84e5e7330a59936dc7a6f0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate jobs to use lf-infra-pre-build 98/12598/1
Thanh Ha [Thu, 13 Sep 2018 23:38:34 +0000 (19:38 -0400)]
Update jobs to use lf-infra-pre-build

Use lf-infra-pre-build to install lftools via --user config. This
resolves the post-build issues caused by `pip install` due to
virtualenvs messing with the environment.

Change-Id: Iccd72e6f1d580037f55bff3199d05d467de17c58
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Update rtd jobs to use lf-infra-pre-build"
Jessica Wagantall [Fri, 14 Sep 2018 02:13:28 +0000 (02:13 +0000)]
Merge "Update rtd jobs to use lf-infra-pre-build"

6 years agoMerge "Use --user for tox install instead of virtualenv"
Jessica Wagantall [Fri, 14 Sep 2018 02:08:55 +0000 (02:08 +0000)]
Merge "Use --user for tox install instead of virtualenv"

6 years agoUpdate rtd jobs to use lf-infra-pre-build 92/12592/3
Thanh Ha [Fri, 14 Sep 2018 00:28:44 +0000 (20:28 -0400)]
Update rtd jobs to use lf-infra-pre-build

Use lf-infra-pre-build to install lftools via --user config. This
resolves the post-build install failing with missing PBR version.

Change-Id: I3aa48d98811a7469fba15fe4c3eb7474bc7b5196
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse --user for tox install instead of virtualenv 86/12586/3
Thanh Ha [Thu, 13 Sep 2018 19:31:30 +0000 (15:31 -0400)]
Use --user for tox install instead of virtualenv

Allows us to remove the workaround of installing lftools in
a venv before as the virtualenvs should no longer be conflicting.

Change-Id: Ic466cd74a568e0de2fbb0f3fd75205cd04c1e3f9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Update lftools to ~ 0.17.1"
Jessica Wagantall [Fri, 14 Sep 2018 02:01:02 +0000 (02:01 +0000)]
Merge "Update lftools to ~ 0.17.1"

6 years agoUse `python -m pip` to ensure updated pip is used 91/12591/1
Thanh Ha [Fri, 14 Sep 2018 00:04:51 +0000 (20:04 -0400)]
Use `python -m pip` to ensure updated pip is used

/usr/bin/pip is usually an OS level wrapper for pip. Calling
`python -m pip` ensures that we are getting the pip we are
installing rather than the OS local version.

Change-Id: I054d1cc0455c700e00450295cf76d925cff99f73
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate lftools to ~ 0.17.1 90/12590/1
Thanh Ha [Fri, 14 Sep 2018 00:02:07 +0000 (20:02 -0400)]
Update lftools to ~ 0.17.1

Change-Id: I69a2e669493b0f309e161f07152d93b0fa0c9ac6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Use clouds.yaml for openstack packer builders"
Anil Belur [Thu, 13 Sep 2018 15:56:24 +0000 (15:56 +0000)]
Merge "Use clouds.yaml for openstack packer builders"

6 years agoMerge "Add sigul signing to maven-stage job"
Andrew Grimberg [Wed, 12 Sep 2018 18:52:34 +0000 (18:52 +0000)]
Merge "Add sigul signing to maven-stage job"

6 years agoFix package list script to not fail on diff 58/12558/1
Thanh Ha [Wed, 12 Sep 2018 17:48:19 +0000 (13:48 -0400)]
Fix package list script to not fail on diff

The diff command exits 1 if there is a difference between 2 files.
This is perfectly valid so ignore the exit code for this command.

Change-Id: I0da9d6bb99a5a0a9666697b27416fa5e5518e316
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse clouds.yaml for openstack packer builders 50/12550/4
Thanh Ha [Wed, 12 Sep 2018 00:03:52 +0000 (20:03 -0400)]
Use clouds.yaml for openstack packer builders

Since packer version 1.2.5, packer now supports pulling openstack
config from clouds.yaml. Let's consolidate to that file so that we
don't have duplicate configuration with the jobs that need the
openstack cli.

Issue: RELENG-1205
Change-Id: Idf23a30b111dd922120fb6195d0411e2fc993dab
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd sigul signing to maven-stage job 12/12312/10
Thanh Ha [Sat, 18 Aug 2018 02:15:07 +0000 (22:15 -0400)]
Add sigul signing to maven-stage job

Refactor the lf-sigul* macros into a new one called lf-sigul-sign-dir
to be used as a one shot macro to sign a directory. Macro initializes
and cleans up after itself so no need to call extra builder steps.

Issue: RELENG-1071
Change-Id: I0ff965c2ef24fa7a44a114445d8a97c3176e575a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoChange gjjb install to use symlinks in jjb-dir 28/12528/3
Thanh Ha [Mon, 10 Sep 2018 22:00:19 +0000 (18:00 -0400)]
Change gjjb install to use symlinks in jjb-dir

Update global-jjb install instructions to symlink the jjb and shell
directories in global-jjb and clone the submodule to the root of
ci-management instead.

This allows us to use tools that have YAML file configurations that
JJB will otherwise pick up and parse as invalid JJB config.

Issue: RELENG-1204
Change-Id: I5060dd0c1b67fa020a84844936eebb970ae2cbb6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse Reno for release notes 04/12504/1
Thanh Ha [Fri, 7 Sep 2018 23:07:23 +0000 (19:07 -0400)]
Use Reno for release notes

Change-Id: I4ac1ce147ada7176cdac399b83edc646973dd80e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Refactor job-groups documentation"
Andrew Grimberg [Thu, 6 Sep 2018 15:08:12 +0000 (15:08 +0000)]
Merge "Refactor job-groups documentation"

6 years agoMerge "Remove maven-merge job todo"
Andrew Grimberg [Thu, 6 Sep 2018 15:05:45 +0000 (15:05 +0000)]
Merge "Remove maven-merge job todo"

6 years agoStrip out trailing metadata from version 61/12461/1
Thanh Ha [Wed, 5 Sep 2018 16:42:01 +0000 (12:42 -0400)]
Strip out trailing metadata from version

When manually building maven plugins maven puts in some metadata
like "2.38-SNAPSHOT (private-9853d407-zxiiro)" which throws off the
version_ge function as it does not know how to handle a version with
a space in the name. This change strips out only the leading version
ignoring everything after a space.

Change-Id: I02f0397ae5627f65638a456ba2f1304dd9a16de9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRefactor job-groups documentation 95/12395/2
Thanh Ha [Sat, 25 Aug 2018 15:21:27 +0000 (11:21 -0400)]
Refactor job-groups documentation

Improve the way job-groups are documented so that it stays properly
in sync. This update recommends projects define their own job-groups
and using the ones defined in global-jjb only as a starting point.

Update ensure-documented to ignore job-groups since they should be
self documenting now in the new format.

Change-Id: I945735ecd50596605139c6522903a49350a1ea10
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRemove maven-merge job todo 94/12394/1
Thanh Ha [Sat, 25 Aug 2018 14:54:52 +0000 (10:54 -0400)]
Remove maven-merge job todo

This is completed.

Change-Id: Iddc98ccc4d4f8f3bfc3650eec3b5bab7f156db3b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease global-jjb v0.24.0 86/12386/3 v0.24.0
Thanh Ha [Fri, 24 Aug 2018 16:43:42 +0000 (12:43 -0400)]
Release global-jjb v0.24.0

Change-Id: I5cc5be89985e0fcb99cb256053282b5e740b05c1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRe-enable CLM jobs 88/12388/1
Thanh Ha [Fri, 24 Aug 2018 18:49:55 +0000 (14:49 -0400)]
Re-enable CLM jobs

Change-Id: I1816f34e964ff56cba3e5d7af693993c97b1cc7d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add pre-build step to prep vm before build"
Jeremy Phelps [Fri, 24 Aug 2018 14:42:07 +0000 (14:42 +0000)]
Merge "Add pre-build step to prep vm before build"

6 years agoAdd option to disable-job for all jobs 77/12377/3
Thanh Ha [Thu, 23 Aug 2018 22:47:00 +0000 (18:47 -0400)]
Add option to disable-job for all jobs

Add option to all jobs to allow disabling the job. CLM will has this
setting set to "true" while we figure out the CLM issues however
for all other jobs "false" is default.

Change-Id: I9db6e8603a7d968aacf0eae17dea3554d6c97429
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Disable CLM jobs by default"
Thanh Ha (zxiiro) [Thu, 23 Aug 2018 19:50:08 +0000 (19:50 +0000)]
Merge "Disable CLM jobs by default"

6 years agoDisable CLM jobs by default 75/12375/1
Jeremy Phelps [Thu, 23 Aug 2018 19:12:19 +0000 (14:12 -0500)]
Disable CLM jobs by default

Change-Id: I8c3b4a68aaed349d026d08134de4147ea74a9696
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoAdd pre-build step to prep vm before build 50/12150/4
Thanh Ha [Wed, 8 Aug 2018 00:27:59 +0000 (20:27 -0400)]
Add pre-build step to prep vm before build

This new build step will run before any jobs run to prep the
builder.

This change should not force using of $HOME/.local/bin just yet
but preps the macros in place for us to activate it in jobs later.
The current virtualenv method should override what's done here.

Change-Id: I55947020e2f0cdbb61f9d4e7e88927d9bc304d17
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSet permit-all true for all jobs 44/12344/1
Thanh Ha [Tue, 21 Aug 2018 16:45:44 +0000 (12:45 -0400)]
Set permit-all true for all jobs

We need this set for all jobs otherwise GHPR will spam GitHub.
This was set for verify jobs but the merge jobs did not have them.

Change-Id: I76db9d6146228180c9af3f06780705dac33b7899
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Move openstack-cron job to global-jjb"
Andrew Grimberg [Mon, 20 Aug 2018 17:05:24 +0000 (17:05 +0000)]
Merge "Move openstack-cron job to global-jjb"

6 years agoMerge "Require IMAGE_NAME and HARDWARE_ID"
Andrew Grimberg [Mon, 20 Aug 2018 17:00:49 +0000 (17:00 +0000)]
Merge "Require IMAGE_NAME and HARDWARE_ID"

6 years agoMerge "Add job to verify upstream global-jjb patches"
Andrew Grimberg [Mon, 20 Aug 2018 16:19:08 +0000 (16:19 +0000)]
Merge "Add job to verify upstream global-jjb patches"

6 years agoMerge "Remove mvn-settings requirement from jjb job docs"
Andrew Grimberg [Mon, 20 Aug 2018 15:36:53 +0000 (15:36 +0000)]
Merge "Remove mvn-settings requirement from jjb job docs"

6 years agoMerge "Refactor staging-profile-id out of mvn-parameters"
Andrew Grimberg [Mon, 20 Aug 2018 15:29:05 +0000 (15:29 +0000)]
Merge "Refactor staging-profile-id out of mvn-parameters"

6 years agoMerge "Make staging jobs run daily"
Andrew Grimberg [Mon, 20 Aug 2018 15:27:31 +0000 (15:27 +0000)]
Merge "Make staging jobs run daily"

6 years agoMerge "Make maven-merge jobs run daily"
Andrew Grimberg [Mon, 20 Aug 2018 15:26:40 +0000 (15:26 +0000)]
Merge "Make maven-merge jobs run daily"

6 years agoRequire IMAGE_NAME and HARDWARE_ID 26/12326/1
Thanh Ha [Mon, 20 Aug 2018 15:18:41 +0000 (11:18 -0400)]
Require IMAGE_NAME and HARDWARE_ID

IMAGE_NAME had HARDWARE_ID are required settings so clearly mark
them as so instead of mentioning the default setting.

Change-Id: I30a00f1c92f7714f7ac8a308d12a6181fe4547cd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Document the jjb-version variable"
Andrew Grimberg [Mon, 20 Aug 2018 15:18:30 +0000 (15:18 +0000)]
Merge "Document the jjb-version variable"

6 years agoMake maven-merge jobs run daily 21/12321/1
Thanh Ha [Sat, 18 Aug 2018 20:54:02 +0000 (16:54 -0400)]
Make maven-merge jobs run daily

Back when OpenDaylight was on Rackspace we were trying to cut back
on how often jobs run due to the infra being unstable and at the
time thought the maven-integration job and maven-merge jobs were
part of the problem. Since we moved to Vexxhost infra has been
significantly more stable and not as big a concern. Let's run
the maven-merge jobs on a daily basis so that project artifacts
have more chances to pass before the 3 week SNAPSHOT clearing
cron that's run in Nexus.

Change-Id: I7ac17b3b4b8729d0f143fb15c71143c3de1ac461
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMake staging jobs run daily 20/12320/1
Thanh Ha [Sat, 18 Aug 2018 20:50:58 +0000 (16:50 -0400)]
Make staging jobs run daily

As we move towards more automated releases having regularly running
staging jobs will allow projects to discover broken staging jobs
earlier. Let's run these jobs @daily as a default.

Change-Id: I50a3f27396fc921714d1faff16830b2e6b38730d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRefactor staging-profile-id out of mvn-parameters 19/12319/1
Thanh Ha [Sat, 18 Aug 2018 20:44:52 +0000 (16:44 -0400)]
Refactor staging-profile-id out of mvn-parameters

This was originally a bad design decision. We should not be forcing
staging-profile-id variable against all users of
lf-infra-maven-parameters when only the staging job needs it.

This patch moves custom parameter definitions to the maven-stage job
and removes staging-profile-id requirement from all other jobs.

Change-Id: I58fe4c43c851cd9e61ddec847529b0dcb91e0af1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAllow unbound variables in sigul scripts 14/12314/1
Thanh Ha [Sat, 18 Aug 2018 02:30:02 +0000 (22:30 -0400)]
Allow unbound variables in sigul scripts

These scripts as they are designed expect unbound variables so
enable them at least until they are fixed.

Change-Id: I48182a1d5d5c3cf4d42249bfc8a55b7c0088ec36
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse include-raw instead of escape for sigul macros 13/12313/1
Thanh Ha [Sat, 18 Aug 2018 02:23:40 +0000 (22:23 -0400)]
Use include-raw instead of escape for sigul macros

These macros are not using any substitutions so are hitting
the bug that inserts curly braces.

Change-Id: I7af376c3c4ce1e2cd41ca4842e5042728cdafb69
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix typo in lf-sigual-install builders syntax 11/12311/1
Thanh Ha [Sat, 18 Aug 2018 02:13:53 +0000 (22:13 -0400)]
Fix typo in lf-sigual-install builders syntax

Change-Id: I8a75a63a577500783d7a5f22f1833a2f6451f3d5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMove openstack-cron job to global-jjb 89/12089/10
Thanh Ha [Thu, 2 Aug 2018 22:23:02 +0000 (18:23 -0400)]
Move openstack-cron job to global-jjb

Move OpenDaylight's builder-openstack-cron job to global-jjb. This is
an initial patch that only migrates the "image-protection" script.

image-protection is used to parse jenkins-config/ and jjb/ directories
for any mention of images starting with "ZZCI" and flagging them as
protected. The assumption here is that ZZCI images are CI managed
and if they are referred to anywher by anything then they are
effectively considered in-use and should not be deletable so flag
them as "protected: true" in OpenStack.

Change-Id: Ib706663f0c08bd7a9160b0a6ce69dcd3b802f8f5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd job to verify upstream global-jjb patches 93/12293/3
Thanh Ha [Fri, 17 Aug 2018 00:24:27 +0000 (20:24 -0400)]
Add job to verify upstream global-jjb patches

Add job that can be used by downstream projects to report upstream
to global-jjb patches when a proposed patch breaks their project.

This job sets -1 CR only and does not block the upstream patch as
there are cases where we may want to break backwards compatibility
on purpose. This job's purpose is to give us a clear view when it
does happen.

Change-Id: If0dda88ff24da7fd171484c37855f33b05f36553
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument the jjb-version variable 10/12310/1
Thanh Ha [Sat, 18 Aug 2018 01:39:42 +0000 (21:39 -0400)]
Document the jjb-version variable

Change-Id: Ia07cb6b437e6e2107b8301d52f72aa3cace112da
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRemove mvn-settings requirement from jjb job docs 09/12309/1
Thanh Ha [Sat, 18 Aug 2018 01:37:46 +0000 (21:37 -0400)]
Remove mvn-settings requirement from jjb job docs

These jobs do not use that setting.

Change-Id: I8c606002bc4ca187b56514d65aa39919a6c6e74b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add Jenkins Sandbox Cleanup job"
Jeremy Phelps [Fri, 10 Aug 2018 00:02:26 +0000 (00:02 +0000)]
Merge "Add Jenkins Sandbox Cleanup job"

6 years agoMerge "Rename maven-release job to maven-stage"
Jeremy Phelps [Thu, 9 Aug 2018 23:50:37 +0000 (23:50 +0000)]
Merge "Rename maven-release job to maven-stage"

6 years agoMerge "Make GHPRB trigger on comment only"
Thanh Ha (zxiiro) [Thu, 9 Aug 2018 23:50:28 +0000 (23:50 +0000)]
Merge "Make GHPRB trigger on comment only"

6 years agoMake GHPRB trigger on comment only 80/12180/2
Jeremy Phelps [Thu, 9 Aug 2018 18:25:57 +0000 (13:25 -0500)]
Make GHPRB trigger on comment only

Issue: RELENG-1132
Change-Id: I5d67b8a70a4b2d5dc5e7c4028ba62c21cd7a7d1e
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoTest with latest JJB and supported JJB 65/12165/1
Thanh Ha [Wed, 8 Aug 2018 23:27:49 +0000 (19:27 -0400)]
Test with latest JJB and supported JJB

Test global-jjb with both the latest version of JJB as well as the
global-jjb supported version of JJB.

Also include a script to ensure that jjb/lf-ci-jobs.yaml and tox.ini
define the same supported versions of JJB.

Change-Id: I1a181776c6d0eef1b857ede9099d3ebb8e3ba98d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpgrade minimal jjb version to 2.2.1 57/12157/1
Jeremy Phelps [Wed, 8 Aug 2018 17:41:44 +0000 (12:41 -0500)]
Upgrade minimal jjb version to 2.2.1

Issue: RELENG-1129
Change-Id: Idd342b85a0306cfedb63215f4a6442ced74c94e4
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoAdd Jenkins Sandbox Cleanup job 22/12122/2
Thanh Ha [Sat, 4 Aug 2018 20:22:58 +0000 (16:22 -0400)]
Add Jenkins Sandbox Cleanup job

This cleanup job runs weekly on Saturdays to clear out Sandbox
jobs and views from the system.

The benefit of this is that it uses the same version of JJB as
the other CI jobs whereas the traditional cron job we put in puppet
does not often get updated to match the right version.

Issue: RELENG-1118
Change-Id: I2229d66f637bd5aab203a3bbf12aa1e677a471a1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix packer {cron} should be {obj:cron} 23/12123/1
Thanh Ha [Sat, 4 Aug 2018 20:36:01 +0000 (16:36 -0400)]
Fix packer {cron} should be {obj:cron}

Cron accepts a multiline list of crons so fix to {obj:cron} so that
the user can provide multiple cron settings.

Change-Id: I2ac03ad59e33c07eaa0a89d87bd7486fdbfe7e9d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add CMake Stage job"
Jeremy Phelps [Fri, 3 Aug 2018 18:12:11 +0000 (18:12 +0000)]
Merge "Add CMake Stage job"

6 years agoRename maven-release job to maven-stage 27/9927/3
Thanh Ha [Wed, 11 Apr 2018 20:48:08 +0000 (16:48 -0400)]
Rename maven-release job to maven-stage

ATTENTION: This is a breaking change. The trigger word
"build release$" is changed to "stage-release$" to better
reflect what this job is actually doing.

In preparation for work on RELENG-425 this change renames the
maven-release jobs to maven-stage job to better reflect what the
job really does.

Trigger keyword was also changed to "stage-release$"

Issue: RELENG-425
Change-Id: I0dd4342664251386ddc7eca52df56156105f200d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix nexus-iq-scan-patterns should be obj class 77/12077/1
Thanh Ha [Wed, 1 Aug 2018 23:37:50 +0000 (19:37 -0400)]
Fix nexus-iq-scan-patterns should be obj class

Since we are passing a list we need to set the scan patterns
variable as {obj:var}.

Change-Id: I13c4cf4d77f8aee0652962731a5bd7fb901a3d46
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd CMake Stage job 71/12071/2
Thanh Ha [Wed, 1 Aug 2018 21:37:07 +0000 (17:37 -0400)]
Add CMake Stage job

Issue: RELENG-1108
Change-Id: I6b295c1ceefc1c77fbe3311a8fdf314849b35cd0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoDocument comment triggers 70/12070/1
Thanh Ha [Wed, 1 Aug 2018 21:51:34 +0000 (17:51 -0400)]
Document comment triggers

Change-Id: If017ac0989557cef10f2d393bddf98d40b7d9121
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd github whitelist branches params to trigger. 37/12037/6
Jeremy Phelps [Mon, 30 Jul 2018 21:53:02 +0000 (16:53 -0500)]
Add github whitelist branches params to trigger.

Issue: RELENG-1104
Change-Id: I02c7d8926888f17e8b9b7d78deb561147f44602f
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoFix github project url for properties 39/12039/4
Jeremy Phelps [Tue, 31 Jul 2018 14:18:12 +0000 (09:18 -0500)]
Fix github project url for properties

Jobs will not trigger off of GHPRB without it.

Issue: RELENG-1103
Change-Id: Id35c7e4f4beb5ecc06a69ac2c684cd585b565fae
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
6 years agoMerge "Update CLM job to use Nexus Policy Evaluation"
Thanh Ha [Wed, 1 Aug 2018 00:24:35 +0000 (00:24 +0000)]
Merge "Update CLM job to use Nexus Policy Evaluation"

6 years agoUpdate CLM job to use Nexus Policy Evaluation 16/12016/13
Jessica Wagantall [Fri, 27 Jul 2018 03:54:00 +0000 (20:54 -0700)]
Update CLM job to use Nexus Policy Evaluation

Depends on JJB plugin support:
https://review.openstack.org/584581

Change-Id: I9b790183545f64c2d535163ae0eed9ed1ad5cc1e
Issue-ID: RELENG-1086
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoRelease global-jjb v0.23.0 20/12020/2 v0.23.0
Thanh Ha [Fri, 27 Jul 2018 15:56:24 +0000 (11:56 -0400)]
Release global-jjb v0.23.0

Change-Id: I2f9edd302f643601c18bb02ad08e79c5faf7f316
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUse eval so that $cmake_opts is properly parsed 28/12028/1
Thanh Ha [Sat, 28 Jul 2018 22:09:08 +0000 (18:09 -0400)]
Use eval so that $cmake_opts is properly parsed

Without eval bash inserts single quotes and breaks parameters passed
if they have quotes in the parameters. For example
`-D CMAKE_CXX_FLAGS="-fPIC -std=gnu++11"`

Issue: RELENG-1075
Change-Id: I77046a7edc0516f0ae28dd2b8cd2c8994ad5079e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Validate only template/platform that is built"
Andrew Grimberg [Thu, 26 Jul 2018 19:16:13 +0000 (19:16 +0000)]
Merge "Validate only template/platform that is built"

6 years agoValidate only template/platform that is built 00/12000/1
Thanh Ha [Thu, 26 Jul 2018 02:25:44 +0000 (22:25 -0400)]
Validate only template/platform that is built

No point validating every combination of template/platform in a
merge job that is only interested in building a single combo.

Change-Id: I0ad760b3247ac18aba79a9bca25d887e09b987fa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix GitHub templates override lf-infra-properties 54/11954/2
Thanh Ha [Tue, 24 Jul 2018 17:03:56 +0000 (13:03 -0400)]
Fix GitHub templates override lf-infra-properties

When redefining any Jenkins section we must redefine everything
that is being overrided otherwise previous configuration will
be lost. This patch fixes the build-days-to-keep parameter that
is lost in the GitHub jobs due to the github property override.

Change-Id: I8a127344189215367c3546d0b3222d989ea74800
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd cmake-verify job template 40/11940/6
Thanh Ha [Tue, 24 Jul 2018 00:54:58 +0000 (20:54 -0400)]
Add cmake-verify job template

CMake verify job template for building CMake based projects.

Issue: RELENG-1074
Change-Id: Iccd3bab1d9f17071583a03e84b35bcd729161195
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Add Node / NPM cache & metrics to .gitignore"
Andrew Grimberg [Thu, 19 Jul 2018 15:02:02 +0000 (15:02 +0000)]
Merge "Add Node / NPM cache & metrics to .gitignore"

6 years agoAdd Best Practice for Shell scripts 29/11829/1
Thanh Ha [Wed, 18 Jul 2018 00:51:56 +0000 (20:51 -0400)]
Add Best Practice for Shell scripts

Change-Id: Ia6370964e34af94eceb9797596a048a5df3aea2a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd Node / NPM cache & metrics to .gitignore 28/11828/1
Thanh Ha [Wed, 18 Jul 2018 00:43:30 +0000 (20:43 -0400)]
Add Node / NPM cache & metrics to .gitignore

Change-Id: I7eaff8749e45c1699da0000ba4f446c4f37d3df8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix global-vars fail to instantiate instance 02/11802/1 v0.22.1
Thanh Ha [Mon, 16 Jul 2018 20:31:54 +0000 (16:31 -0400)]
Fix global-vars fail to instantiate instance

Not sure why this is suddenly a problem. Jenkins was not upgraded
as far as I am aware but adding Jenkins. seems to resolve the
issue we suddenly started seeing.

Change-Id: I76b7e01c7f1d377e7c4b63d5adde1b4fc29c6933
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd global-jjb v0.22.0 release notes 78/11778/3 v0.22.0
Thanh Ha [Fri, 13 Jul 2018 16:28:48 +0000 (12:28 -0400)]
Add global-jjb v0.22.0 release notes

Change-Id: I763e15fc63482d51a2f6a7878641c5738b881e30
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "project-pattern configurable for license-check"
Jessica Wagantall [Fri, 13 Jul 2018 16:39:30 +0000 (16:39 +0000)]
Merge "project-pattern configurable for license-check"

6 years agoMerge "Remove Unused Jenkins-Admin Groovy Scripts"
Thanh Ha [Fri, 13 Jul 2018 16:35:51 +0000 (16:35 +0000)]
Merge "Remove Unused Jenkins-Admin Groovy Scripts"

6 years agoproject-pattern configurable for license-check 69/11769/2
Thanh Ha [Thu, 12 Jul 2018 22:47:03 +0000 (18:47 -0400)]
project-pattern configurable for license-check

Allow the project-pattern to be configurable for the license-check
job. In an ideal world we would have have a single job that will
enforce for all projects but initially we will need flexibility to
allow us to adjust as we enforce against existing projects.

Change-Id: Ibf83868bacf520c69ef729566207ce7cc7ecf57e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge "Support recheck and reverify in global-jjb"
Andrew Grimberg [Fri, 13 Jul 2018 15:30:47 +0000 (15:30 +0000)]
Merge "Support recheck and reverify in global-jjb"

6 years agoPull default USER_DATA_ID from cloud.cfg 75/11775/1
Thanh Ha [Fri, 13 Jul 2018 15:11:15 +0000 (11:11 -0400)]
Pull default USER_DATA_ID from cloud.cfg

Sets the default USER_DATA_ID for minion templates to be
what is defined in cloud.cfg. If cloud.cfg does not define
one then default to "jenkins-init-script".

RELENG-1069
Change-Id: I135c9a6c1d0ee11e627a66d1cc87e60eb7db1b20
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSigul install location has changed 74/11774/1
Andrew Grimberg [Fri, 13 Jul 2018 01:06:48 +0000 (18:06 -0700)]
Sigul install location has changed

The location to install sigul from has changed since initial testing was
done.

Change-Id: I911d748aa662d68bcc1e4ecc304b04268dc995d7
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
6 years agoPull default KEY_PAIR_NAME from cloud.cfg 50/11750/1
Thanh Ha [Thu, 12 Jul 2018 17:38:03 +0000 (13:38 -0400)]
Pull default KEY_PAIR_NAME from cloud.cfg

Sets the default KEY_PAIR_NAME for minion templates to be
what is defined in cloud.cfg. If cloud.cfg does not define
one then default to "jenkins-ssh".

Issue: RELENG-1066
Change-Id: I72bddf861174139048e1843a3631b3998ac32bef
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAdd support for JNLP based minions 33/11733/3
Thanh Ha [Wed, 11 Jul 2018 18:14:59 +0000 (14:14 -0400)]
Add support for JNLP based minions

Issue: RELENG-939
Change-Id: I05a4fa92387425932bbc28cadadbb44acbc190bb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRevert "Print out OS Cloud Plugin version" 30/11730/1
Thanh Ha [Wed, 11 Jul 2018 16:59:26 +0000 (12:59 -0400)]
Revert "Print out OS Cloud Plugin version"

This reverts commit dfb2c6ca52a4c885e42d6c2252706bd824c75068.

Change-Id: If217ac6caf7b33c54e61d3a090c1062c666e63b9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoSupport recheck and reverify in global-jjb 05/10705/6
Aric Gardner [Thu, 17 May 2018 20:05:51 +0000 (16:05 -0400)]
Support recheck and reverify in global-jjb

In OPNFV we are using reverify as a convention (we also support recheck)
This was previously deprecated in global-jjb
But I'm adding it back to not confuse our users

Change-Id: Ie794636e49f97ff2ac2735e81c407b57a3470f55
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
6 years agoMake toxworkdir configurable and default to /tmp/v 28/11728/1
Trevor Bramwell [Wed, 11 Jul 2018 16:01:45 +0000 (09:01 -0700)]
Make toxworkdir configurable and default to /tmp/v

By default tox environment will now be installed under /tmp/v/{envname},
but configurable through the CLI environment by specifying TOX_WORK_DIR.

This will allow users dynamically specify where the toxworkdir should
live, like so:

> TOX_WORK_DIR=$(mktemp -d -t gjjb-XXX) tox -e ...

Change-Id: I3daa4dc3538c61fb80a464a1b7e07d7b48fd7a1c
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoDocument support for os-cloud-plugin 2.37 20/11720/1
Thanh Ha [Tue, 10 Jul 2018 23:15:35 +0000 (19:15 -0400)]
Document support for os-cloud-plugin 2.37

Change-Id: I4ea15a75d6f98ac95bf352fe0b7ca386e6874723
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoPrint out OS Cloud Plugin version 03/11703/1
Thanh Ha [Mon, 9 Jul 2018 23:09:12 +0000 (19:09 -0400)]
Print out OS Cloud Plugin version

Change-Id: I974667afb03f5aa4a00c4098ce93ca96c4a388ec
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix API breakage caused by OS Plugin version scan 01/11701/3
Thanh Ha [Mon, 9 Jul 2018 22:14:07 +0000 (18:14 -0400)]
Fix API breakage caused by OS Plugin version scan

Patch I3384c86c64c3aff7404ddec77aa85463e5fbac2a caused an unexpected
API change in get_minion_options which now requires a $silo
variable. However the change was not passed down to all instances
where the function was called causing breakage.

Change-Id: If4a0cec0232d1381413da3f6279f23bc426e1ace
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate build-timeout parameter documentation 99/11699/2
Trevor Bramwell [Mon, 9 Jul 2018 20:52:01 +0000 (13:52 -0700)]
Update build-timeout parameter documentation

All build-timeout documentation incorrectly lists seconds instead of
minutes, while the the license scanning jobs did not have build-timeout
documented, and the packer merge job had the wrong value listed.

Change-Id: I6e3f2b934bcda92fb14ab9cd996434ff83277408
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
6 years agoDocument support for OS Cloud plugin 2.36 48/11548/1
Thanh Ha [Mon, 25 Jun 2018 20:36:17 +0000 (16:36 -0400)]
Document support for OS Cloud plugin 2.36

Change-Id: I662e1a479f10d9040eb75dd5a29c0c0b25d0dcf8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoFix empty variable when run in Jenkins 47/11547/1
Thanh Ha [Mon, 25 Jun 2018 16:37:58 +0000 (12:37 -0400)]
Fix empty  variable when run in Jenkins

Change-Id: Ic6e2b1424e8e59611e021c4a506ba556e8e2111e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoMerge changes from topic '10422'
Andrew Grimberg [Sat, 23 Jun 2018 15:10:35 +0000 (15:10 +0000)]
Merge changes from topic '10422'

* changes:
  Enable ensure-documented check
  Document undocumented macros
  Document undocumented ci-jobs macros
  Document undocumented maven macros

6 years agoMerge "Document undocumented Python macros"
Andrew Grimberg [Sat, 23 Jun 2018 15:07:46 +0000 (15:07 +0000)]
Merge "Document undocumented Python macros"

6 years agoMerge "Add license check job using new lhc"
Andrew Grimberg [Sat, 23 Jun 2018 15:02:18 +0000 (15:02 +0000)]
Merge "Add license check job using new lhc"

6 years agoMerge "Add support for OS Plugin v2.35"
Andrew Grimberg [Sat, 23 Jun 2018 14:58:13 +0000 (14:58 +0000)]
Merge "Add support for OS Plugin v2.35"

6 years agoMerge "Use a more exact grep for fetching cfg options"
Andrew Grimberg [Sat, 23 Jun 2018 14:56:30 +0000 (14:56 +0000)]
Merge "Use a more exact grep for fetching cfg options"

6 years agoMerge "Global-JJB Jenkins scripts require recurse"
Thanh Ha [Sat, 23 Jun 2018 13:10:04 +0000 (13:10 +0000)]
Merge "Global-JJB Jenkins scripts require recurse"

6 years agoGlobal-JJB Jenkins scripts require recurse 37/11537/2
Andrew Grimberg [Sat, 23 Jun 2018 00:29:41 +0000 (17:29 -0700)]
Global-JJB Jenkins scripts require recurse

If a project is switching to using the global-jjb provided
jenkins-init-scripts then the clone that they need to do requires that
they do a submodule recurse clone.

Change-Id: I748205f58b016e27bdd1c95df6b67d47b16bb6aa
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>