Thanh Ha [Mon, 16 Oct 2017 02:05:02 +0000 (02:05 +0000)]
Merge "Migrate node-verify job to global-jjb"
Thanh Ha [Sun, 15 Oct 2017 19:03:02 +0000 (15:03 -0400)]
Add missing documentation to rtd jobs
Change-Id: I1e0f97f3824aef4c18c4975931b388a41686e8bd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 19:00:27 +0000 (15:00 -0400)]
Add missing documentation for Python jobs
Change-Id: I985f14b50187b70d5d12872318c68acfcca5378b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 18:57:29 +0000 (14:57 -0400)]
Add missing stream documentation to maven docs
Change-Id: I653707b9384c7b4170a53f738500bcecf72a8423
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 18:55:46 +0000 (14:55 -0400)]
Remove doc for unused parameter
Change-Id: If2d6d5ee2b6c7f6e221ff3499f3060cb018772f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 18:49:33 +0000 (14:49 -0400)]
Add missing documentation from maven jobs
Change-Id: I71b7774c01e8e7ddb0ac8768d9ec7b0e7714ddc7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 18:40:43 +0000 (14:40 -0400)]
Standardize gerrit_[merge|verify]_triggers
It turns out you can override per job definition inside of a projects
declaration so let's standardize the trigger wording so that they are
the same everywhere.
Change-Id: Id489a3b04242183a35d56bb938c66b4b486a1d1f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 15 Oct 2017 18:36:09 +0000 (14:36 -0400)]
Make staging-profile-id optional
Only the release job needs staging-profile-id so set a default of empty
for all other Maven templates.
Change-Id: Id53073377af415a0345f2aeef6637c5bb4a9d559
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 14 Oct 2017 19:52:03 +0000 (15:52 -0400)]
Sleep between 1 - 10 seconds for tox
Adds a random 1 - 10 second sleep to workaround parallel tox runs using
the same sdist directory to build a package and failing due to tripping
over itself.
Change-Id: I5054c839dabc3fac3cc814c08bc6568f99485d0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Tue, 3 Oct 2017 21:10:52 +0000 (07:10 +1000)]
Migrate node-verify job to global-jjb
Add a NodeJS verify job which uses nodeenv (Python project) to install
NodeJS and then runs `npm install` & `npm test`.
Issue: RELENG-241
Change-Id: Ia120cf804e530ab7d940b96d48ba6524fcf51f0f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 14 Oct 2017 15:05:38 +0000 (11:05 -0400)]
Bump Sphinx minimal dependencies to latest
Change-Id: I5c032ea889b7a17be9614516e3e51a2963b068c6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 14 Oct 2017 14:59:35 +0000 (10:59 -0400)]
Add LF Logo
Change-Id: Ia82ca35196630689f67f8b1b6fb5f2091a6e5c6d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sat, 14 Oct 2017 14:50:06 +0000 (10:50 -0400)]
Add custom navbar ala OpenDaylight docs
Change-Id: I2af32b6847a6dd1242efd6b9c320a22eff0d8d76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Fri, 13 Oct 2017 20:38:21 +0000 (13:38 -0700)]
Fix packer verify file path triggering
Packer verifies are not properly triggering because the generated ANT
paths are non-resolvable
Change-Id: I3938ca653ab0fba7190ea8caf3715bf7757be4f7
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Thanh Ha [Fri, 13 Oct 2017 17:29:33 +0000 (13:29 -0400)]
Fix cross link
Change-Id: I4eaefa4f8e0e64299a98f8bd1519831704be5fcb
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Oct 2017 17:45:35 +0000 (13:45 -0400)]
Move best practices to global-jjb
Change-Id: I0fb2743438658f775fd321cd27422ceee017be78
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 13 Oct 2017 17:29:33 +0000 (13:29 -0400)]
Bootstrap global-jjb docs
Just initialize the docs. Content to come in the next patch.
Change-Id: I2d85ee37e2fca3039b12438220401e6f24e69dbc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Fri, 13 Oct 2017 14:58:43 +0000 (07:58 -0700)]
Add more required Jenkins plugins
* Git plugin is required by all Jenkins systems using global-jjb
* Create new Gerrit and GitHub sections which details plugins that are
required for a Jenkins that services requests from that SCM service
Change-Id: If0f3f3a5bfd313aa15da96fd2247c9b1fe1b7c6a
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Thanh Ha [Fri, 13 Oct 2017 01:37:58 +0000 (21:37 -0400)]
staging-profile-id unnecessary for javadoc jobs
This parameter is not used at all in javadoc jobs so set to a blank
default so that projects do not have to define this if they want to use
the javadoc jobs.
Change-Id: If97fff08c72d32798cd724d84c29b9cdafe11c0d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Thu, 12 Oct 2017 21:45:17 +0000 (14:45 -0700)]
Update required plugins list
The Environment Injector Plugin is a required plugin for log shipping
purposes.
Change-Id: I71551c59291e4db69a5b9dc92a351f9449e9af13
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Vratko Polak [Fri, 6 Oct 2017 15:51:12 +0000 (17:51 +0200)]
Do not trigger on drafts before Publish
This way, uploading drafts will tie less resources.
Contributors can still recheck drafts manually
if they want them verified before hitting the Publish button.
Change-Id: Ifeddbb2fcde7d56b768ca8d31bcc3eeb1050ff1d
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Thanh Ha [Mon, 2 Oct 2017 21:34:58 +0000 (17:34 -0400)]
Fix unescaped * in if-statement
Change-Id: I8e45a1adc13f4da0e7386371678f6364670f5c38
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 29 Sep 2017 17:04:46 +0000 (13:04 -0400)]
Release global-jjb v0.9.0
Change-Id: If902162ff4a18828a23ab3dfedf05a70c7acdd79
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jeremy Phelps [Fri, 29 Sep 2017 12:29:42 +0000 (12:29 +0000)]
Merge "DO NOT hardcode mvn staging server id"
Jeremy Phelps [Fri, 29 Sep 2017 12:29:37 +0000 (12:29 +0000)]
Merge "Add maven-javadoc jobs"
Jeremy Phelps [Thu, 28 Sep 2017 19:22:43 +0000 (14:22 -0500)]
Add timed parameter to lf-maven-release anchor
Timed parameter is to specify a cron schedule
for the job to run.
Change-Id: Ic08983b4ceed2f05896471fa50797e0351e191f8
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Thu, 28 Sep 2017 17:34:36 +0000 (13:34 -0400)]
DO NOT hardcode mvn staging server id
This needs to be configured in defaults.yaml to get the right one.
Change-Id: I8d54118999eb912c3074c4bb2f9b5237bea93ebe
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 27 Sep 2017 18:31:23 +0000 (14:31 -0400)]
Add maven-javadoc jobs
Create jobs that run javadoc:aggregate to generate javadocs and publish
them to Nexus via the javadoc repo.
Issue: RELENG-482
Change-Id: I07f62abfdd3a63b48838d2421dacfc876c9a007c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jeremy Phelps [Thu, 28 Sep 2017 16:33:12 +0000 (16:33 +0000)]
Merge "Run tox envs separately and capture logs"
Andrew Grimberg [Thu, 28 Sep 2017 16:23:33 +0000 (16:23 +0000)]
Merge "RTD Merge job GTriggers should be overridable"
Thanh Ha [Fri, 25 Aug 2017 17:54:33 +0000 (13:54 -0400)]
Run tox envs separately and capture logs
Run the tox envlist as separate tox runs so that we can capture the logs
in separate files for easier troubleshooting.
This patch requires the vm to have the 'crudini' package installed.
Change-Id: I05e01668af6b84c38c10b24353a2157bfa8d5b23
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Tue, 19 Sep 2017 17:59:34 +0000 (13:59 -0400)]
Docs needs to be built from the $WORKSPACE
Otherwise it will build from the submodule because of the if-statement
above. This breaks the job in cases where a project has submodules.
Change-Id: I06d6291d3329da142ecdbebfb4ac1a866108ef0b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 17 Sep 2017 04:32:10 +0000 (00:32 -0400)]
RTD Merge job GTriggers should be overridable
Change-Id: I2193129790709c2232ebcd283e25cca8efb978e3
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Sun, 17 Sep 2017 04:32:10 +0000 (00:32 -0400)]
Fix RTD Verify job Gerrit Triggers
The verify job was incorrectly setup as a merge job trigger causing
RTD builds to not trigger as expected.
Change-Id: I2502eff209deb7b077e64c620c77d4ecbfbc9a8e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jeremy Phelps [Mon, 11 Sep 2017 22:32:14 +0000 (17:32 -0500)]
Fix bug that removed custom docker registry
Inadvertently removed the custom docker
param in an ealier bug fix that was not related.
Change-Id: Ie4f3673be8f636ee1200ed6c308a42a05078ae51
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Fri, 8 Sep 2017 01:40:56 +0000 (21:40 -0400)]
Add job to deploy to sandbox
This job allows a contributor to leave a comment for example
'jjb-deploy builder-jjb-*' to deploy a job (or several jobs if wildcards
are used) to the Jenkins Sandbox.
This allows jjb contributors to no longer have to install jjb on their
local systems in order to push the job to the Jenkins Sandbox.
ATTN: GitHub version of the job is untested and likely does NOT work as
currently designed.
Issue: RELENG-373
Change-Id: I4f26c640804a0b7db1a0087cbd805b9263821326
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 6 Sep 2017 23:23:28 +0000 (19:23 -0400)]
Add trigger for launching release job via comment
Allows the release job to be triggered via Gerrit / GitHub PR comment.
This allows contributors to initiate a release build without needing
permissions via Jenkins directly.
Issue: RELENG-426
Change-Id: I2c75f607cc57471afb49fa0347bb130af214ea4b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Thu, 7 Sep 2017 14:07:09 +0000 (14:07 +0000)]
Merge "Create job to lock|unlock branches via Gerrit"
Jeremy Phelps [Thu, 7 Sep 2017 00:20:08 +0000 (00:20 +0000)]
Merge "Allow project-pattern to be overridable"
Thanh Ha [Wed, 6 Sep 2017 23:56:29 +0000 (19:56 -0400)]
Remove rtd-project incorrectly labelled required
rtd-project is not a required parameter for the rtd-verify job. In fact
it's not used at all in the job.
Change-Id: Iea9ba7a6101c130e77d60cfb6536c9be7f12d5b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 6 Sep 2017 23:49:27 +0000 (19:49 -0400)]
Allow project-pattern to be overridable
While the ** pattern is good for global docs projects like the
OpenDaylight docs project. If projects have their own standalone
documentation such as lftools we need to be able to set project-pattern
to the exact project. This ensures that Gerrit won't start a lftools
build when a trigger happens on any other project in the Gerrit system.
Change-Id: I46c7d0d45eb7ea82230437648ff23e81baab07f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 30 Aug 2017 21:56:55 +0000 (17:56 -0400)]
Create job to lock|unlock branches via Gerrit
A contributor can leave a comment "lock|unlock branch" in Gerrit comment
which triggers a job to submit a patch to Gerrit for the project to lock
or unlock their branch.
Locking refers to removing the permission to click the Submit button in
the project's branch effectively disallowing new patches to be merged
into the repo. This job simply generates and submits a patch. A project
committer still needs to approve it.
Issue: RELENG-424
Change-Id: Id489d931037c76bdcad032ec44b0ce748bdffe81
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Tue, 5 Sep 2017 18:51:47 +0000 (18:51 +0000)]
Merge "Fix docker-login to conditionally use -e"
Jeremy Phelps [Tue, 5 Sep 2017 18:37:57 +0000 (13:37 -0500)]
Fix docker-login to conditionally use -e
The -e/--email flag was removed in docker version
17.06.0. Do not use if equal or less than that version.
Change-Id: I69335d8ff068fbb180de284317d02f21b8b7e552
JIRA: RELENG-452
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Thanh Ha [Tue, 5 Sep 2017 16:01:03 +0000 (12:01 -0400)]
Release global-jjb v0.8.0
Change-Id: Ife11163e99194bd9b43efee47f9601e3adbc5710
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Jeremy Phelps [Wed, 26 Jul 2017 21:25:05 +0000 (16:25 -0500)]
Generalize odl rtd jobs for global-jjb
Change-Id: I35bdd1629c4f1079131048a8a8f41f09949796ff
JIRA: RELENG-240
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Shashikumar Belur [Fri, 1 Sep 2017 04:10:24 +0000 (04:10 +0000)]
Merge "Add update-expected-xml call"
Anil Shashikumar Belur [Fri, 1 Sep 2017 04:08:48 +0000 (04:08 +0000)]
Merge "Add lf-pip-install macro to handle pypi packages"
Thanh Ha [Thu, 31 Aug 2017 21:43:32 +0000 (17:43 -0400)]
Add update-expected-xml call
Simplify the process of updating the expected-xml by adding a command to
tox.
Change-Id: I02a9f07272baab3fd0dd4407cdb0afb3ffd6e3c7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 31 Aug 2017 02:54:52 +0000 (22:54 -0400)]
Re-order maven jobs alphabetically
Change-Id: Ibc3d91e21d59614fc8e0ed3402e43b986a185759
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 30 Aug 2017 23:08:53 +0000 (19:08 -0400)]
Add lf-pip-install macro to handle pypi packages
This creates a generically reusable pip-install macro that can be used
to install pypi packages into a virtualenv. The script uses the first
package name from {pip-packages} as the name of the virtualenv it
creates.
Change-Id: Iabe4005efcb0a79af48d3c83d854f4e101414737
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Tue, 29 Aug 2017 16:04:13 +0000 (16:04 +0000)]
Merge "Fix tox-run.sh print statement"
Thanh Ha [Wed, 23 Aug 2017 23:15:38 +0000 (19:15 -0400)]
Migrate sonar job
This patch uses OpenDaylight Maven Sonar job as a base and modifies it
to be more generic for use in global-jjb.
Changes from original:
- Support overriding Sonar Gerrit Triggers.
- Use maven deploy goal rather than install. End result is the same but
deploy sends artifacts to a staging repo which we can check if needed.
Issue: RELENG-243
Change-Id: Ided78015ced8b2d4b42ed452b704e1fe65770a01
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 25 Aug 2017 17:42:53 +0000 (13:42 -0400)]
Fix tox-run.sh print statement
Change-Id: I11721f0e292cddfd7eb05c26866ed274fa7116c8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Tue, 29 Aug 2017 15:39:57 +0000 (15:39 +0000)]
Merge "Update .gitignore"
Anil Belur [Fri, 18 Aug 2017 23:03:11 +0000 (09:03 +1000)]
Dont prefix PATH with hash built-in command.
The changes are tested with the below job
https://jenkins.hyperledger.org/job/ci-management-packer-verify/4/console
Also supress wget verbose output.
Jira: releng-442
Change-Id: Icab1214c19e68346a84c37179a1d8c1540ffc657
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Thu, 24 Aug 2017 04:39:03 +0000 (14:39 +1000)]
Update .gitignore
Remove path/to/files not to ignore
Change-Id: I844cc63779c29f85f4d57e7a8bd180a30c9ad085
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 17:15:09 +0000 (13:15 -0400)]
Release global-jjb v0.7.0
Change-Id: Ia57686ff8dc8ca45048d81211463052a96ee7be9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 18 Aug 2017 19:22:27 +0000 (15:22 -0400)]
Add .jjb-test to tox jjb command
This directory needs to be explicitly added for tests to run when
calling `tox -e jjb`.
Change-Id: I38fc6fff2bab79d03298acff768ecffbb6c25c9a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 18 Aug 2017 19:10:27 +0000 (15:10 -0400)]
Revert "Exclude the jjb-test directory"
No longer necessary due to I9bd85a43d76cf1dfcb02e327f097cd6551366d1b.
This reverts commit
854da1e33dd03f1569d0766dbedda123dd5af4ea.
Change-Id: Iba0569d8fb1931af6dbacbd0bec8fd03b5d4e775
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 18 Aug 2017 18:56:32 +0000 (14:56 -0400)]
Move tests to .jjb-test
JJB by default ignores paths that start with '.' so take advantage of
that and move our tests there. This way end users do not need to make
any changes to their local environment to handle the new jjb-test
directory.
Change-Id: I9bd85a43d76cf1dfcb02e327f097cd6551366d1b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 16 Aug 2017 18:38:04 +0000 (14:38 -0400)]
Add all release notes up to date
Keeping a history for our release notes would be useful for folks to
understand what changes since the version they are currently using.
Change-Id: Ic0e06f742ec1609664329cdd70c809655d3c9db2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 16 Aug 2017 18:11:03 +0000 (14:11 -0400)]
Update expected-xml due to missing changes
The patch I52d05808f1f84fee37e41f68677136ee105ba48c was merged after
patch I165c8309d4aaded6830f21eea10bc5a64cad2dff so is missing the
lftools changes in it's expected-xml.
Change-Id: I6a524cf9a0ba4251e3e2b2ad1036de52c4f2a48b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Tue, 15 Aug 2017 15:17:07 +0000 (15:17 +0000)]
Merge "Migrate Maven Verify job template"
Anil Shashikumar Belur [Tue, 15 Aug 2017 00:38:19 +0000 (00:38 +0000)]
Merge "Verify JJB when global-jjb is updated"
Anil Shashikumar Belur [Tue, 15 Aug 2017 00:38:04 +0000 (00:38 +0000)]
Merge changes I7d7323b8,Ib796cfee
* changes:
Add default refspec reference
Refactor packer ci templates
Anil Shashikumar Belur [Tue, 15 Aug 2017 00:37:02 +0000 (00:37 +0000)]
Merge "Refactor jjb ci templates"
Thanh Ha [Mon, 14 Aug 2017 15:53:27 +0000 (11:53 -0400)]
Verify JJB when global-jjb is updated
Change-Id: Ic9b9bb7f8869a4580dc0f6c69290c1c76f96ecba
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 21:52:09 +0000 (17:52 -0400)]
Add default refspec reference
Missed this when we ported over the infra-parameters. Refspec should
default to refs/heads/{branch} so that a manual run of a job will always
work against the specified branch for verify jobs. Merge jobs ignore
this by defining a blank refspec.
Change-Id: I7d7323b85b61639eef0e1b4491d6ba94d934b714
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 21:26:32 +0000 (17:26 -0400)]
Refactor packer ci templates
Improve maintainability by refactoring some common code.
- Improve documentation
- Reorganize anchors for better maintainability
- Remove dependency on jjb_common anchor
(updates to jjb code should not not break packer code)
- Do not run packer merge jobs concurrently
(merge jobs should not be configured to run concurrently)
Change-Id: Ib796cfee44ae7b01b42ee400a04be79b243cac3b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 21:02:46 +0000 (17:02 -0400)]
Refactor jjb ci templates
- Add Documentation
- Rearrange anchors for improved maintainability
Change-Id: If69127cb4a26942bcc3f57c5bfc407964c817393
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 10 Aug 2017 20:54:34 +0000 (16:54 -0400)]
Migrate Maven Verify job template
This patch uses the OpenDaylight Maven Verify job as the original base
and modifies it to be more generically used in global-jjb.
Changes from original template:
- Support overriding the default Gerrit Triggers.
- Use the mvn deploy goal rather than install goal. End result is the
same only the job copies artifacts to a staging directory in case we
need it.
- File paths can now be overrided in case a project wants to be more
specific on which files to build against.
Issue: RELENG-244
Change-Id: I52d05808f1f84fee37e41f68677136ee105ba48c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 16:40:04 +0000 (12:40 -0400)]
Make lftools version configurable
Add a new global default variable 'lftools-version' which can be used to
specify a version of lftools to install.
Issue: RELENG-391
Change-Id: I165c8309d4aaded6830f21eea10bc5a64cad2dff
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 9 Aug 2017 20:48:11 +0000 (16:48 -0400)]
Add method to test dev versions of lftools
Can be used to test dev versions of lftools. Instructions are purposely
only documented in lftools install script such that end consumers of
global-jjb should not see this and do not need to know about it's
existance.
Issue: RELENG-362
Change-Id: I95605d578f0295edc34d6f782fb0a6b44b2f295a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 03:35:03 +0000 (23:35 -0400)]
Add Maven CLM tests
Change-Id: Ib38677b946f6b50c165a571cecd1ab93468afd78
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 03:26:57 +0000 (23:26 -0400)]
Remove lftools install step from clm job
Missed this in code review. The CLM job does not do anything with
lftools so it shouldn't waste cycles installing it.
Change-Id: I6ecb765c03f10a03397af7583cc2bde5c990b348
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 11 Aug 2017 02:48:56 +0000 (22:48 -0400)]
Reorganize template definition structure
Having maintained this repo for awhile we can now see some common
patterns emerge from our yaml structures. Typically for a given job
there is a common builder anchor followed by 2 template sections, 1
for Gerrit and 1 for GitHub. Plus some common macros / anchors that
may be used by multiple job types.
This patch reorganizes the structure to treat a set of
anchor-gerrit-github job definitions as a single job definition. This
allows us to keep the job template close to their anchor definition so
that looking up what the main anchor does will not cause as much back
scroll.
Additionally this patch refactors the confusingly named verify_merge
anchors to a more understandable 'common' name.
Change-Id: I95eb4609274ec21b50aef059b03ac4598894f671
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Thu, 10 Aug 2017 20:56:36 +0000 (20:56 +0000)]
Merge "Make Merge and Verify job triggers overrideable"
Thanh Ha [Thu, 10 Aug 2017 20:32:01 +0000 (16:32 -0400)]
Make Merge and Verify job triggers overrideable
This makes merge and verify jobs that use Gerrit Trigger be able to
override the default trigger defined by the job. This is useful in cases
where a project may have topic branches that they do not wish to
configure their build rules differently. For example in OpenDaylight the
NetVirt project has a need for topic branches but they don't want to
run testing against every patch submission in the topic branches and
would prefer to run them manually. This patch would allow them to
reconfigure the triggers in that case for the topic branch.
Based on a POC from:
https://git.opendaylight.org/gerrit/61385
Change-Id: Idf1d301572bb33f5b540f1011658cdd3f3fc69f5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 10 Aug 2017 03:43:41 +0000 (23:43 -0400)]
Fix python-tox incorrect default stream setting
Change-Id: Ief29e966267efac9634e51bec3c201c3ee4351c9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 9 Aug 2017 23:01:52 +0000 (19:01 -0400)]
Refactor tests into jjb-tests directory
Issue: RELENG-250
Change-Id: Idc2ddc9c28a8ab835b3558f4076305053ee43235
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 9 Aug 2017 23:24:01 +0000 (19:24 -0400)]
Exclude the jjb-test directory
When running jenkins-jobs we should exclude the jjb-test directory. That
way global-jjb can maintain tests in that directory while not affecting
users of global-jjb's tests jobs from picking up the tests.
Change-Id: I5101e4627291817d5cf9538f85a9f3db3e6d7b28
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Thu, 10 Aug 2017 03:17:12 +0000 (03:17 +0000)]
Merge "Generalize deploy maven-file builder"
Anil Belur [Sun, 6 Aug 2017 23:59:48 +0000 (09:59 +1000)]
Generalize deploy maven-file builder
The builder hard codes the URL path which makes the builder
limit deploy capabilites only to external nexus repos and not
local file systems.
The change fixes the above issue by allowing the calling job
to define the repository path.
ex:
"${NEXUS_URL}/content/repositories/$REPO_ID"
"file://$WORKSPACE/m2repo"
Renamed variables:
'files-dir' to 'upload-files-dir'
'nexus-url-path' to 'maven-repo-url'
'$NEXUS_URL_PATH' to '$MAVEN_REPO_URL'
Change-Id: If0beb7f6dff76c18988c9a75b52c80358f16dff6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Thu, 3 Aug 2017 21:23:32 +0000 (17:23 -0400)]
Add license header test for shell scripts
Add a test to check license headers exist in shell scripts.
Change-Id: I4f6f9874f79d55f5ab52b17a4dafa9d836f90d34
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Anil Belur [Thu, 3 Aug 2017 02:20:05 +0000 (12:20 +1000)]
Add timer to packer merge job to build new images
Change-Id: I5d3d76ba4350d71e051a3f1642060ebb0bd0aa2d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Wed, 2 Aug 2017 18:58:50 +0000 (18:58 +0000)]
Merge "Make packer-cloud-env variable configurable"
Anil Belur [Mon, 31 Jul 2017 05:30:30 +0000 (15:30 +1000)]
Make packer-cloud-env variable configurable
The packer-cloud-env can have a default in job templates but we should
allow it to be configurable in case a downstream consumer names their
configuration file differently.
Jira: releng-341
Change-Id: Ifc89dec39d3b93b75df58d8d37c7299a9dccf29d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Anil Belur [Tue, 1 Aug 2017 05:39:55 +0000 (15:39 +1000)]
packer should validate only .json files
Some of the projects could have README or .txt file
which should be excluded, without which packer validate
would fail.
Change-Id: I6cc388a851ae2731a113d47e3719da7edf519c63
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Thanh Ha [Wed, 2 Aug 2017 13:49:54 +0000 (13:49 +0000)]
Merge "Rename settings-file to mvn-settings"
Thanh Ha [Wed, 2 Aug 2017 13:42:40 +0000 (09:42 -0400)]
Rename settings-file to mvn-settings
I7970aae80a807e359dd34c52353007f13642fb01 did not rename the test
settings and caused some build failures.
Issue: RELENG-345
Change-Id: Ief9b45a000eb43600531a9ac923d12b4e4aa8c91
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Fri, 28 Jul 2017 01:00:31 +0000 (01:00 +0000)]
Merge "Pass common maven options to deploy file builder"
Thanh Ha [Wed, 26 Jul 2017 15:30:57 +0000 (11:30 -0400)]
Rename settings-file to mvn-settings in templates
For Maven Templates we should be using mvn-* when referring to settings
files (and any other variables provided by user related to mvn cli).
Issue: RELENG-345
Change-Id: I7970aae80a807e359dd34c52353007f13642fb01
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 26 Jul 2017 15:08:24 +0000 (11:08 -0400)]
Build CLM weekly on Saturdays
Change-Id: I92f7bf21f66d48f2f073a09e444f16b909d22c27
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 26 Jul 2017 14:43:36 +0000 (10:43 -0400)]
Fix GitHub CLM job-group
Incorrectly referred to a Gerrit job.
Change-Id: Id0a48befb5631ea4b192a81e15b0c57659e1b65e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 26 Jul 2017 03:32:36 +0000 (23:32 -0400)]
Add missing maven parameters to CLM job
lf-infra-maven-parameters expects some parameters to be passed to it.
Add the missing ones to the CLM job and set sensible defaults.
Change-Id: I7d5fe5e2c306dd988ba023c78b86ce32db1d30b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Thanh Ha [Wed, 26 Jul 2017 03:06:15 +0000 (23:06 -0400)]
Add missing stream declaration in clm job
Change-Id: Ie2e0540f79c10b0960405056d697a305c5520d27
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Tue, 25 Jul 2017 20:30:23 +0000 (13:30 -0700)]
Fix docker login for custom registry
Custom registry detection fails to be detected if the corresponding
Jenkins environment variable is not properly referenced.
Change-Id: I618836ca4e9364045b01c7d710ac00f359a1e025
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Anil Belur [Tue, 25 Jul 2017 03:01:23 +0000 (13:01 +1000)]
Set sensible default timeouts for packer jobs
Set the build timeout for verify job to 10 minutes and merge job
to 45 minutes based on evaluation of average build timeouts in
OpenDaylight's packer job runs.
https://jenkins.opendaylight.org/releng/view/packer
Change-Id: If97eab52f23952fd141888a7618b4bd8a502dd70
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Andrew Grimberg [Tue, 25 Jul 2017 13:22:49 +0000 (06:22 -0700)]
Remove unneeded JJB variable from packer templates
Gerrit Iaccaa906980eb077676a3dc4b9100a91ec65f8c0 /
commit
91d975d5c426a08e82d8a6bbe1e298fa82f2b7b5 removed an unneeded
variable from the packer scripts but it wasn't removed from the top
level macros.
Change-Id: I893e25429c5aab45fcabdf3853e752e2f12dcf36
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>