releng/lftools.git
7 years agoRe-organize functions alphabetically 71/5271/1
Thanh Ha [Wed, 21 Jun 2017 18:36:29 +0000 (14:36 -0400)]
Re-organize functions alphabetically

Missed this when we merged the maven-file code. L comes before M.

Change-Id: I46e0bbc622599ddf2ed2fa25e7dde4c9bb3bf54b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to 0.5.0-dev 67/5267/1
Thanh Ha [Wed, 21 Jun 2017 15:33:15 +0000 (11:33 -0400)]
Bump version to 0.5.0-dev

Change-Id: I064a1042799bfc46bf4d20970f4af6728715cf66
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools 0.4.0 66/5266/1 v0.4.0
Thanh Ha [Wed, 21 Jun 2017 15:29:58 +0000 (11:29 -0400)]
Release lftools 0.4.0

Noteable Changes:

e5c8909 Anil Belur      Add deploy maven-file command to lftools
b6a9961 Thanh Ha        Add a README to locate the online docs
7485330 Thanh Ha        Link deploy commands into commands index
032dbba Thanh Ha        Improve error detection for when SSL invalid

Change-Id: Ib8a8829f53e150bffb1c826b69bd7e3406cad033
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy maven-file command to lftools 87/5187/35
Anil Belur [Tue, 13 Jun 2017 00:24:27 +0000 (10:24 +1000)]
Add deploy maven-file command to lftools

The 'deploy maven-file' command uses mvn deploy-file goal
for deploying files to a nexus repository.

Credentials can be provided by settings.xml file in the following way
(order or precedence listed):

    1) User provides the settings file explicitly via -s parameter
    2) User provides the settings file via SETTINGS_FILE envvar
    3) User does not provide the file (default Maven location used)

Jira: releng-160
Change-Id: I0a3af408f70d7d2551a187ec3561b5e609e733d5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Link deploy commands into commands index"
Andrew Grimberg [Mon, 19 Jun 2017 21:17:54 +0000 (21:17 +0000)]
Merge "Link deploy commands into commands index"

7 years agoAdd a README to locate the online docs 92/5192/1
Thanh Ha [Tue, 13 Jun 2017 16:45:01 +0000 (12:45 -0400)]
Add a README to locate the online docs

Change-Id: Ie415e767bf2a1dc4a71b1cefe001002ae2041974
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoLink deploy commands into commands index 82/5182/1
Thanh Ha [Mon, 12 Jun 2017 19:52:40 +0000 (15:52 -0400)]
Link deploy commands into commands index

Change-Id: I5479625279e9be1c6c44eb27d3a0c7ec7f854f56
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove error detection for when SSL invalid 46/5146/2
Thanh Ha [Mon, 12 Jun 2017 00:37:00 +0000 (20:37 -0400)]
Improve error detection for when SSL invalid

If SSL cert is invalid we don't even reach the Nexus server. So add code
to check that status is 201 before proceeding.

Change-Id: Ic5c8a0ce4177f73e6f753001ee8bbc5fdf02956c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version for next dev cycle 42/5142/1
Thanh Ha [Sun, 11 Jun 2017 17:59:27 +0000 (13:59 -0400)]
Bump version for next dev cycle

Change-Id: Ie1d3ad6829c6e213a86e00ebb07b6f959c65b209
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.3.0 41/5141/1 v0.3.0
Thanh Ha [Sun, 11 Jun 2017 17:41:02 +0000 (13:41 -0400)]
Release lftools v0.3.0

Noteable changes:

3c498dc Thanh Ha        Add deploy nexus-stage command
c84a544 Thanh Ha        Add deploy nexus command
58a1793 Anil Belur      Report memory usage with sys-info
5529081 Trevor Bramwell Add Jenkins to LF Tools

Change-Id: I3b9866ac884e31f3869cdd0ae062afa8e695a386
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy nexus-stage command 33/5133/7
Thanh Ha [Fri, 9 Jun 2017 03:12:56 +0000 (23:12 -0400)]
Add deploy nexus-stage command

Use curl to deploy a staging repository to Nexus.

Jira: RELENG-120
Change-Id: Ibd6c25f4318264e5f3e96aeede1c7fe891c473b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy nexus command 55/5055/9
Thanh Ha [Wed, 31 May 2017 21:01:43 +0000 (17:01 -0400)]
Add deploy nexus command

Use curl to deploy a Maven repository to Nexus.

Jira: RELENG-121
Change-Id: If46e5054a2234eab77e7bd07120d8d0f11dfd293
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoReport memory usage with sys-info 32/5132/3
Anil Belur [Fri, 9 Jun 2017 03:42:51 +0000 (13:42 +1000)]
Report memory usage with sys-info

Earlier this was getting printed in the end of the console logs
which got missed out while porting to lftools.

Change-Id: Id7e59ecdc017c15ebbe1d540fa36eef19ced9d38
Co-Authored-By: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoEnsure shell scripts exit with proper status codes 36/5136/1
Thanh Ha [Fri, 9 Jun 2017 21:35:58 +0000 (17:35 -0400)]
Ensure shell scripts exit with proper status codes

Otherwise shell scripts called by lftools will return success which may
be incorrect.

Change-Id: I607dd7d5047da51446b953e27a9d48c31c16736c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Jenkins to LF Tools 66/4866/7
Trevor Bramwell [Fri, 12 May 2017 02:17:00 +0000 (19:17 -0700)]
Add Jenkins to LF Tools

Initial supported commands:

- jenkins builds running
- jenkins builds queued
- jenkins nodes list
- jenkins quiet-down
- jenkins plugins list
- jenkins plugins active
- jenkins plugins enabled
- jenkins plugins disabled
- jenkins plugins pinned
- jenkins plugins needs-update

Change-Id: I6f5e2601ed4eae76f3fd58422e8f7ea128f6e9f6
Signed-off-by: Trevor Bramwell <tbramwell@linuxfoundation.org>
7 years agoRemove unused variable 95/5095/1
Thanh Ha [Tue, 6 Jun 2017 16:37:45 +0000 (12:37 -0400)]
Remove unused variable

Change-Id: I94a45ef34c9cc2d108cb2e6e6fd7415298e63a1b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove lftools description to include dependencies 72/5072/1
Thanh Ha [Thu, 1 Jun 2017 21:53:46 +0000 (17:53 -0400)]
Improve lftools description to include dependencies

Change-Id: Ia9b757441ab7288ca7f02a0b58599c0333a5a4d1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version for next dev cycle 86/4986/1
Thanh Ha [Fri, 26 May 2017 15:06:24 +0000 (11:06 -0400)]
Bump version for next dev cycle

Change-Id: I1d796671b0a5130e5f671d727dea97de468d8429
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.2.0 85/4985/1 v0.2.0
Thanh Ha [Fri, 26 May 2017 15:04:11 +0000 (11:04 -0400)]
Release lftools v0.2.0

Change-Id: I9f8e9b45dc1483571257c80cd394c1eea03c8937
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoDO NOT version bump after tagging 71/4971/1
Thanh Ha [Wed, 24 May 2017 16:33:33 +0000 (12:33 -0400)]
DO NOT version bump after tagging

The patch command should only handle tagging. We'll be using a job for
automated version bumping moving forward.

Change-Id: If43c3099961401b46fa045583c138b070dbfd1a2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add artifact base target to nexus configuration"
Thanh Ha [Wed, 24 May 2017 00:15:44 +0000 (00:15 +0000)]
Merge "Add artifact base target to nexus configuration"

7 years agoAdd artifact base target to nexus configuration 65/4965/1
Andrew Grimberg [Wed, 24 May 2017 00:02:27 +0000 (17:02 -0700)]
Add artifact base target to nexus configuration

Projects should be able to push to $groupId.$artifactId.$extension as
well well as anything under that path. Not allowing this means that our
projects always are having to define a broken pom that may look like:

<groupId>org.example.artifactId</groupId>
<artifactId>artifactId</artifactId>

Which means they always end up deploying a base artifact at
$groupId.$artifactId.$artifactId in many cases.

Change-Id: I11a2bcebfe07d39251d85f92ab783c1a2ed5288c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoAdd openstack server list and cleanup commands 61/4861/4
Anil Belur [Mon, 15 May 2017 01:29:45 +0000 (11:29 +1000)]
Add openstack server list and cleanup commands

This adds 2 new commands to lftools to manipulate openstack servers:

    list:     Prints available servers in the cloud.
    cleanup:  Removes old servers from the cloud.

Change-Id: Ic9a99f8a5d13e040868f2271c1814ab82d9e0ac8
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAmend .gitignore for vscode editor 86/4586/1
Jeremy Phelps [Thu, 27 Apr 2017 14:32:31 +0000 (09:32 -0500)]
Amend .gitignore for vscode editor

Change-Id: I4852abfc79187f0f8b9d76cba116ecff6abfad45
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Add JJB best practices"
Andrew Grimberg [Wed, 26 Apr 2017 16:45:21 +0000 (16:45 +0000)]
Merge "Add JJB best practices"

7 years agoPin babel version 45/4445/1
Thanh Ha [Thu, 20 Apr 2017 15:17:55 +0000 (11:17 -0400)]
Pin babel version

Upstream released a new version of Babel which some requirements are
blocking. Pin it so that future updates like this don't break us.

Change-Id: I5681a7055e40655ef62c51e28f682d1832b37f4e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPrepare for next dev cycle 96/4396/1
Thanh Ha [Wed, 19 Apr 2017 02:42:19 +0000 (22:42 -0400)]
Prepare for next dev cycle

Change-Id: I5a99416a8e633691d81e41869e5aa9a5ab7ec43a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease v0.1.0 95/4395/1 v0.1.0
Thanh Ha [Wed, 19 Apr 2017 02:40:49 +0000 (22:40 -0400)]
Release v0.1.0

Change-Id: If0cd7890d12e21e60c95166a75e1f4807554002f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add deploy command to lftools"
Thanh Ha [Wed, 19 Apr 2017 02:39:45 +0000 (02:39 +0000)]
Merge "Add deploy command to lftools"

7 years agoPrevent PBR from getting installed 93/4393/1
Thanh Ha [Wed, 19 Apr 2017 02:17:36 +0000 (22:17 -0400)]
Prevent PBR from getting installed

openstacksdk's requirements.txt excludes PBR 2.1.0 and causes an install
issue if we pull it in. Let's also exclude it from our requirements.txt
too.

Change-Id: I5fb061ee794f93905b339582d82ad6613abf62f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd JJB best practices 46/4346/1
Thanh Ha [Mon, 17 Apr 2017 17:07:15 +0000 (13:07 -0400)]
Add JJB best practices

Provide some best practices around:

1) Declaring paramters in shell scripts
2) Usage of config-file-provider plugin

Change-Id: I81204e8e38f1997d95fd50788ace9e8b04215914
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy command to lftools 40/4340/4
Thanh Ha [Mon, 6 Mar 2017 22:59:38 +0000 (17:59 -0500)]
Add deploy command to lftools

Provides a generic script that can be used to deploy artifacts to a
Nexus site repository. Currently it is hardcoded to use a site repo
named "logs" but a future update can be implemented to allow this repo
to be configurable if necessary.

Provides 3 deploy commands:

archives)
  Deploys everything that exists in $WORKSPACE/archives if it exists.
  This needs to be provided by the job. Designed to run at the end of a
  Jenkins build.

logs)
  Deploys system information and build console logs. The script will
  handle all this. Designed to run at the end of a Jenkins build.

files)
  An arbitrary list of files passed by the user will be deployed to the
  logs server into an archives directory. Designed to be used inside of
  scripts at any time when the job needs to deploy anything to the
  server. This is an alternative to having to place all files inside an
  archives directory.

  (Unimplemented, will be implemented in a future patch)

Change-Id: Ie48f8c65d89fcdce2cc2619fa4bc3408b1e4d709
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix .gitreview to point to the correct place 71/4171/1
Andrew Grimberg [Mon, 3 Apr 2017 21:45:10 +0000 (14:45 -0700)]
Fix .gitreview to point to the correct place

Change-Id: I5672d64a556edd3095c36868881c01737cc355e8
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoPrepare for next dev cycle 38/4038/1
Thanh Ha [Thu, 16 Mar 2017 22:21:05 +0000 (18:21 -0400)]
Prepare for next dev cycle

Change-Id: I8fd9d11c7e762eb543acb1d224ad969eddc0a7d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease v0.0.10 39/4039/1 v0.0.10
Thanh Ha [Thu, 16 Mar 2017 15:47:13 +0000 (11:47 -0400)]
Release v0.0.10

Change-Id: If9968695ad9161b692bae32209a4e6578197525a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd minimum setuptools version 40/4040/1
Thanh Ha [Thu, 16 Mar 2017 15:46:54 +0000 (11:46 -0400)]
Add minimum setuptools version

Change-Id: Ifd8d5df39813473d78df7b90b177e2cf18f1f918
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to next dev version 41/4041/1
Thanh Ha [Wed, 15 Mar 2017 21:15:14 +0000 (17:15 -0400)]
Bump version to next dev version

Change-Id: Ib7ab5ca47079e94fb505eddf58c7fa49fe732d32
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease v0.0.9 42/4042/1 v0.0.9
Thanh Ha [Wed, 15 Mar 2017 20:56:41 +0000 (16:56 -0400)]
Release v0.0.9

Change-Id: I3402f74baff9114cfbac8ee77cc9b08ed64cf7ad
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPrevent requests 2.13.0 from being installed 43/4043/1
Thanh Ha [Wed, 15 Mar 2017 20:54:04 +0000 (16:54 -0400)]
Prevent requests 2.13.0 from being installed

Looks like 2.13.0 was released and one of our dependencies does not like
it. Disable it in our requirements.txt file.

Change-Id: I0f42444809089d9c3249bbe9b9565ae3e96eca3c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix syntax error 44/4044/1
Thanh Ha [Wed, 15 Mar 2017 20:41:43 +0000 (16:41 -0400)]
Fix syntax error

Change-Id: I1e23893fd3ae4520640b898dd7d6774c36e6fdc1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump dev version and update description 45/4045/1
Thanh Ha [Wed, 15 Mar 2017 20:36:35 +0000 (16:36 -0400)]
Bump dev version and update description

Change-Id: I3a08fb1ec307456313239cc7702d9e0e2d4ee01b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add openstack image list and cleanup cmds" v0.0.8
Andrew Grimberg [Tue, 14 Mar 2017 15:32:36 +0000 (15:32 +0000)]
Merge "Add openstack image list and cleanup cmds"

7 years agoAdd openstack image list and cleanup cmds 47/4047/7
Thanh Ha [Fri, 10 Mar 2017 02:51:46 +0000 (21:51 -0500)]
Add openstack image list and cleanup cmds

This adds 2 new commands to lftools to manipulate openstack images:

    list:     Prints available images in the cloud.
    cleanup:  Removes old unused images.

Also fix ctx not getting passed properly to the cli function.

Change-Id: I5c73964f33f4fccb56684910fb08828c747fa562
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd docs on how to setup coala 48/4048/2
Thanh Ha [Fri, 10 Mar 2017 19:16:37 +0000 (14:16 -0500)]
Add docs on how to setup coala

Change-Id: I7816fcf0e4aa94c2cde6007f51f5ed1560f4c51e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUse PEP8Bear 49/4049/2
Thanh Ha [Fri, 10 Mar 2017 19:32:25 +0000 (14:32 -0500)]
Use PEP8Bear

Looks like we forgot to configure the PEP8Bear. PEP8Bear also handles
space consistency so let's leave that job to PEP8Bear for Python files
instead.

Change-Id: I7f582a2202a33d7f8ea0d737befecde9f1842805
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoReorg .coafile for better handling of bears 50/4050/1
Thanh Ha [Fri, 10 Mar 2017 18:54:44 +0000 (13:54 -0500)]
Reorg .coafile for better handling of bears

Change-Id: I300128fa181ccd326f0626789f454fc8e5ed0f98
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add .editorconfig"
Thanh Ha [Thu, 9 Mar 2017 02:40:14 +0000 (02:40 +0000)]
Merge "Add .editorconfig"

7 years agoConvert project_builder code to lftools 53/4053/4
Thanh Ha [Tue, 7 Mar 2017 04:59:03 +0000 (23:59 -0500)]
Convert project_builder code to lftools

Change-Id: Ie06569e69570065817a7fc2e96fa2e0930e4b2ed
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoReformat lftools cmd docs for sphinx and click 52/4052/1
Thanh Ha [Wed, 8 Mar 2017 04:16:52 +0000 (23:16 -0500)]
Reformat lftools cmd docs for sphinx and click

Sphinx and Click have very different docstring formats unfortunately
which makes it difficult for us to share the same documentation in both
places without breaking the format of the other. This patch proposes a
compromise where we use sphinxcontrib-programoutput to copy the output
of Click --help documentation and place it inside of Sphinx. Not the
best but ensures we only write documentation once.

This patch also fixes the documentation for the Version command as it
was inaccurate or misleading in some places.

Also disable PyDocLint rule for backslashes since Click uses \b as a
keyword for text wrapping.

Change-Id: Ica09079d339065912fb5a78dccb24ee9a3063abc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRemove Contributor list 55/4055/1
Thanh Ha [Tue, 7 Mar 2017 16:53:37 +0000 (11:53 -0500)]
Remove Contributor list

We can get the contributor list to a file by checking git-log which
would provide more accurate data anyway.

Change-Id: I538c205021e08f1fa3c7faf9d2957c648f362b07
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRun tests against both Python 2 and Python 3 56/4056/1
Thanh Ha [Mon, 6 Mar 2017 20:48:28 +0000 (15:48 -0500)]
Run tests against both Python 2 and Python 3

Change-Id: I00526b5111147e5c2a26b82766dfb3e6e2777508
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd .editorconfig 51/4051/1
Thanh Ha [Mon, 6 Mar 2017 19:17:52 +0000 (14:17 -0500)]
Add .editorconfig

Change-Id: I75e7e1baaf03a05e2bf97fe2cbc8735d6a280dd2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoNexus2 and Gerrit project builder 57/4057/5
Andrew Grimberg [Mon, 13 Feb 2017 14:17:03 +0000 (06:17 -0800)]
Nexus2 and Gerrit project builder

Initial checkin of project build system for Nexus 2 and Gerrit

The script currently does the following:

* takes 2 yaml files (see examples) for configuration
  - settings.yaml == administrative / global settings
  - config.yaml == repository structure to build including nexus
    passwords
* Walks config.yaml for all repositories and creates targets,
  privileges, roles and users based upon our standard configuration

Presently does not create the Gerrit repositories

* Staging repo re-ordering hack script

NOTE: This does not work against Nexus 3 as the REST API has been
removed in Nexus 3. Presently scripting Nexus 3 requires groovy

Change-Id: Ia06444a85e167a1e5685f9e569322c9b0e0b8c97
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoUnify versions to a single location 58/4058/1
Thanh Ha [Mon, 6 Mar 2017 17:35:36 +0000 (12:35 -0500)]
Unify versions to a single location

setup.py and conf.py have their own version definition. This patch
makes them both point to the same truth for versioning.

Change-Id: Ie8633bf6ddcb51cfbc31566f07fbdd5d26ab05b0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd patch-odl-release as a subcommand of version 59/4059/3 v0.0.7
Thanh Ha [Mon, 6 Mar 2017 03:57:24 +0000 (22:57 -0500)]
Add patch-odl-release as a subcommand of version

This patch makes patch-odl-release be less specific to the OpenDaylight
project in case other projects might want to use it in the future. It
also moves it into the version tool as a sub-command.

Refactor cli code around to make it easier to manage version
subcommands.

Change-Id: I100927195f61c33584219445a9dfac1e3e59ceab
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix archives script "File exists" spam 60/4060/1
Thanh Ha [Mon, 6 Mar 2017 05:13:28 +0000 (00:13 -0500)]
Fix archives script "File exists" spam

The archive scripts has a bug that causes it to spam "File exists" at
the end of a log. This patch improves the script to handle this a little
better.

Change-Id: I61e939e74d7ab9c5f87a83cebd96ce886927bc88
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake create version tests easier 61/4061/1
Thanh Ha [Mon, 6 Mar 2017 00:30:23 +0000 (19:30 -0500)]
Make create version tests easier

This patch allows version tests to simply be placing files into a
directory and comparing the test results from an input pom and an
expected pom.

Also add a test to validate bump order.

Change-Id: Ide4da6f721223bc4d3edab79db9008e4cae730c6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix RTD generation of Shell docs 62/4062/1
Thanh Ha [Sun, 5 Mar 2017 04:57:57 +0000 (23:57 -0500)]
Fix RTD generation of Shell docs

Change-Id: Ieec4b6695610d7a2a53727cd8c5680b34cf647a9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix RTD generation of Shell docs 63/4063/1
Thanh Ha [Sun, 5 Mar 2017 04:56:05 +0000 (23:56 -0500)]
Fix RTD generation of Shell docs

Not sure if this exactly fixes it but have to merged to test.

Change-Id: I949fb80cd5031dc1a4bff3732ac75d09e6f09c6d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease version 0.0.6 64/4064/1 v0.0.6
Thanh Ha [Sun, 5 Mar 2017 04:43:20 +0000 (23:43 -0500)]
Release version 0.0.6

Change-Id: I7c4d8d12294968017ea1c668eb55047b0d8c582c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd unit tests for version script 65/4065/1
Thanh Ha [Sun, 5 Mar 2017 04:20:39 +0000 (23:20 -0500)]
Add unit tests for version script

Adds unit tests for the version script to ensure it works in the use
cases OpenDaylight requires the script for. Unit Tests run against
Python 3 as we are only supporting Python 3 for lftools at the moment.

- Fix version script not running 'release' command
- Add pytest
- Test version script for 3 use cases:
    1) Version bump for release
    2) Version bump by x.y.(z+1) post release
    3) Version bump by x.(y+1).z

Change-Id: Ib36d9a84e2769863083400c434e1539b302869a8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Python linting in coala 66/4066/1
Thanh Ha [Sun, 5 Mar 2017 02:36:58 +0000 (21:36 -0500)]
Add Python linting in coala

- Add Git Commit Bear to validate commit message
- Make tox automatically download nltk data for GitCommitBear
- Add Python Bears to validate Python code

Change-Id: Ib50fa4ecaf282a751de38f149bf1e2992463a5f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix shellcheck issues in deploy-archives script 67/4067/1
Thanh Ha [Sun, 5 Mar 2017 01:59:34 +0000 (20:59 -0500)]
Fix shellcheck issues in deploy-archives script

Change-Id: I2bfaad163292a5689c2c65946e2b3e6e80929117
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoCreate lftools cli 68/4068/3
Thanh Ha [Sun, 5 Mar 2017 01:06:56 +0000 (20:06 -0500)]
Create lftools cli

lftools cli becomes a wrapper for Shell scripts as well as a cli for
lftools Python components. Use the 'version' script as a starting point.

This patch also:

* Initializes automated Shell docs
* Improves version script to be callable from lftools cli

Change-Id: I21c7997745af0d3852d5b86d928832e7a8486fa4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoConvert version bump script to functions 69/4069/2
Thanh Ha [Sat, 4 Mar 2017 23:52:16 +0000 (18:52 -0500)]
Convert version bump script to functions

Convert the version bump script to functions so that it can be sourced
and reused more easily.

Change-Id: I09dde2c7e51b6dc8b70bb5befbe22d1fdb947903
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMove deploy-archives script into shell dir 70/4070/1
Thanh Ha [Sat, 4 Mar 2017 23:49:07 +0000 (18:49 -0500)]
Move deploy-archives script into shell dir

Change-Id: I35a0a732c6431c656a2a33d74916946e78acdaca
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoCreate a git status report at the end of build 71/4071/1
Thanh Ha [Wed, 8 Feb 2017 20:29:43 +0000 (15:29 -0500)]
Create a git status report at the end of build

git-status report can be useful at the end of a build to identify
projects that left their project repo either with modified files or
untracked files.

Change-Id: I3f9f9c01991699574e1a9ca81885728117144b26
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake message more clear 72/4072/1
Thanh Ha [Thu, 26 Jan 2017 22:43:40 +0000 (14:43 -0800)]
Make message more clear

Change-Id: Ib10b7dc474b8411419d8e809e2d87c8341b60125
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoReduce verbosity of shiplogs 73/4073/1
Thanh Ha [Mon, 23 Jan 2017 14:57:09 +0000 (09:57 -0500)]
Reduce verbosity of shiplogs

The end of a build there's a lot of download details from wget. This
patch aims to reduce that unnecessary verbosity. We will still get
error messages / success messages just not the download status of wget.

Change-Id: I10b9cffc6b74abc6fe2dd7f90924498b9f99197f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFilter out bad environment variables 74/4074/1
Thanh Ha [Tue, 10 Jan 2017 20:07:42 +0000 (15:07 -0500)]
Filter out bad environment variables

Change-Id: Id0631226ac1ebd433ff72d079b598e43e1f4f660
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPrefix timestamps on archived console logs 75/4075/1
Anil Belur [Tue, 6 Dec 2016 08:54:02 +0000 (18:54 +1000)]
Prefix timestamps on archived console logs

Time stamper plugin adds time stamps only to the jobs console logs,
which is unavailble on the archived console logs. This change fixes
the issue using the paste command.

Change-Id: Idc08840622a62dc679b0030554cfb4377472d726
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRename _console-output.log to console.log 76/4076/1
Thanh Ha [Wed, 19 Oct 2016 17:34:04 +0000 (13:34 -0400)]
Rename _console-output.log to console.log

This allows someone to take a url like:

https://jenkins.opendaylight.org/releng/job/example-job/253/console

and convert it to

https://logs.oopendaylight.org/releng/jenkins092/example-job/253/console

and be able to expect to see the console logs despite the BASE_URL
changing.

Change-Id: I093f851f816cc71a55cbadbfd085b58baa289835
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRedirect zip logs to file and store on logs.o.o 77/4077/1
Thanh Ha [Sat, 15 Oct 2016 01:01:40 +0000 (21:01 -0400)]
Redirect zip logs to file and store on logs.o.o

The zip logs take a lot of the console log lines at the end of a build.
The output might be useful for troubleshooting so lets redirect the
output to a file and store it in logs.opendaylight.org instead of
outputting it to the Jenkins console logs directly.

Change-Id: Ie56d2a5348c9a55854199539e647f21894febe68
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoGzip *.bundle files in archives/patches 78/4078/1
Anil Belur [Wed, 14 Sep 2016 08:53:37 +0000 (18:53 +1000)]
Gzip *.bundle files in archives/patches

Change-Id: I3a3b0ea61d5729c538403bc912a01acfd1aeced7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoEnable system stats for archive-build macro 79/4079/1
Anil Belur [Fri, 19 Aug 2016 06:37:17 +0000 (16:37 +1000)]
Enable system stats for archive-build macro

Change-Id: I828ff5053d6957e54362ecb50616ba0bdd790046
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoChange log servers and url to support parameter 80/4080/1
Sandra Biton [Thu, 18 Aug 2016 09:19:05 +0000 (12:19 +0300)]
Change log servers and url to support parameter

Provide a default value for OpenDaylight.

Change-Id: Ifeaad654884d1730f4f3ea46aa5d8ca5730d26e4
Signed-off-by: Sandra Biton <sandra.biton@hpe.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoJob for bindingv1 suite 81/4081/1
Vratko Polak [Tue, 26 Jul 2016 12:15:37 +0000 (14:15 +0200)]
Job for bindingv1 suite

Change-Id: Ic0d539f44e476b98dc40ad239fb7e44bc4dd547c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoWrap ARCHIVE_ARTIFACTS variable with quotes and braces 82/4082/1
Thanh Ha [Thu, 14 Jul 2016 02:33:37 +0000 (22:33 -0400)]
Wrap ARCHIVE_ARTIFACTS variable with quotes and braces

Otherwise certain glob patterns are parsed incorrectly in the
if-statement.

Change-Id: I288b31fd483553ba151645ecd4164ef0684d40d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove archive-build macro to gzip any text file 83/4083/1
Anil Belur [Tue, 12 Jul 2016 05:55:08 +0000 (11:25 +0530)]
Improve archive-build macro to gzip any text file

Change-Id: I5a782147ec7f11fa353fbf01ea6d7fc117757346
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove archive-build to archive using globstar 84/4084/1
Thanh Ha [Mon, 11 Jul 2016 20:42:11 +0000 (16:42 -0400)]
Improve archive-build to archive using globstar

Allows us to use **/*.xml for example as the archive parameter.

Change-Id: I5a92e198999a3db31fedc23e65f4c5315561f93c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPrint out environment variables to file 85/4085/1
Thanh Ha [Wed, 6 Jul 2016 00:30:24 +0000 (20:30 -0400)]
Print out environment variables to file

The environment variable list could be useful in troubleshooting so
paste it out at the end of the build.

Change-Id: Ibf3abed0f71c73269aa077ebe9dd7ea8bc35faad
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix archiving script to trim the end of the log file 86/4086/1
Thanh Ha [Wed, 6 Jul 2016 00:27:10 +0000 (20:27 -0400)]
Fix archiving script to trim the end of the log file

Because the console log is still running while we are downloading it to
archive to logs.opendaylight.org it ends abruptly and causes confusion.
This patch trims the log so it will have a natural end to it's log.

Change-Id: Ic68828d2209a1c95e3c8282a82bc12f3138105a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoPrint size of archives.zip 87/4087/1
Thanh Ha [Tue, 28 Jun 2016 02:03:20 +0000 (22:03 -0400)]
Print size of archives.zip

Change-Id: I9d73d1849fe43c5d0d800a41d7c619ecc8decf62
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRework archives directory format 88/4088/1
Thanh Ha [Mon, 27 Jun 2016 18:18:06 +0000 (14:18 -0400)]
Rework archives directory format

Change-Id: I9318ffa2a06b3a918263eb678a75ad700f7171f0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRemove Gerrit notification script 89/4089/1
Thanh Ha [Mon, 27 Jun 2016 16:37:49 +0000 (12:37 -0400)]
Remove Gerrit notification script

It seems ssh-agent is not passed to publishers so will have to rework
this code to run as a builder step in a later patch.

Change-Id: I856468e91087ce39ea24308ad864dd45c500fc85
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd macro to deploy archives to Nexus 90/4090/1
Thanh Ha [Mon, 13 Jun 2016 04:05:35 +0000 (00:05 -0400)]
Add macro to deploy archives to Nexus

Requires the Description Setter plugin:
https://wiki.jenkins-ci.org/display/JENKINS/Description+Setter+Plugin

Change-Id: Ibc3d4a74416995b699e420864626dabd8a3c0658
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd SpaceConsistencyBear 91/4091/1
Thanh Ha [Sat, 4 Mar 2017 18:25:21 +0000 (13:25 -0500)]
Add SpaceConsistencyBear

Enforce spaces instead of tabs and 4 space indents.

Change-Id: I0e977f5206ebbb3f9962c463e4ddf23bb767c5ae
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUse coala got run ShellCheck 92/4092/1
Thanh Ha [Sat, 4 Mar 2017 18:20:16 +0000 (13:20 -0500)]
Use coala got run ShellCheck

Change-Id: I7ea7346fb2cacb5310293a3b2dbdc1e6261dbab0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRun shellcheck by default with tox 93/4093/1
Thanh Ha [Sat, 4 Mar 2017 18:05:36 +0000 (13:05 -0500)]
Run shellcheck by default with tox

Change-Id: I8908346b168dbc21831538e5f64ab438ec693f30
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd ShellCheck to tox 94/4094/1
Thanh Ha [Sat, 4 Mar 2017 18:04:21 +0000 (13:04 -0500)]
Add ShellCheck to tox

Change-Id: Ib76fe08933a360a3e676ea6f825934c1f6f830c9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix ShellCheck for patch-odl-release 95/4095/1
Thanh Ha [Sat, 4 Mar 2017 18:04:04 +0000 (13:04 -0500)]
Fix ShellCheck for patch-odl-release

Change-Id: Ief138884ec71f2d5713dae7c2f71b7247052be08
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoSet minimum theme requirements 96/4096/1
Thanh Ha [Sat, 4 Mar 2017 17:49:17 +0000 (12:49 -0500)]
Set minimum theme requirements

Change-Id: I089c105f75cf01650e7a56e28901495671a10560
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoInitialize lftools docs 97/4097/1
Thanh Ha [Sat, 4 Mar 2017 17:32:26 +0000 (12:32 -0500)]
Initialize lftools docs

Change-Id: I613285e42f7213f8fc43deb00392f1017b249a00
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd basic setup.py 98/4098/2
Thanh Ha [Sat, 4 Mar 2017 17:04:58 +0000 (12:04 -0500)]
Add basic setup.py

Initialize lftools as a project on pypi.

Change-Id: I901ecd512a856f2693da773ae08861ca1bfbf7c8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd a fairly basic .gitignore 99/4099/1
Andrew Grimberg [Mon, 13 Feb 2017 13:54:53 +0000 (05:54 -0800)]
Add a fairly basic .gitignore

Change-Id: Iabcd042ddc733a12fdd766dcbdcd3fddde735279
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoBump versions also in repo-pom.xml files 00/4100/1
Vratko Polak [Wed, 12 Oct 2016 12:01:46 +0000 (14:01 +0200)]
Bump versions also in repo-pom.xml files

This is needed for https://git.opendaylight.org/gerrit/46822
to pass validation.

Change-Id: I120cf4a59ca2d26ee02df4833ed6d4d263b3eeee
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove release script to handle new release workflow 01/4101/1
Thanh Ha [Fri, 19 Aug 2016 04:20:18 +0000 (00:20 -0400)]
Improve release script to handle new release workflow

See:
https://lists.opendaylight.org/pipermail/release/2016-June/006771.html

Change-Id: Iae9f5940c5eb2fe6024005843e2a966f593909f5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix version.sh to handle date-only version correctly 02/4102/1
Colin Dixon [Tue, 9 Aug 2016 16:55:13 +0000 (12:55 -0400)]
Fix version.sh to handle date-only version correctly

Change-Id: I402067a5db99f69866f9d919643f660e8218bcfd
Signed-off-by: Colin Dixon <colin@colindixon.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix version.sh to handle date-based versions correctly 03/4103/1
Colin Dixon [Tue, 9 Aug 2016 16:32:16 +0000 (12:32 -0400)]
Fix version.sh to handle date-based versions correctly

Change-Id: Ide6fbf329f72f53c4afb6782dedd1a6a5208ac68
Signed-off-by: Colin Dixon <colin@colindixon.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUpdate bumping script to merge from git bundles 04/4104/1
Thanh Ha [Wed, 8 Jun 2016 21:26:27 +0000 (17:26 -0400)]
Update bumping script to merge from git bundles

Change-Id: Ia44a4e037eb218eda0be4ebcbf8f946704c9f0de
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>