releng/lftools.git
6 years agoMerge "Fix wget command for Nexus sign script"
Thanh Ha [Wed, 3 Jan 2018 19:40:13 +0000 (19:40 +0000)]
Merge "Fix wget command for Nexus sign script"

6 years agoFix wget command for Nexus sign script 73/7573/3
Jessica Wagantall [Thu, 16 Nov 2017 03:57:54 +0000 (19:57 -0800)]
Fix wget command for Nexus sign script

Add --level=15 to wget command that fetches the
autoreleases from Nexus. Looks like the previous
command wasn't fetching all the artifacts in the
autorelease tree.

Change-Id: Ieb49331d7b192187ba2e6783b334d90c6477503e
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
6 years agoPrint CPU, Memory, Disk and Network stats 46/8046/1
Anil Belur [Mon, 18 Dec 2017 21:58:33 +0000 (07:58 +1000)]
Print CPU, Memory, Disk and Network stats

Print sar CPU, Memory, Disk, Network statistics at end of console log

JIRA: RELENG-672
Change-Id: I42aae6a07a91e7a666b28fcd027a5c0a91a8e64c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
6 years agoBump version to v0.12.0-dev 18/7918/1
Thanh Ha [Mon, 11 Dec 2017 17:59:57 +0000 (12:59 -0500)]
Bump version to v0.12.0-dev

Change-Id: I37dfe4d790490aa3d40216c7034c77f3d830a5a0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoRelease lftools v0.11.0 17/7917/1 v0.11.0
Thanh Ha [Mon, 11 Dec 2017 17:46:11 +0000 (12:46 -0500)]
Release lftools v0.11.0

Change-Id: If40b6319e21f6d42eb770a22de2b93677a6eb87f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoAutomatically hide protected images 87/7887/2
Thanh Ha [Sat, 9 Dec 2017 01:45:25 +0000 (20:45 -0500)]
Automatically hide protected images

We are not able to delete protected images so automatically filter
them out of our results.

Issue: RELENG-705
Change-Id: Id7fa5ab73ec912aac9b04dfb30c29492320402f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
6 years agoUpdate openstack cmd to support ci_managed filter 86/7886/2
Thanh Ha [Sat, 9 Dec 2017 01:40:13 +0000 (20:40 -0500)]
Update openstack cmd to support ci_managed filter

Add support for filtering ci_managed metadata when querying for
images.

Issue: RELENG-705
Change-Id: I9570a0683e1d87547bda8fc6741369549450045e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoSuppress GNU parallel notice on every run 41/7541/3
Anil Belur [Wed, 15 Nov 2017 05:23:16 +0000 (15:23 +1000)]
Suppress GNU parallel notice on every run

By default the notice is output on every run, therefore
use the `--no-notice` option to supress the output.

Change-Id: Id1dbe7b8daee390c886486eeb3c4c3c436fc26e4
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAdd a snapshot mode to the deploy-nexus command 21/7221/1
Thanh Ha [Wed, 1 Nov 2017 18:28:03 +0000 (14:28 -0400)]
Add a snapshot mode to the deploy-nexus command

This is necessary for RELENG-61 in order to allow pushing
maven-metadata.xml files which in the case of release jobs should not be
allowed. So add an option to the deploy-nexus command to allow an
exception for snapshot artifacts.

Issue: RELENG-173
Change-Id: I6f086bd0987502c5a967ab0b6f313ac405ceabc5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFail gracefully when no files to sign 31/6931/2
Thanh Ha [Tue, 17 Oct 2017 02:14:01 +0000 (22:14 -0400)]
Fail gracefully when no files to sign

Fixes issue where if there are no files to sign detected the script just
hangs indefinitely. Instead if the files_to_sign array is empty then
exit 1 and inform user.

Change-Id: I82a5957faedfe739800305a8224fed67d2c74801
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUse parallel to sign when available 30/6930/2
Thanh Ha [Tue, 17 Oct 2017 01:45:02 +0000 (21:45 -0400)]
Use parallel to sign when available

Speed up the signing process by using parallel when available.

Change-Id: I8a4bebde397b59491039ef6591796f3bfb1db2e8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to v0.11.0-dev 17/6917/1
Thanh Ha [Mon, 16 Oct 2017 18:51:34 +0000 (14:51 -0400)]
Bump version to v0.11.0-dev

Change-Id: Ia83890a4ee3c2119d18d6e50845e07b487068002
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.10.0 84/6884/2 v0.10.0
Thanh Ha [Sun, 15 Oct 2017 18:08:36 +0000 (14:08 -0400)]
Release lftools v0.10.0

Change-Id: I0e203548adad9057d58d7893ba86eb594cdddfea
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRename docs requirements for better sorting 80/6880/2
Thanh Ha [Sat, 14 Oct 2017 15:57:33 +0000 (11:57 -0400)]
Rename docs requirements for better sorting

Change-Id: Ie1fb5e86aa22d49c7d144f85a6f1fbf0340360f8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd LF Logo 74/6874/3
Thanh Ha [Sat, 14 Oct 2017 14:59:35 +0000 (10:59 -0400)]
Add LF Logo

Change-Id: Ia82ca35196630689f67f8b1b6fb5f2091a6e5c6d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd custom navbar ala OpenDaylight docs 72/6872/3
Thanh Ha [Sat, 14 Oct 2017 14:50:06 +0000 (10:50 -0400)]
Add custom navbar ala OpenDaylight docs

Change-Id: I2af32b6847a6dd1242efd6b9c320a22eff0d8d76
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump Sphinx minimal dependencies to latest 75/6875/3
Thanh Ha [Sat, 14 Oct 2017 15:06:57 +0000 (11:06 -0400)]
Bump Sphinx minimal dependencies to latest

Also splits out docs requirements to docs-requirements.txt to avoid
coala failing to run because of version conflict with Sphinx version we
want to use for docs.

Change-Id: I64d0b5953be03f91bf67e75e54072d1da9df5d1a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRemove best practices guide from lftools 56/6856/1
Thanh Ha [Fri, 13 Oct 2017 18:35:35 +0000 (14:35 -0400)]
Remove best practices guide from lftools

The guide sections were divided out and moved to either releng/docs or
releng/global-jjb depending on context.

Issue: RELENG-507
Change-Id: I4eb4b0fe2820415a3e4bda8a98b2a2d5fed3f78f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd cross link 53/6853/1
Thanh Ha [Fri, 13 Oct 2017 18:15:00 +0000 (14:15 -0400)]
Add cross link

Issue: RELENG-507
Change-Id: I925889331d7904f2b85e5a16a1c581b32893779b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUpdate setuptools version 13/6813/4
Ry Jones [Thu, 12 Oct 2017 01:11:57 +0000 (18:11 -0700)]
Update setuptools version

Hyperledger builds fail on the Z platform with versions
of setuptools < 30.

FAB-6595

Change-Id: I6889507870f66e6b44720579f8be7b0b35b7c7a9
Signed-off-by: Ry Jones <rjones@linuxfoundation.org>
7 years agoRefactor descriptions to README.md and __summary__ 17/6317/3
Thanh Ha [Tue, 5 Sep 2017 17:41:37 +0000 (13:41 -0400)]
Refactor descriptions to README.md and __summary__

This change makes it so that the __summary__ is a pydoc variable and we
can pull in the long description directly from README.md. Also add a
website url.

Change-Id: Ibab9e436d4e2c8188a456976e1ab5f19dbf88060
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRe-order log ENV stripping and add new key 32/6432/1
Andrew Grimberg [Fri, 8 Sep 2017 21:16:31 +0000 (14:16 -0700)]
Re-order log ENV stripping and add new key

* Make the environment stripping be asciibetical so it's easier to know
where to insert new elements

* Add KEY as an environment variable base to be stripped from the
shipped logs

Change-Id: I46367ec36c44b5b29534fff7f86356e8b9abffcb
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
7 years agoMerge "Update JJB best practices"
Thanh Ha [Thu, 7 Sep 2017 01:15:36 +0000 (01:15 +0000)]
Merge "Update JJB best practices"

7 years agoUpdate JJB best practices 26/6326/5
Anil Belur [Wed, 6 Sep 2017 14:11:22 +0000 (00:11 +1000)]
Update JJB best practices

Using single quotes around variables.

Update parameter passing section to avoid using `!include-raw`.

Also remove single quotes around examples where its not required.

Change-Id: I176c861a90fcea29c3fd77308287f241e9f26a6c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoSpell check fixes in best practices 25/6325/1
Anil Belur [Wed, 6 Sep 2017 06:01:18 +0000 (16:01 +1000)]
Spell check fixes in best practices

Change-Id: Ibcc86f61181edcfad09cc1cdc056b1b4c8a09954
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoBump version to 0.10.0-dev for next dev cycle 16/6316/1
Thanh Ha [Tue, 5 Sep 2017 17:41:20 +0000 (13:41 -0400)]
Bump version to 0.10.0-dev for next dev cycle

Change-Id: I784869e966f1bb12842663b9386c275dacc59fb6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.9.0 14/6314/1 v0.9.0
Thanh Ha [Tue, 5 Sep 2017 16:07:27 +0000 (12:07 -0400)]
Release lftools v0.9.0

Change-Id: I34c8b9db49b7942329f911e5671fd7dff84402dd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoExit script with error if artifacts fail download 26/6226/2
Thanh Ha [Tue, 29 Aug 2017 20:21:36 +0000 (16:21 -0400)]
Exit script with error if artifacts fail download

Improve error checking to handle a potential error case.

Change-Id: I8ac39a0c5c84f6b23ea60a5c8e6601be76bf6afc
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUse gpg2 if available 25/6225/1
Thanh Ha [Tue, 29 Aug 2017 19:57:07 +0000 (15:57 -0400)]
Use gpg2 if available

Prefer gpg2 over gpg if it is available. In some systems such as Arch
Linux gpg is gpg2. We really only support gpg2 for signing.
Minor fix indentation to 4 spaces like the rest of the script.

Change-Id: I6733521838c78da94b67ab81d9397f5b0622e283
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add a best practice for JJB templates"
Andrew Grimberg [Tue, 29 Aug 2017 16:12:14 +0000 (16:12 +0000)]
Merge "Add a best practice for JJB templates"

7 years agoDO NOT archive if filename is longer than 255 23/6123/2
Thanh Ha [Thu, 24 Aug 2017 16:00:53 +0000 (12:00 -0400)]
DO NOT archive if filename is longer than 255

Most Unix filesystems do not allow files being created that are longer
than 255 characters. The LF Infra VMs are built with XFS and seem to
have the extended attribute allowing longer filenames. This
unfortuantely creates zip that when we copy to Nexus which does not have
this to fail to unpack. Limit archive files to 255 characters or less to
avoid this.

Issue: RELENG-322
Change-Id: I9c70a67d69559b834ec1c1bce0c2b909e61127dd
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd a best practice for JJB templates 50/6050/6
Thanh Ha [Fri, 18 Aug 2017 20:07:30 +0000 (16:07 -0400)]
Add a best practice for JJB templates

Having maintained global-jjb for awhile we have realised some good
design patterns that makes maintaining the global-jjb project easier.
This is an attempt to document these as best practices.

Issue: RELENG-414
Change-Id: I773e227d47a532499bad643f771c88edd45af236
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd suport for .tgz and .gz file extensions 08/6208/2
Anil Belur [Mon, 28 Aug 2017 02:25:14 +0000 (12:25 +1000)]
Add suport for .tgz and .gz file extensions

Handle .tgz and .gz files which are usually shortened name fir .tar.gz.

Jira: releng-431
Change-Id: I06fbb701d28eb1e5958698afbcffc0c504968672
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoSet a default logger if file methods fail 09/6109/1
Thanh Ha [Wed, 23 Aug 2017 16:51:25 +0000 (12:51 -0400)]
Set a default logger if file methods fail

In some environment such as ReadTheDocs it appears that pyprefix does
not appear to work as a backup. Let's fall back to a hardcoded logger in
the worst case situation.

Change-Id: Id3389fb05b7386f6d79026cc111982dac6e20efa
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to 0.9.0-dev 63/6063/1
Thanh Ha [Mon, 21 Aug 2017 15:50:19 +0000 (11:50 -0400)]
Bump version to 0.9.0-dev

Change-Id: I3600d0b5aaa73a3e32da9437305979efe5e06483
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoSet version to 0.8.0 for release 62/6062/1 v0.8.0
Thanh Ha [Mon, 21 Aug 2017 15:37:21 +0000 (11:37 -0400)]
Set version to 0.8.0 for release

Change-Id: I5503409a5a069fc6675442e33664ec14003f5272
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.8.0 47/6047/1
Thanh Ha [Fri, 18 Aug 2017 19:40:12 +0000 (15:40 -0400)]
Release lftools v0.8.0

Change-Id: I7348e33a27434ab6355aec09a7cb5a7beec35914
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Add all release notes up to date"
Thanh Ha [Fri, 18 Aug 2017 19:36:37 +0000 (19:36 +0000)]
Merge "Add all release notes up to date"

7 years agoAdd all release notes up to date 37/5937/1
Thanh Ha [Wed, 16 Aug 2017 18:49:55 +0000 (14:49 -0400)]
Add all release notes up to date

Keeping a history for our release notes would be useful for folks to
understand what changed since the version the are using.

Change-Id: I7eebbf8fc49be87facd0f87291f70d544accfe02
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRe-factor deploy maven file to remove dup code 87/5887/3
Anil Belur [Mon, 14 Aug 2017 10:13:06 +0000 (20:13 +1000)]
Re-factor deploy maven file to remove dup code

Change-Id: I2a4ddd37eff6da11eb04b91ceb96810e39d218aa
Jira: releng-360
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoConvert license print statements to logger 19/5819/4
Thanh Ha [Wed, 9 Aug 2017 22:01:33 +0000 (18:01 -0400)]
Convert license print statements to logger

Change-Id: I0597053944aef49b9537fd8d492781fa76c05ad0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoMerge "Fix best practice doc example code indent"
Jeremy Phelps [Fri, 11 Aug 2017 13:30:35 +0000 (13:30 +0000)]
Merge "Fix best practice doc example code indent"

7 years agoFix best practice doc example code indent 50/5850/1
Anil Belur [Fri, 11 Aug 2017 13:18:17 +0000 (23:18 +1000)]
Fix best practice doc example code indent

Change-Id: I61362fbba37c85713468b7af1eadd132f768b16f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoVerify lftools scripts have license headers 33/5733/3
Thanh Ha [Thu, 3 Aug 2017 21:20:23 +0000 (17:20 -0400)]
Verify lftools scripts have license headers

Add a test to check for license headers in Python and Shell code.

Change-Id: I61b82d463105fca9bb2a0385ca18482ec0fea7c0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to 0.8.0-dev 48/5748/2
Thanh Ha [Fri, 4 Aug 2017 20:29:14 +0000 (16:29 -0400)]
Bump version to 0.8.0-dev

Change-Id: Iadfdcdf72d4f6bfb51e336fb3013c3488eb43560
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.7.0 47/5747/2 v0.7.0
Thanh Ha [Fri, 4 Aug 2017 20:22:56 +0000 (16:22 -0400)]
Release lftools v0.7.0

Noteable Changes:

f3b7292 Jessica Wagantall       Implement lftools logger
f16b45d Anil Belur      Make maven deploy-file more generic
c4084d7 Anil Belur      Pass maven parameters to deploy maven-file
2f7fc1a Jessica Wagantall       Add script to fix yamllint errors
8f0d84c Thanh Ha        Add a license header scanner

Change-Id: I3b25d66720120d79180d0241e625305edf095e45
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoDocument installation of lftools 46/5746/4
Jeremy Phelps [Fri, 4 Aug 2017 20:04:50 +0000 (15:04 -0500)]
Document installation of lftools

Change-Id: I762b8fc6cd82b786c81eb9cc3a0711030a0d1ee5
JIRA: RELENG-325
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoUse logger for Nexus create repo script 66/5666/8
Jessica Wagantall [Fri, 28 Jul 2017 00:19:08 +0000 (17:19 -0700)]
Use logger for Nexus create repo script

Nexus create repo needs to output what it's
doing into a log file.
Use the generic logger to obtain that output.

JIRA: RELENG-253

Change-Id: I1705b52761f79a1331032175c49484c9a75f9810
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
7 years agoImplement lftools logger 65/5665/14
Jessica Wagantall [Fri, 28 Jul 2017 07:04:34 +0000 (00:04 -0700)]
Implement lftools logger

Add generic logger configuration file to be used by lftools scripts.

This logger checks 3 locations for a logger.ini file:

1) ~/.config/lftools/logging.ini
2) /etc/lftools/logging.ini
3) sys.prefix/etc/logging.ini

Dev only...
4) etc/logging.ini (Default fallback in dev environments)

JIRA: RELENG-321
Change-Id: I8fef663dd6b02947f7722424ecce6e2cc78debec
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
7 years agoIgnore shebang when evaluating license headers 43/5743/1
Thanh Ha [Fri, 4 Aug 2017 17:29:18 +0000 (13:29 -0400)]
Ignore shebang when evaluating license headers

The shebang lines in some scripts should be ignored when evaluating
license headers.

Change-Id: I7d895cf6b00a6edf8303c229278a262129ec2661
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUse a regex pattern instead for license searching 41/5741/1
Thanh Ha [Fri, 4 Aug 2017 17:11:51 +0000 (13:11 -0400)]
Use a regex pattern instead for license searching

This allows us to search for files for example in shell/ where there are
no file extensions.

Change-Id: I5634b233d9feb0d2dc3421b0c1a9c5280faf82f1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Make maven deploy-file more generic"
Jeremy Phelps [Fri, 4 Aug 2017 13:10:02 +0000 (13:10 +0000)]
Merge "Make maven deploy-file more generic"

7 years agoTrim trailing slashes from URL inputs 31/5731/1
Thanh Ha [Thu, 3 Aug 2017 21:09:12 +0000 (17:09 -0400)]
Trim trailing slashes from URL inputs

Trailing slashes in URLs causes the staging code to upload to
//org.opendaylight.project instead of /org.opendaylight.project which
fails our URL pattern matching target defined in Nexus since Nexus
thinks // as a blank directory in the path. We need to make sure
extraneous / does not get pushed in by the user so trim it off if they
do.

Issue: RELENG-351
Change-Id: I264fec5c41e89d588e03a9c447917ee8a3623c62
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMake maven deploy-file more generic 96/5696/2
Anil Belur [Sat, 29 Jul 2017 05:34:26 +0000 (15:34 +1000)]
Make maven deploy-file more generic

Add support for war, jar and tar.gz files
Add support for passing pom files with -f

JIRA: releng-201
Change-Id: Ia5da1e5df23eddd803877f5b42bc8a594cbe58c1
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoMerge "Add a license header scanner"
Jeremy Phelps [Wed, 2 Aug 2017 15:38:04 +0000 (15:38 +0000)]
Merge "Add a license header scanner"

7 years agoMerge changes from topic '5663'
Thanh Ha [Wed, 2 Aug 2017 14:48:02 +0000 (14:48 +0000)]
Merge changes from topic '5663'

* changes:
  Add CONTRIBUTING file
  Enable MarkDown linting

7 years agoMerge "Pass maven parameters to deploy maven-file"
Thanh Ha [Wed, 2 Aug 2017 14:22:02 +0000 (14:22 +0000)]
Merge "Pass maven parameters to deploy maven-file"

7 years agoPass maven parameters to deploy maven-file 07/5607/8
Anil Belur [Fri, 21 Jul 2017 11:21:53 +0000 (21:21 +1000)]
Pass maven parameters to deploy maven-file

Change-Id: I361a735779a3441551bc619cc57ff5db762cc5d5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoAdd script to fix yamllint errors 46/4046/30
Jessica Wagantall [Mon, 6 Mar 2017 16:05:27 +0000 (08:05 -0800)]
Add script to fix yamllint errors

Run this script as "./fix_yamllint.sh" inside the desired repo.
This script will ask the option of running for all *.yaml files or
specific ones for which the user will need to provide the complete
path per file separated by spaces.

Change-Id: I63f200fd9289f12715d354c95af18b619e4911a2
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
7 years agoAdd CONTRIBUTING file 63/5663/2
Thanh Ha [Fri, 28 Jul 2017 04:14:25 +0000 (00:14 -0400)]
Add CONTRIBUTING file

CONTRIBUTING files are useful to notify potential developers of how to
contribute to our project. Especially if they found it via the GitHub
mirror.

Change-Id: I707332e1b6d5135fb100481645136bbbbe8c37db
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoEnable MarkDown linting 62/5662/1
Thanh Ha [Fri, 28 Jul 2017 04:13:24 +0000 (00:13 -0400)]
Enable MarkDown linting

Lint MarkDown files with MarkdownBear and resolve markdown lint issues.

Change-Id: I4b18ab8060d8bdc293ef8548ec8e9fd56db3988d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd a license header scanner 00/5600/6
Thanh Ha [Wed, 19 Jul 2017 22:50:24 +0000 (18:50 -0400)]
Add a license header scanner

Simple scanner to check code files for a license header. Does not care
about the exact formatting of the license header as long as all the text
exists in the correct order.

This version only supports headers using '#' as the comment string.

Issue: RELENG-279
Change-Id: Id4030f040c3de4350c59776ed21eed497e5d6f8d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove .coafile rules using inheritance 58/5658/2
Thanh Ha [Fri, 28 Jul 2017 01:55:28 +0000 (21:55 -0400)]
Improve .coafile rules using inheritance

Fix linting where appropriate.

Change-Id: Ife5f944bd3819858486d323ed91a80df7f075d88
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix first/third party import sorting 59/5659/1
Thanh Ha [Fri, 28 Jul 2017 01:42:33 +0000 (21:42 -0400)]
Fix first/third party import sorting

Change-Id: I8e3a28d931e5c1283f44c9b47c261662b7072470
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd missing license header in test_version.py 39/5639/1
Thanh Ha [Wed, 26 Jul 2017 20:38:14 +0000 (16:38 -0400)]
Add missing license header in test_version.py

Change-Id: I769511e1cb099f89b000f550b04bd5c9c9dc7f89
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix docs underline too short in deploy docs 27/5627/2
Thanh Ha [Tue, 25 Jul 2017 16:55:49 +0000 (12:55 -0400)]
Fix docs underline too short in deploy docs

Change-Id: I668f3add6e53abf8138776573616c7e834b01b3d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoIgnore linkchecking Google blog 30/5630/1
Thanh Ha [Tue, 25 Jul 2017 20:47:16 +0000 (16:47 -0400)]
Ignore linkchecking Google blog

Our CI systems appear to be failing to validate against this URL.
Perhaps Google blocked us?

Change-Id: Ie2047cd7f4a9fe94491c440bde93b67bdc3fc904
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to 0.7.0-dev 11/5611/1
Thanh Ha [Fri, 21 Jul 2017 18:02:40 +0000 (14:02 -0400)]
Bump version to 0.7.0-dev

Change-Id: If979aed2d22e962e7175e71b14552d81398399e5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.6.0 10/5610/1 v0.6.0
Thanh Ha [Fri, 21 Jul 2017 16:27:47 +0000 (12:27 -0400)]
Release lftools v0.6.0

Notable Changes:

41bf360 Thanh Ha        Copy sign scripts over to lftools

Change-Id: I7f63280df10ae3e5b271927a6b21e75811018dd2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Disable Maven transfer output"
Jeremy Phelps [Fri, 21 Jul 2017 16:06:49 +0000 (16:06 +0000)]
Merge "Disable Maven transfer output"

7 years agoDisable Maven transfer output 09/5609/1
Thanh Ha [Fri, 21 Jul 2017 15:56:53 +0000 (11:56 -0400)]
Disable Maven transfer output

Enable --batch-mode and set transfer logger to WARN to prevent Maven
from printing the download/upload progress indicators in console logs.

Issue: https://trello.com/c/uSwEfMmP/542-make-build-rpm-stream-console-output-less-verbose
Change-Id: I00d323192a9726e5b6f7b92ab80c424bfe3ab81f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Code Review checklist 22/5522/7
Thanh Ha [Wed, 12 Jul 2017 15:15:22 +0000 (11:15 -0400)]
Add Code Review checklist

Change-Id: I590e1da39c7097aa31ff566d744c67f57c28112b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoDocument the use of {obj:key} notation 95/5595/3
Jeremy Phelps [Wed, 19 Jul 2017 15:37:07 +0000 (10:37 -0500)]
Document the use of {obj:key} notation

When using this notation in JJB, the variable name
you pass to must not have a dash in it.

Change-Id: Ic66d5bb82314af0715ecc465c412b07b44dbedc8
JIRA: RELENG-332
Signed-off-by: Jeremy Phelps <jphelps@linuxfoundation.org>
7 years agoUpdate SPDX License header to new format 72/5572/1
Thanh Ha [Tue, 18 Jul 2017 17:47:32 +0000 (13:47 -0400)]
Update SPDX License header to new format

According to SPDX's website https://spdx.org/using-spdx the correct
format for specifying SPDX is now:

    # SPDX-License-Identifier: EPL-1.0

Issue: RELENG-278
Change-Id: I742b12f50a14fa2108f705f44860ee64d02ebd7e
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd write-good linting for docs 53/5553/1
Thanh Ha [Sat, 15 Jul 2017 00:37:41 +0000 (20:37 -0400)]
Add write-good linting for docs

Write Good is a linter for English prose.

Change-Id: Iace497dbfaf5ef7091bf6b52eb4d8d6c2b4d1134
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFix write-good lint errors 52/5552/1
Thanh Ha [Sat, 15 Jul 2017 01:17:48 +0000 (21:17 -0400)]
Fix write-good lint errors

Change-Id: I0eab0d68ba35939d7275d51166df418eed637b7a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoShorten title and add description 51/5551/1
Thanh Ha [Sat, 15 Jul 2017 00:08:00 +0000 (20:08 -0400)]
Shorten title and add description

Change-Id: If03ba16d2e370ea9ca2723ec2ffdc8b6d469a920
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd Sign command documentation 41/5541/1
Thanh Ha [Fri, 14 Jul 2017 18:02:26 +0000 (14:02 -0400)]
Add Sign command documentation

Change-Id: I6a7c6038f31719fee893b7b5ba5ddb25614c3e2d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoFilter creds before writing to logs. 87/5487/1
Anil Belur [Sun, 9 Jul 2017 23:55:19 +0000 (09:55 +1000)]
Filter creds before writing to logs.

Remove any credentials possibily set as evnironment variables
when running the job.

Change-Id: I8e6daa19bb76152944e54be454fc83adbb9221fc
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
7 years agoCopy sign scripts over to lftools 43/5343/4
Thanh Ha [Wed, 28 Jun 2017 17:51:41 +0000 (13:51 -0400)]
Copy sign scripts over to lftools

This is a rewrite of the original tools to make it more generically
reusable by any Nexus server and project but is based on the original
code in OpenDaylight's releng/builder project scripts odlrelease and
odlsign-bulk.

Issue: RELENG-20
Change-Id: I35d4da0e2978f06640ddc11a93c9f86676a2a7e7
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to 0.6.0-dev 59/5359/1
Thanh Ha [Thu, 29 Jun 2017 22:02:55 +0000 (18:02 -0400)]
Bump version to 0.6.0-dev

Change-Id: Ie1312e51019c16416b354318a571c491db9f8646
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.5.0 58/5358/1 v0.5.0
Thanh Ha [Thu, 29 Jun 2017 21:59:13 +0000 (17:59 -0400)]
Release lftools v0.5.0

Noteable Changes:

4da2d40 Thanh Ha        Deploy to Nexus using parallel
a72bf05 Thanh Ha        Add command to deploy nexus-zip files

Change-Id: I8652cdd31ead436e49da417138cb978813cc0225
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoDeploy to Nexus using parallel 21/5321/1
Thanh Ha [Tue, 27 Jun 2017 03:38:29 +0000 (23:38 -0400)]
Deploy to Nexus using parallel

Speed up the script by using GNU parallel to push when it is available.

Change-Id: I8ddff8b8cf50cd821aae21958ab8b5c7ecc33174
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove deploy error message 95/5295/1
Thanh Ha [Fri, 23 Jun 2017 15:08:43 +0000 (11:08 -0400)]
Improve deploy error message

The previous error message states that there are missing arguments
however if the user provides more arguments than necessary it still
fails with the same error. This patch attempts to make the error message
more helpful to the user.

Change-Id: I6e5967f098a98bb7b141635ce8358bc5de4a89e4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Use a multiline string for description"
Andrew Grimberg [Thu, 22 Jun 2017 13:33:17 +0000 (13:33 +0000)]
Merge "Use a multiline string for description"

7 years agoAdd command to deploy nexus-zip files 73/5273/1
Thanh Ha [Wed, 21 Jun 2017 19:47:21 +0000 (15:47 -0400)]
Add command to deploy nexus-zip files

This command is useful to push nexus formated zip files directly to the
Nexus content-compressed URL. This is useful for example with Site repos
where it would be faster to cURL a zip file here than to allow Maven
site:deploy to upload one file at time to Nexus.

Issue: RELENG-211
Change-Id: Ie459498b4886391a4a4fbe86b3cbb1a837bc2b16
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRe-organize functions alphabetically 71/5271/1
Thanh Ha [Wed, 21 Jun 2017 18:36:29 +0000 (14:36 -0400)]
Re-organize functions alphabetically

Missed this when we merged the maven-file code. L comes before M.

Change-Id: I46e0bbc622599ddf2ed2fa25e7dde4c9bb3bf54b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoUse a multiline string for description 68/5268/1
Thanh Ha [Wed, 21 Jun 2017 15:39:22 +0000 (11:39 -0400)]
Use a multiline string for description

Fix up some formatting issues by using a multiline string.

Change-Id: I8f199a813dd6fde2b5b4af8598aa93c847287a38
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version to 0.5.0-dev 67/5267/1
Thanh Ha [Wed, 21 Jun 2017 15:33:15 +0000 (11:33 -0400)]
Bump version to 0.5.0-dev

Change-Id: I064a1042799bfc46bf4d20970f4af6728715cf66
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools 0.4.0 66/5266/1 v0.4.0
Thanh Ha [Wed, 21 Jun 2017 15:29:58 +0000 (11:29 -0400)]
Release lftools 0.4.0

Noteable Changes:

e5c8909 Anil Belur      Add deploy maven-file command to lftools
b6a9961 Thanh Ha        Add a README to locate the online docs
7485330 Thanh Ha        Link deploy commands into commands index
032dbba Thanh Ha        Improve error detection for when SSL invalid

Change-Id: Ib8a8829f53e150bffb1c826b69bd7e3406cad033
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy maven-file command to lftools 87/5187/35
Anil Belur [Tue, 13 Jun 2017 00:24:27 +0000 (10:24 +1000)]
Add deploy maven-file command to lftools

The 'deploy maven-file' command uses mvn deploy-file goal
for deploying files to a nexus repository.

Credentials can be provided by settings.xml file in the following way
(order or precedence listed):

    1) User provides the settings file explicitly via -s parameter
    2) User provides the settings file via SETTINGS_FILE envvar
    3) User does not provide the file (default Maven location used)

Jira: releng-160
Change-Id: I0a3af408f70d7d2551a187ec3561b5e609e733d5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoMerge "Link deploy commands into commands index"
Andrew Grimberg [Mon, 19 Jun 2017 21:17:54 +0000 (21:17 +0000)]
Merge "Link deploy commands into commands index"

7 years agoAdd a README to locate the online docs 92/5192/1
Thanh Ha [Tue, 13 Jun 2017 16:45:01 +0000 (12:45 -0400)]
Add a README to locate the online docs

Change-Id: Ie415e767bf2a1dc4a71b1cefe001002ae2041974
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoLink deploy commands into commands index 82/5182/1
Thanh Ha [Mon, 12 Jun 2017 19:52:40 +0000 (15:52 -0400)]
Link deploy commands into commands index

Change-Id: I5479625279e9be1c6c44eb27d3a0c7ec7f854f56
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoImprove error detection for when SSL invalid 46/5146/2
Thanh Ha [Mon, 12 Jun 2017 00:37:00 +0000 (20:37 -0400)]
Improve error detection for when SSL invalid

If SSL cert is invalid we don't even reach the Nexus server. So add code
to check that status is 201 before proceeding.

Change-Id: Ic5c8a0ce4177f73e6f753001ee8bbc5fdf02956c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoBump version for next dev cycle 42/5142/1
Thanh Ha [Sun, 11 Jun 2017 17:59:27 +0000 (13:59 -0400)]
Bump version for next dev cycle

Change-Id: Ie1d3ad6829c6e213a86e00ebb07b6f959c65b209
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoRelease lftools v0.3.0 41/5141/1 v0.3.0
Thanh Ha [Sun, 11 Jun 2017 17:41:02 +0000 (13:41 -0400)]
Release lftools v0.3.0

Noteable changes:

3c498dc Thanh Ha        Add deploy nexus-stage command
c84a544 Thanh Ha        Add deploy nexus command
58a1793 Anil Belur      Report memory usage with sys-info
5529081 Trevor Bramwell Add Jenkins to LF Tools

Change-Id: I3b9866ac884e31f3869cdd0ae062afa8e695a386
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy nexus-stage command 33/5133/7
Thanh Ha [Fri, 9 Jun 2017 03:12:56 +0000 (23:12 -0400)]
Add deploy nexus-stage command

Use curl to deploy a staging repository to Nexus.

Jira: RELENG-120
Change-Id: Ibd6c25f4318264e5f3e96aeede1c7fe891c473b2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoAdd deploy nexus command 55/5055/9
Thanh Ha [Wed, 31 May 2017 21:01:43 +0000 (17:01 -0400)]
Add deploy nexus command

Use curl to deploy a Maven repository to Nexus.

Jira: RELENG-121
Change-Id: If46e5054a2234eab77e7bd07120d8d0f11dfd293
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
7 years agoReport memory usage with sys-info 32/5132/3
Anil Belur [Fri, 9 Jun 2017 03:42:51 +0000 (13:42 +1000)]
Report memory usage with sys-info

Earlier this was getting printed in the end of the console logs
which got missed out while porting to lftools.

Change-Id: Id7e59ecdc017c15ebbe1d540fa36eef19ced9d38
Co-Authored-By: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>