Fix archives script "File exists" spam

The archive scripts has a bug that causes it to spam "File exists" at
the end of a log. This patch improves the script to handle this a little
better.

Change-Id: I61e939e74d7ab9c5f87a83cebd96ce886927bc88
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Make create version tests easier

This patch allows version tests to simply be placing files into a
directory and comparing the test results from an input pom and an
expected pom.

Also add a test to validate bump order.

Change-Id: Ide4da6f721223bc4d3edab79db9008e4cae730c6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix RTD generation of Shell docs

Change-Id: Ieec4b6695610d7a2a53727cd8c5680b34cf647a9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix RTD generation of Shell docs

Not sure if this exactly fixes it but have to merged to test.

Change-Id: I949fb80cd5031dc1a4bff3732ac75d09e6f09c6d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Release version 0.0.6

Change-Id: I7c4d8d12294968017ea1c668eb55047b0d8c582c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add unit tests for version script

Adds unit tests for the version script to ensure it works in the use
cases OpenDaylight requires the script for. Unit Tests run against
Python 3 as we are only supporting Python 3 for lftools at the moment.

- Fix version script not running 'release' command
- Add pytest
- Test version script for 3 use cases:
    1) Version bump for release
    2) Version bump by x.y.(z+1) post release
    3) Version bump by x.(y+1).z

Change-Id: Ib36d9a84e2769863083400c434e1539b302869a8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add Python linting in coala

- Add Git Commit Bear to validate commit message
- Make tox automatically download nltk data for GitCommitBear
- Add Python Bears to validate Python code

Change-Id: Ib50fa4ecaf282a751de38f149bf1e2992463a5f2
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix shellcheck issues in deploy-archives script

Change-Id: I2bfaad163292a5689c2c65946e2b3e6e80929117
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Create lftools cli

lftools cli becomes a wrapper for Shell scripts as well as a cli for
lftools Python components. Use the 'version' script as a starting point.

This patch also:

* Initializes automated Shell docs
* Improves version script to be callable from lftools cli

Change-Id: I21c7997745af0d3852d5b86d928832e7a8486fa4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Convert version bump script to functions

Convert the version bump script to functions so that it can be sourced
and reused more easily.

Change-Id: I09dde2c7e51b6dc8b70bb5befbe22d1fdb947903
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Move deploy-archives script into shell dir

Change-Id: I35a0a732c6431c656a2a33d74916946e78acdaca
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Create a git status report at the end of build

git-status report can be useful at the end of a build to identify
projects that left their project repo either with modified files or
untracked files.

Change-Id: I3f9f9c01991699574e1a9ca81885728117144b26
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Make message more clear

Change-Id: Ib10b7dc474b8411419d8e809e2d87c8341b60125
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Reduce verbosity of shiplogs

The end of a build there's a lot of download details from wget. This
patch aims to reduce that unnecessary verbosity. We will still get
error messages / success messages just not the download status of wget.

Change-Id: I10b9cffc6b74abc6fe2dd7f90924498b9f99197f
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Filter out bad environment variables

Change-Id: Id0631226ac1ebd433ff72d079b598e43e1f4f660
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Prefix timestamps on archived console logs

Time stamper plugin adds time stamps only to the jobs console logs,
which is unavailble on the archived console logs. This change fixes
the issue using the paste command.

Change-Id: Idc08840622a62dc679b0030554cfb4377472d726
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Rename _console-output.log to console.log

This allows someone to take a url like:

https://jenkins.opendaylight.org/releng/job/example-job/253/console

and convert it to

https://logs.oopendaylight.org/releng/jenkins092/example-job/253/console

and be able to expect to see the console logs despite the BASE_URL
changing.

Change-Id: I093f851f816cc71a55cbadbfd085b58baa289835
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Redirect zip logs to file and store on logs.o.o

The zip logs take a lot of the console log lines at the end of a build.
The output might be useful for troubleshooting so lets redirect the
output to a file and store it in logs.opendaylight.org instead of
outputting it to the Jenkins console logs directly.

Change-Id: Ie56d2a5348c9a55854199539e647f21894febe68
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Gzip *.bundle files in archives/patches

Change-Id: I3a3b0ea61d5729c538403bc912a01acfd1aeced7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Enable system stats for archive-build macro

Change-Id: I828ff5053d6957e54362ecb50616ba0bdd790046
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Change log servers and url to support parameter

Provide a default value for OpenDaylight.

Change-Id: Ifeaad654884d1730f4f3ea46aa5d8ca5730d26e4
Signed-off-by: Sandra Biton <sandra.biton@hpe.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Job for bindingv1 suite

Change-Id: Ic0d539f44e476b98dc40ad239fb7e44bc4dd547c
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Wrap ARCHIVE_ARTIFACTS variable with quotes and braces

Otherwise certain glob patterns are parsed incorrectly in the
if-statement.

Change-Id: I288b31fd483553ba151645ecd4164ef0684d40d4
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Improve archive-build macro to gzip any text file

Change-Id: I5a782147ec7f11fa353fbf01ea6d7fc117757346
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Improve archive-build to archive using globstar

Allows us to use **/*.xml for example as the archive parameter.

Change-Id: I5a92e198999a3db31fedc23e65f4c5315561f93c
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Print out environment variables to file

The environment variable list could be useful in troubleshooting so
paste it out at the end of the build.

Change-Id: Ibf3abed0f71c73269aa077ebe9dd7ea8bc35faad
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix archiving script to trim the end of the log file

Because the console log is still running while we are downloading it to
archive to logs.opendaylight.org it ends abruptly and causes confusion.
This patch trims the log so it will have a natural end to it's log.

Change-Id: Ic68828d2209a1c95e3c8282a82bc12f3138105a6
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Print size of archives.zip

Change-Id: I9d73d1849fe43c5d0d800a41d7c619ecc8decf62
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Rework archives directory format

Change-Id: I9318ffa2a06b3a918263eb678a75ad700f7171f0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Remove Gerrit notification script

It seems ssh-agent is not passed to publishers so will have to rework
this code to run as a builder step in a later patch.

Change-Id: I856468e91087ce39ea24308ad864dd45c500fc85
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add macro to deploy archives to Nexus

Requires the Description Setter plugin:
https://wiki.jenkins-ci.org/display/JENKINS/Description+Setter+Plugin

Change-Id: Ibc3d4a74416995b699e420864626dabd8a3c0658
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add SpaceConsistencyBear

Enforce spaces instead of tabs and 4 space indents.

Change-Id: I0e977f5206ebbb3f9962c463e4ddf23bb767c5ae
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Use coala got run ShellCheck

Change-Id: I7ea7346fb2cacb5310293a3b2dbdc1e6261dbab0
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Run shellcheck by default with tox

Change-Id: I8908346b168dbc21831538e5f64ab438ec693f30
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add ShellCheck to tox

Change-Id: Ib76fe08933a360a3e676ea6f825934c1f6f830c9
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix ShellCheck for patch-odl-release

Change-Id: Ief138884ec71f2d5713dae7c2f71b7247052be08
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Set minimum theme requirements

Change-Id: I089c105f75cf01650e7a56e28901495671a10560
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Initialize lftools docs

Change-Id: I613285e42f7213f8fc43deb00392f1017b249a00
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add basic setup.py

Initialize lftools as a project on pypi.

Change-Id: I901ecd512a856f2693da773ae08861ca1bfbf7c8
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add a fairly basic .gitignore

Change-Id: Iabcd042ddc733a12fdd766dcbdcd3fddde735279
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Bump versions also in repo-pom.xml files

This is needed for https://git.opendaylight.org/gerrit/46822
to pass validation.

Change-Id: I120cf4a59ca2d26ee02df4833ed6d4d263b3eeee
Signed-off-by: Vratko Polak <vrpolak@cisco.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Improve release script to handle new release workflow

See:
https://lists.opendaylight.org/pipermail/release/2016-June/006771.html

Change-Id: Iae9f5940c5eb2fe6024005843e2a966f593909f5
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix version.sh to handle date-only version correctly

Change-Id: I402067a5db99f69866f9d919643f660e8218bcfd
Signed-off-by: Colin Dixon <colin@colindixon.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix version.sh to handle date-based versions correctly

Change-Id: Ide6fbf329f72f53c4afb6782dedd1a6a5208ac68
Signed-off-by: Colin Dixon <colin@colindixon.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Update bumping script to merge from git bundles

Change-Id: Ia44a4e037eb218eda0be4ebcbf8f946704c9f0de
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Fix taglist script to include subprojects

For example integration/distribution was not being processed in the
tag script.

Change-Id: I9c989936f4421562245a61e57cfafcd5eb297f9b
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Improve grep in case 2 projects with similar name

For example "snmp" will return both snmp and snmp4sdn. This patch makes
it clear we only want the result of snmp only.

Change-Id: I2224cb5bdbe3f4a976d095e9a7b696a8b9e2008a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
(cherry picked from commit bb0d68fb970a101660b9027af2b383ea29068571)

Update release scripts to match stable/lithium

Change-Id: I0e7d08594c72e79c93ca244288addce4c329a83d
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Bug 3453 : Error in running version.sh

Change-Id: I030d7a07125c3b389e5c3829e14b736ac032c641
Signed-off-by: Navin Agrawal <anavin@gmail.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Improve comments and when usage is printed

Change-Id: I1144c6562e8ff543d08e2bbab5cf184d4c1cd29a
Signed-off-by: Colin Dixon <colin@colindixon.com>
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Improve version.sh to handle SNAPSHOT->RELEASE

Bug: 2830
Change-Id: Ieeeba8d1c5d19a1f6297d7cfb68e9f9c68c6874a
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add wrapper script that produces commits for releases

Change-Id: Icb2c12100c8e3eaa622f96956769ca80ee95ed89
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Add version-bump.sh

Copied from
https://wiki.opendaylight.org/view/File:Version-bump.sh

Change-Id: Iabc3f41b42161ff7aecac2a6cec8bf7024374487
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>
Signed-off-by: Colin Dixon <colin@colindixon.com>

Add .gitreview

Change-Id: I0ca8fb9ae6e7d5b029d8f119b1bdb43dad6c0ff1
Signed-off-by: Thanh Ha <thanh.ha@linuxfoundation.org>

Initial empty repository