releng/lftools.git
3 months agoChore: Update pre-commit deps to latest 24/73124/1 master
lfit.gh2gerrit [Wed, 7 Aug 2024 23:56:55 +0000 (23:56 +0000)]
Chore: Update pre-commit deps to latest

black 24.4.2 -> 24.8.0
flake8 7.0.0 -> 7.1.1
mypy v1.10.0 -> v1.11.1
actionlint v1.6.26 -> v1.7.1

Change-Id: I58ef95d4d134398770c85df200ef369a5bf95b06
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Signed-off-by: lfit.gh2gerrit <releng+lfit-gh2gerrit@linuxfoundation.org>
3 months agoCI: Add github2gerrit workflow 23/73123/1
Andrew Grimberg [Wed, 7 Aug 2024 20:28:09 +0000 (13:28 -0700)]
CI: Add github2gerrit workflow

Configure the github2gerrit workflow to allow PRs to open Gerrit changes
against the LFIT Gerrit system.

Issue: Fixes lfit/releng-lftools#12
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I9a8cefc6539ade8ae86f1ef7436b57e33e1f6046

3 months agoCI: Update to latest versions of actions 22/73122/1
Andrew Grimberg [Wed, 7 Aug 2024 19:18:01 +0000 (12:18 -0700)]
CI: Update to latest versions of actions

* lfit/checkout-gerrit-change-action v0.3 -> v0.9
* lfit/gerrit-review-action v0.3 -> v0.8

Issue: Fixes lfit/releng-lftools#11
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I1d5e157e350d05469e26ff56eca22a20ce878213

3 months agoChore: Update pre-commit issue link requirement 42/73042/4
Andrew Grimberg [Wed, 7 Aug 2024 16:19:45 +0000 (09:19 -0700)]
Chore: Update pre-commit issue link requirement

The Release Engineering Jira project is no longer publicly accessible.
As we currently require issue links for commits to lftools, this
switches to using the GitHub issue tracker for links.

Links may also use the optional 'Fixes' message identifier to cause GH
to close an issue if it is still open.

Issue: Fixes lfit/releng-lftools#10
Change-Id: I13b7592248f0d77a576d394a5a4415209777ae87
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
5 months agoMerge "Fix: Add setuptools to deps"
Andrew Grimberg [Wed, 5 Jun 2024 22:21:49 +0000 (22:21 +0000)]
Merge "Fix: Add setuptools to deps"

5 months agoFix: Add setuptools to deps 33/72933/1
Anil Belur [Wed, 5 Jun 2024 13:55:10 +0000 (23:55 +1000)]
Fix: Add setuptools to deps

Issue: RELENG-5403
Change-Id: I51f41b47d6bcc2e7e6103ae67e1389eda127e04f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
5 months agoCI: Change out conclusion getter 10/72910/2
Andrew Grimberg [Mon, 3 Jun 2024 13:42:40 +0000 (06:42 -0700)]
CI: Change out conclusion getter

Issue: RELENG-5356
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I7bc0b36543ff89ac98fae83b6770184413feb674

5 months agoCI: Fetch all changes for docs jobs 13/72913/1
Andrew Grimberg [Mon, 3 Jun 2024 16:53:31 +0000 (09:53 -0700)]
CI: Fetch all changes for docs jobs

The docs jobs need to fetch all changes to ensure that the docs are
built properly given the use of reno

Issue: RELENG-5356
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I93bd81f922045cc7f8f373e3b22a014eba047b03

5 months agoCI: Use latest actions and reusable workflows 87/72887/1
Andrew Grimberg [Wed, 29 May 2024 21:53:02 +0000 (14:53 -0700)]
CI: Use latest actions and reusable workflows

Update defined actions to the latest frozen version and move our
pre-commit validation to the Release Engineering reusable linting
workflow.

Issue: RELENG-5356
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Idfc6a234040bafa4c1dc6608d008cfc71c0cdfa1

5 months agoChore: Update pre-commit hooks to latest versions 85/72885/1
Andrew Grimberg [Wed, 29 May 2024 19:20:29 +0000 (12:20 -0700)]
Chore: Update pre-commit hooks to latest versions

* github.com/pre-commit/pre-commit-hooks: v4.5.0 -> v4.6.0
* github.com/ambv/black: 24.1.1 -> 24.4.2
* github.com/pre-commit/mirrors-mypy: v1.8.0 -> v1.10.0

Issue: RELENG-5356
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I4b6e6fe50d78bb92fb0729d48f47cf74727b3af1

7 months agoFix: Add missing Python module dependency "munch" causing cleanup job failures 37/72737/1 v0.37.10
Matthew Watkins [Tue, 12 Mar 2024 12:27:30 +0000 (12:27 +0000)]
Fix: Add missing Python module dependency "munch" causing cleanup job failures

Issue: RELENG-5176
Change-Id: I758b6d86f9ae912f368c4380cafd8d4a0eabad4f
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
8 months agoMerge "Chore: Update GitHub actions for setup-python and artefact upload/download"
Anil Belur [Tue, 5 Mar 2024 01:41:23 +0000 (01:41 +0000)]
Merge "Chore: Update GitHub actions for setup-python and artefact upload/download"

8 months agoChore: Update GitHub actions for setup-python and artefact upload/download 23/72723/1
Matthew Watkins [Mon, 4 Mar 2024 19:13:23 +0000 (19:13 +0000)]
Chore: Update GitHub actions for setup-python and artefact upload/download

Issue: RELENG-5176
Change-Id: Ib9703988106f6d4223e9c6d7035a8cf39c904f09
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
8 months agoMerge "Chore: Update urllib3 pin to <2.1.0"
Kevin Sandi [Mon, 4 Mar 2024 19:10:17 +0000 (19:10 +0000)]
Merge "Chore: Update urllib3 pin to <2.1.0"

8 months agoChore: Update urllib3 pin to <2.1.0 22/72722/2
Matthew Watkins [Mon, 4 Mar 2024 16:24:02 +0000 (16:24 +0000)]
Chore: Update urllib3 pin to <2.1.0

Issue: RELENG-5176
Change-Id: Ibda2f27e79d9219489aa789c4e6bb39d5b6c502f
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
8 months agoFix: Correct syntax for RTD extra requirements 63/72663/1
Andrew Grimberg [Wed, 21 Feb 2024 14:49:03 +0000 (06:49 -0800)]
Fix: Correct syntax for RTD extra requirements

Issue: RELENG-5171
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I877f83ea4f84f8207ee0f03c0d2ff3d71b20b791

8 months agoFix: Fix requirements install for RTD 62/72662/1
Andrew Grimberg [Wed, 21 Feb 2024 14:40:00 +0000 (06:40 -0800)]
Fix: Fix requirements install for RTD

Issue: RELENG-5171
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Id9ee39d08b7aeeb86df488d2f8866167b278e654

8 months agoChore: Add missing release note for 0.37.9 tag 61/72661/1
Matthew Watkins [Wed, 21 Feb 2024 11:55:24 +0000 (11:55 +0000)]
Chore: Add missing release note for 0.37.9 tag

Change-Id: I46616cade08cd45f6c9e79efb3eb9a555b1bfa9c
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
8 months agoChore: Update openstacksdk from <1.5.0 to >=2.1.0 46/72646/1 v0.37.9
Matthew Watkins [Mon, 12 Feb 2024 10:59:24 +0000 (10:59 +0000)]
Chore: Update openstacksdk from <1.5.0 to >=2.1.0

Also, updated linting tool versions with pre-commit autoupdate.
Addressed minor type checking issue flagged by flake8.
Minor file formatting changes implemented via linting.

Issue: IT-26453
Change-Id: If9f941326c3f105d71fd0014d900653633d886ea
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
10 months agoCI: Remove release email 07/72507/1
Andrew Grimberg [Mon, 8 Jan 2024 21:41:30 +0000 (13:41 -0800)]
CI: Remove release email

The lf-releng@lists.linuxfoundation.org mailing list is going away.
GitHub releases are already being generated (though the release notes
generation doesn't seem to be working 100% correctly) but this needs to
happen or we start getting failures soon.

Issue: RELENG-4931
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ib67a2f042a6c17837c366a0a82a300de8994d44e

10 months agoRefactor: Update to using configparser 06/72506/3
Andrew Grimberg [Mon, 8 Jan 2024 21:08:21 +0000 (13:08 -0800)]
Refactor: Update to using configparser

Since we've effectively dropped Python2 support there is no reason to
keep using six for backwards compatibility. This is the first of many
small changes to remove six from use.

This one is first as newer mypy seems to be having issues with the
configparser transition!

Issue: RELENG-5063
Change-Id: If9cd83933d0cd6e0b7ac69afaa1bb94a9dab8202
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
11 months agoFix: Correct path for Jenkins settings files 00/72400/1
Eric Ball [Sat, 18 Nov 2023 00:59:17 +0000 (16:59 -0800)]
Fix: Correct path for Jenkins settings files

The correct path should be "<repo>-settings", but was previously set
to just "<repo>". This is causing problems in our JCASC and other
automation.

Issue: RELENG-4490
Change-Id: I7f526d82d550acc3021548ee642a0d3706783d9f
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
12 months agoFix: Move the git fetch depth 43/72343/1
Andrew Grimberg [Mon, 6 Nov 2023 22:58:21 +0000 (14:58 -0800)]
Fix: Move the git fetch depth

It is not possible to specify a depth larger than 1 with the tag
checkout that is performed. Move the depth increase to where it's
actually needed.

Issue: RELENG-4973
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I394c2359f8d8e8fec83bf5b39a9282222a9c2ad5

12 months agoCI: Generate GitHub releases 38/72338/1
Andrew Grimberg [Mon, 6 Nov 2023 22:12:27 +0000 (14:12 -0800)]
CI: Generate GitHub releases

* Increase the checkout depth from 1 to 30 to handle reno needing to be
  able to find all relevant tags (current and current -1) and also pull
  the tags
* Generate a reno report for the given tag and then modify the report to
  strip out all the extra garbage that is added by the report process to
  get it into a valid markdown file and not RST file
* Use `gh` cli tool to generate the release notes using the
  auto-changelog generation plus the reno release notes

Issue: RELENG-4973
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ic54ac4a5b138aabe2adcc3a9612f018ed34b4983

12 months agoRevert "Refactor: Annotate lftools.deploy" 35/72335/1 v0.37.8
Andrew Grimberg [Fri, 3 Nov 2023 15:57:28 +0000 (08:57 -0700)]
Revert "Refactor: Annotate lftools.deploy"

This reverts commit 0006fe3df413dcca4d03d26d9c33fdadb3498a26.

Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I7d57bc95825769c374333877b27eda628bfd9d6f

12 months agoFix: Tolerate transient connection errors 97/72297/2 v0.37.7
Robert Varga [Mon, 30 Oct 2023 17:09:28 +0000 (18:09 +0100)]
Fix: Tolerate transient connection errors

Nexus release process is absolutely critical and it seems just cannot
get our infra to work reliably. Work this around by ignoring
ConnectionErrors unless they pile up.

Issue: IT-25604
Change-Id: I3c035c280dd5ea973c188b78baec76e24aa1ec16
Signed-off-by: Robert Varga <nite@hq.sk>
12 months agoMerge "Refactor: Annotate lftools.deploy"
Eric Ball [Fri, 13 Oct 2023 23:59:08 +0000 (23:59 +0000)]
Merge "Refactor: Annotate lftools.deploy"

12 months agoMerge changes from topic "modernize_lftools"
Andrew Grimberg [Fri, 13 Oct 2023 18:10:13 +0000 (18:10 +0000)]
Merge changes from topic "modernize_lftools"

* changes:
  Refactor: Add annotations to lftools.config
  Refactor: Add annotations to lftools.helpers
  Refactor: Add annotations to schema validator

12 months agoMerge "Refactor: Add annotations to lftools.cli.version"
Anil Belur [Thu, 12 Oct 2023 22:14:16 +0000 (22:14 +0000)]
Merge "Refactor: Add annotations to lftools.cli.version"

12 months agoMerge "CI: Bring testing of lftools.cli.version to 100%"
Anil Belur [Thu, 12 Oct 2023 22:13:45 +0000 (22:13 +0000)]
Merge "CI: Bring testing of lftools.cli.version to 100%"

12 months agoMerge "Refactor: Add annotations on lftools.api.*"
Anil Belur [Thu, 12 Oct 2023 22:13:25 +0000 (22:13 +0000)]
Merge "Refactor: Add annotations on lftools.api.*"

12 months agoRefactor: Add annotations to lftools.cli.version 58/72258/1
Andrew Grimberg [Thu, 12 Oct 2023 19:44:16 +0000 (12:44 -0700)]
Refactor: Add annotations to lftools.cli.version

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: If44a5dac471ef07c609bc8f26d70dbb34cc07def

12 months agoCI: Bring testing of lftools.cli.version to 100% 57/72257/1
Andrew Grimberg [Thu, 12 Oct 2023 19:34:38 +0000 (12:34 -0700)]
CI: Bring testing of lftools.cli.version to 100%

Finish off the testing for lftools.cli.version

Issue: RELENG-4944
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Id5ea7118f25e066c173b5a56f705d638f40689af

12 months agoChore: Add coverage reporting 54/72254/2
Andrew Grimberg [Thu, 12 Oct 2023 16:56:22 +0000 (09:56 -0700)]
Chore: Add coverage reporting

Issue: RELENG-4938
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ic5589cd05033ee2f6758f10a84cb235317cc55df

12 months agoRefactor: Add annotations on lftools.api.* 52/72252/3
Andrew Grimberg [Thu, 12 Oct 2023 16:14:09 +0000 (09:14 -0700)]
Refactor: Add annotations on lftools.api.*

Issue: RELENG-4933
Change-Id: I2dde8fa02f2efac810a1ec874989ec1e94dfdeee
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
12 months agoRefactor: Annotate lftools.deploy 50/72250/1
Andrew Grimberg [Thu, 12 Oct 2023 13:36:32 +0000 (06:36 -0700)]
Refactor: Annotate lftools.deploy

* Add annotations
* Refactor sections to deal with th needed changes for type enforcement
* Small rewrite of hard to follow logic that was exposed with type
  enforcement
* Cleanup most formatted strings

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Idd435d831efc27954ca6e8c137b98ba8d728287d

13 months agoRefactor: Add annotations to lftools.config 39/72239/1
Andrew Grimberg [Tue, 10 Oct 2023 13:37:36 +0000 (06:37 -0700)]
Refactor: Add annotations to lftools.config

* Update lftools.oauth2_helper for new type hints out of config

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I7659432c722b1074c41f801170bac1b5b2c6b5d6

13 months agoRefactor: Add annotations to lftools.helpers 38/72238/1
Andrew Grimberg [Tue, 10 Oct 2023 13:23:15 +0000 (06:23 -0700)]
Refactor: Add annotations to lftools.helpers

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I28a94f82c6fdb04380cb2bc731ebc13811157ceb

13 months agoRefactor: Add annotations to schema validator 37/72237/1
Andrew Grimberg [Tue, 10 Oct 2023 13:13:21 +0000 (06:13 -0700)]
Refactor: Add annotations to schema validator

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I1b13c1ad1ad825cf29718dd15c0cc56c8a4a55cc

13 months agoRefactor: Add annoations to lftools.oauth2_helper 36/72236/1
Andrew Grimberg [Mon, 9 Oct 2023 15:49:31 +0000 (08:49 -0700)]
Refactor: Add annoations to lftools.oauth2_helper

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I5d80203fa91196de29e77c55721150668545aeee

13 months agoRefactor: Add annotations to lftools.license 35/72235/1
Andrew Grimberg [Mon, 9 Oct 2023 15:39:02 +0000 (08:39 -0700)]
Refactor: Add annotations to lftools.license

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Id3c7e98378b4a5251f266ed78a21e4311dea5aa5

13 months agoRefactor: Add annotations to lftools.jenkins 34/72234/1
Andrew Grimberg [Mon, 9 Oct 2023 15:18:12 +0000 (08:18 -0700)]
Refactor: Add annotations to lftools.jenkins

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I94db9930f39c4421b20dc74d678c685a5b1ce0c5

13 months agoRefactor: Add annotations to base lftools 33/72233/1
Andrew Grimberg [Fri, 6 Oct 2023 21:52:27 +0000 (14:52 -0700)]
Refactor: Add annotations to base lftools

Issue: RELENG-4933
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I9d793ebe4db3ca47dafee56c9016789f8bcd3f1f

13 months agoChore: Remove defunct requirements files 32/72232/1
Andrew Grimberg [Fri, 6 Oct 2023 20:07:44 +0000 (13:07 -0700)]
Chore: Remove defunct requirements files

The requirements files being removed was missed in the previous change
to convert to using pyproject.toml

Issue: RELENG-4932
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I3e887e754413899d63f5b320904b275dcf3a94bc

13 months agoMerge "Refactor: Migrate to pyproject.toml"
Jessica Wagantall [Thu, 5 Oct 2023 19:29:38 +0000 (19:29 +0000)]
Merge "Refactor: Migrate to pyproject.toml"

13 months agoRefactor: Migrate to pyproject.toml 21/72221/5
Andrew Grimberg [Thu, 5 Oct 2023 14:06:44 +0000 (07:06 -0700)]
Refactor: Migrate to pyproject.toml

* Convert build configuration to a pure pyproject.toml project.
* Clamps reno notes generation to greater than v0.36.0

Issue: RELENG-4932
Change-Id: I10ebe156bb7712569fb06bd0c4b203074c3aed2b
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
13 months agoChore: Bump base python to 3.8 13/72213/1
Andrew Grimberg [Wed, 4 Oct 2023 13:42:39 +0000 (06:42 -0700)]
Chore: Bump base python to 3.8

Finalize the move to python 3.8 as our base python

Issue: RELENG-4891
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I4d3cea74a171baa6bdb540f8d4a29ac8d5cb4e02

13 months agoChore: Remove Python 3.5 - 3.7 11/72211/1
Andrew Grimberg [Tue, 3 Oct 2023 17:10:44 +0000 (10:10 -0700)]
Chore: Remove Python 3.5 - 3.7

Remove Python 3.5 - 3.7 from the defined compatible versions of lftools

Issue: RELENG-4891
Change-Id: Ia51f0dcce25b1c0394d690156d693df3f4f0e7b5
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
13 months agoCI: Remove Python 3.7 from tox validation 09/72209/1
Andrew Grimberg [Tue, 3 Oct 2023 17:00:30 +0000 (10:00 -0700)]
CI: Remove Python 3.7 from tox validation

Issue: RELENG-4891
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I4d8bd39c553f6804beada41f7fcbfaec756af75f

13 months agoCI: Remove python 3.7 validation from GHA 08/72208/1
Andrew Grimberg [Tue, 3 Oct 2023 16:54:29 +0000 (09:54 -0700)]
CI: Remove python 3.7 validation from GHA

Issue: RELENG-4891
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I0224c6a43c677aa2fba5d7450c5cd50500f11bd5

13 months agoCI: Update python validation 03/72203/2
Andrew Grimberg [Mon, 2 Oct 2023 21:51:18 +0000 (14:51 -0700)]
CI: Update python validation

* Drop python 3.6
* Set min version to 3.8
* Add python 3.9

Issue: RELENG-4891
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I6c5dfa4a7730783cdb1e2181e33503241f90109f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
13 months agoFix: Update github_cli call from deprecated method 81/72181/1
Eric Ball [Wed, 27 Sep 2023 23:59:08 +0000 (16:59 -0700)]
Fix: Update github_cli call from deprecated method

The "set_repo_permission" method has been replaced by
"update_team_repository", which has the same signature, but
uses "pull" and "push" rather than "read" and "write" as the
permission strings.

Issue: RELENG-4481
Change-Id: I5167b07f85cbc063e4a4affabbd5ccf60a7dfa42
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
13 months agoChore: Change "print" to "log" in github_cli 70/72170/3
Eric Ball [Wed, 27 Sep 2023 03:02:09 +0000 (20:02 -0700)]
Chore: Change "print" to "log" in github_cli

print statements should not be used for logging. These have been
replaced with log.info and log.error, where appropriate.

Change-Id: I919e5972dd887a0ed647b00250cbbe7a020f7d7e
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
15 months agoCI: Add RTD configuration file 69/71969/1
Andrew Grimberg [Fri, 21 Jul 2023 12:58:54 +0000 (05:58 -0700)]
CI: Add RTD configuration file

RTD will soon be requiring a configuration file for builds.
Additionally, they will soon stop honoring the unshallow feature flag
that they have on the repository and to get an unshallow checkout we
must do so via the config file

Issue: RELENG-4815
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I41ae572570dcfb1b82a8457a5f008cb736ca3c0b

15 months agoChore: add new lines required by pre-commit 43/71943/4 v0.37.6
Kevin Sandi [Wed, 19 Jul 2023 23:28:41 +0000 (17:28 -0600)]
Chore: add new lines required by pre-commit

Signed-off-by: Kevin Sandi <ksandi@contractor.linuxfoundation.org>
Change-Id: I659776622fefceb233f3a444ec38f5174a5d5054

18 months agoFix: pin urllib3<2.0.0 12/71712/1 v0.37.4
Anil Belur [Mon, 8 May 2023 03:28:34 +0000 (13:28 +1000)]
Fix: pin urllib3<2.0.0

The latest version of module breaks compatibility with
python-jenkins.

Issue: RELENG-4715
Change-Id: If0d942696820b8c867b56735ca3036aa3aa3b37c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
18 months agoFix: Correct version label for GHA call 24/71624/1
Andrew Grimberg [Mon, 24 Apr 2023 18:14:00 +0000 (11:14 -0700)]
Fix: Correct version label for GHA call

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ia041c727d4787368a0eb26302a89110c047dbb9c

18 months agoFix: Correct bad actions call 84/71584/1
Andrew Grimberg [Tue, 18 Apr 2023 16:23:21 +0000 (09:23 -0700)]
Fix: Correct bad actions call

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I5e960e68368a3471d73776b330d4bb12f489d043

18 months agoMerge "Fix: Correct bad vars definition"
Andrew Grimberg [Mon, 17 Apr 2023 17:03:46 +0000 (17:03 +0000)]
Merge "Fix: Correct bad vars definition"

18 months agoFix: Correct missing steps designator 72/71572/1
Andrew Grimberg [Mon, 17 Apr 2023 16:55:34 +0000 (09:55 -0700)]
Fix: Correct missing steps designator

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I7412fafa1d91d464e367209215c6a50861f27bd4

18 months agoFix: Correct bad vars definition 65/71565/1
Andrew Grimberg [Sat, 15 Apr 2023 13:40:34 +0000 (06:40 -0700)]
Fix: Correct bad vars definition

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ie1a1ee5e12cdae56c5108824e3e755a536afd764

19 months agoCI: Optimize GHA verify job 49/71549/1
Andrew Grimberg [Wed, 12 Apr 2023 19:08:07 +0000 (12:08 -0700)]
CI: Optimize GHA verify job

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I6410121b35edf484a476ae0438c86fc8fbca2d28

19 months agoCI: Add release workflow for tags 46/71546/3
Andrew Grimberg [Wed, 12 Apr 2023 17:35:02 +0000 (10:35 -0700)]
CI: Add release workflow for tags

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I32708d17966a7782e65bdf66c152e4e9ac89fda2

19 months agoCI: Enable sysstat 48/71548/1
Andrew Grimberg [Wed, 12 Apr 2023 18:35:33 +0000 (11:35 -0700)]
CI: Enable sysstat

Test for lftools require that sysstat be running as sar is called

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I0e53f40a36f66a630d8d1a4469e39b811aab951b

19 months agoCI: Remove python 3.6 checks 47/71547/1
Andrew Grimberg [Wed, 12 Apr 2023 17:42:43 +0000 (10:42 -0700)]
CI: Remove python 3.6 checks

GHA default runners will not install python 3.6, remove it as an option.

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ia9b54001fb1d6b774796735be0b0a7dde7f70ee3

19 months agoCI: Add GitHub Actions verify 45/71545/1
Andrew Grimberg [Wed, 12 Apr 2023 17:02:16 +0000 (10:02 -0700)]
CI: Add GitHub Actions verify

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I5f37fa7d4cf278d48e4b6eae38f9f477781c36e3

19 months agoCI: Add tox publish environment 44/71544/1
Andrew Grimberg [Wed, 12 Apr 2023 16:59:57 +0000 (09:59 -0700)]
CI: Add tox publish environment

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I5a7158668f3418dbba2d09d71c0d32adbc17ddfe

19 months agoCI: Add tox build,clean environments 43/71543/1
Andrew Grimberg [Wed, 12 Apr 2023 16:58:24 +0000 (09:58 -0700)]
CI: Add tox build,clean environments

* Add the tox build and clean environments
* Add additional gitignore to deal with build artifacts

Issue: RELENG-4563
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I26df479ac9f0a6177c345fd3a9bdd3dbb4bc9f49

19 months agoChore: Clean-up pre-commit issues 42/71542/1
Andrew Grimberg [Wed, 12 Apr 2023 16:17:04 +0000 (09:17 -0700)]
Chore: Clean-up pre-commit issues

Pre-commit issues all need to be clean before GitHub Actions can be
setup.

Issue: RELENG-4689
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I4f08a7ed8f05caaa9430b50bc83aeceb8f4fd71e

19 months agoChore: Update pre-commit hooks 41/71541/1
Andrew Grimberg [Wed, 12 Apr 2023 14:44:39 +0000 (07:44 -0700)]
Chore: Update pre-commit hooks

* github.com/pre-commit/pre-commit-hooks: updating v4.3.0 -> v4.4.0
* github.com/jorisroovers/gitlint: v0.17.0 -> v0.19.1
* github.com/ambv/black: 22.8.0 -> 23.3.0
* github.com/PyCQA/isort: 5.10.1 -> 5.12.0
* github.com/PyCQA/flake8: 3.9.2 -> 6.0.0
* github.com/pre-commit/mirrors-mypy: v0.971 -> v1.2.0

Issue: RELENG-4387
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I244f85858511ea039e35afddfd05c29b59f7523f

19 months agoChore: Use C8 build node for new project creation jobs 54/71454/1
Jessica Wagantall [Tue, 28 Mar 2023 16:58:31 +0000 (09:58 -0700)]
Chore: Use C8 build node for new project creation jobs

ONAP needs to use Centos8 build nodes in new automated project
yaml file creation.

Issue: RELENG-4659
Change-Id: I2dad2d7d26dc0690b98c5c15f42075a46b31fa97
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
19 months agoChore: rm py2.7 and add py3.8 and py3.9 support 30/71430/1
Anil Belur [Tue, 21 Mar 2023 11:24:16 +0000 (16:54 +0530)]
Chore: rm py2.7 and add py3.8 and py3.9 support

Update the PyPI setup config to remove Python 2.x support
since it is EOL and add support for Python 3.8, 3.9.

Change-Id: Ie7595bbd4a5673bdeef123a34a7d08b73a03d0c5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
19 months agoFix: Remove shade deps from tox 24/71424/2 v0.37.3
Anil Belur [Fri, 17 Mar 2023 16:59:31 +0000 (22:29 +0530)]
Fix: Remove shade deps from tox

Shade libs are deprecated therefore no longer required
to be installed. Remove whitespaces in EOL.

Issue-ID: RELENG-4644
Change-Id: I06226186cc80d5cb6da41b35f7a9fdf8309bf32d
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
19 months agoFix: Replace shade library with openstacksdk 23/71423/6
Bengt Thuree [Fri, 17 Mar 2023 12:25:44 +0000 (23:25 +1100)]
Fix: Replace shade library with openstacksdk

The shade library has been depreciated. Replace shade library
with openstacksdk for remaining openstack commands.

Issue-ID: RELENG-4644
Ref: https://docs.openstack.org/releasenotes/shade/stein.html
Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org>
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: Ie45f6ba7862a1bd3f471d469286b042512604c54

23 months agoMerge "Fix: Replace v1 dockerhub api with v2 json files" v0.37.2
Eric Ball [Wed, 7 Dec 2022 16:12:38 +0000 (16:12 +0000)]
Merge "Fix: Replace v1 dockerhub api with v2 json files"

23 months agoFix: Replace v1 dockerhub api with v2 json files 86/70986/6
Bengt Thuree [Thu, 10 Nov 2022 05:31:57 +0000 (16:31 +1100)]
Fix: Replace v1 dockerhub api with v2 json files

Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org>
Change-Id: Iac2e23671bb421745099a1b4cbc56187ab39474f

23 months agoFix: Improve parameter handling in os/image cleanup 70/70970/10 v0.37.1
Matthew Watkins [Mon, 7 Nov 2022 16:55:51 +0000 (16:55 +0000)]
Fix: Improve parameter handling in os/image cleanup

Issue: RELENG-4467
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: If91463f83c4be698415e695a83f10f416e379dac

2 years agoFix: Correct file path and url parsing 43/70743/3 v0.37.0
Eric Ball [Tue, 27 Sep 2022 21:07:17 +0000 (14:07 -0700)]
Fix: Correct file path and url parsing

These two bugs are both blocking our info-master job, so they are
being grouped together. One is an issue with using an absolute rather
than relative file path when adding a file to git. The other is
parsing the url with safe slashes, which was causing issues with
creation of repos that have slashes in the name.

Issue: RELENG-4461
Change-Id: Ia63ffc5f157bfb5285e8c6bdb2274a91a384a3f4
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoFix: Mislabelling of function description 70/70570/2
Matthew Watkins [Tue, 30 Aug 2022 14:43:44 +0000 (15:43 +0100)]
Fix: Mislabelling of function description

Issue: RELENG-4391
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: I65b4b14604c8b536ee5663a43b3b004f701e5660

2 years agoCI: Enable pre-commit validation via MyPy 48/70548/1
Andrew Grimberg [Fri, 26 Aug 2022 20:19:43 +0000 (13:19 -0700)]
CI: Enable pre-commit validation via MyPy

Start enforcing proper annotation defintions by way of MyPy validation

Issue: RELENG-4388
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I2776f4f578856da4478637a33711a47a4ba2ef1a

2 years agoRefactor: Cleanup MyPy errors 47/70547/1
Andrew Grimberg [Fri, 26 Aug 2022 20:15:40 +0000 (13:15 -0700)]
Refactor: Cleanup MyPy errors

While preparing to start enforcing MyPy validation by way of pre-commit
several redeclarations of click command / functions were found. After
examining the errors from MyPy these were determined to be faulty in how
they were being implemented. They were not caught before as no linter
was in place that could easily catch it.

Issue: RELENG-4388
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I35c2502cb08f5502fb30e3d14ac083c30209635c

2 years agoChore: Update pre-commit hooks 46/70546/3
Andrew Grimberg [Fri, 26 Aug 2022 18:07:40 +0000 (11:07 -0700)]
Chore: Update pre-commit hooks

* github.com/pre-commit/pre-commit-hooks: v4.0.1 -> v4.3.0
* github.com/jorisroovers/gitlint: v0.15.1 -> v0.17.0
* github.com/ambv/black: 21.8b0 -> 22.6.0
* github.com/PyCQA/isort: 5.9.3 -> 5.10.1

* Update tox pre-commit environment to be py37 for base python matching
  our global minver, this is required to get pre-commit to properly
  install under tox

Issue: RELENG-4387
Change-Id: Iffaf00c6100237141140ba5524068964c406c8cc
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
2 years agoCI: Require RELENG changes in commit messages 14/70514/1
Andrew Grimberg [Wed, 17 Aug 2022 17:38:03 +0000 (10:38 -0700)]
CI: Require RELENG changes in commit messages

To make sure that JSD issues are not being referenced since that is not
public data, we will now start enforcing a requirement that commits have
a RELENG issue associated with them.

Issue: RELENG-4375
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: Ibd30e0f0f1b0ab5393dfd84bf080ab6671936c85

2 years agoFix: Bugs in git.gerrit on nexus3 and sanity_check 05/70505/1 v0.36.2
Eric Ball [Mon, 15 Aug 2022 21:10:42 +0000 (14:10 -0700)]
Fix: Bugs in git.gerrit on nexus3 and sanity_check

Issue: RELENG-4366
Change-Id: I88f71ea3ffe746b46a5ee599db99aeee0e9bd3e8
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoFix: Gerrit create_project check results 62/70462/1
Eric Ball [Mon, 8 Aug 2022 14:59:17 +0000 (07:59 -0700)]
Fix: Gerrit create_project check results

The create_project method is not hitting the correct URL, but will
still often receive HTML from the server and a 200 status. We need to
check the validity of the returned data, and use the status of a bad
return as the exit code so that scripts can properly react to the
error encountered.

Issue: RELENG-4355
Change-Id: Icc3a769f0fa9aba61142bef11bd81821e1fa5356
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoMerge "Fix: Print upload size with deploy nexus stage"
Andrew Grimberg [Mon, 6 Jun 2022 21:56:14 +0000 (21:56 +0000)]
Merge "Fix: Print upload size with deploy nexus stage"

2 years agoFeat: Add get-private-keys to lftools.jenkins 86/70186/4
Anil Belur [Wed, 25 May 2022 01:35:09 +0000 (11:35 +1000)]
Feat: Add get-private-keys to lftools.jenkins

Add ``get-private-keys`` to lftools.jenkins.

The ``get-private-keys`` command retrives the private keys and passphrases
stored in the credential store. This feature will add the
command ``get-private-keys`` in order to print these values.

Issue-ID: RELENG-4245
Change-Id: Iff0cab0b14d43bea540ca513ade08a5e330836e4
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
2 years agoFix: Print upload size with deploy nexus stage 37/70037/2
Anil Belur [Sun, 7 Nov 2021 06:18:04 +0000 (16:18 +1000)]
Fix: Print upload size with deploy nexus stage

Print upload size in the logs after deploying Nexus
stage repositories. This is useful while comparing
the repository sizes.

Change-Id: Ie8cff4ae6e026177cd43c309d4f3a36bab9c7beb
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
2 years agoFix: INFO job template and sanity_check call 35/70035/2 v0.36.1
Eric Ball [Fri, 15 Apr 2022 13:07:43 +0000 (06:07 -0700)]
Fix: INFO job template and sanity_check call

The INFO job template was improperly formatted. The sanity_check call
is to a class method, and requires and positional argument for "self"
(this does not need to contain anything; it is just filler in this
case).

Change-Id: I1dcbc456bf31e907821ab4c5aee7c324dbd70722
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoFix: Do not fail tox if gerrit.acumos.org is down 00/70000/1
Bengt Thuree [Tue, 12 Apr 2022 12:55:41 +0000 (22:55 +1000)]
Fix: Do not fail tox if gerrit.acumos.org is down

Issue-Id: RELENG-4181
Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org>
Change-Id: I3a1228e77fd7fdc0ae723c26cff420da8f299fa3

2 years agoFix: Force delay (take 2) between docker get calls 05/69905/2
Bengt Thuree [Thu, 24 Mar 2022 08:54:50 +0000 (19:54 +1100)]
Fix: Force delay (take 2) between docker get calls

Docker has introduced a 429 error return code
if there site is called to quickly.

Retry after 60 seconds after every 429 return code,
up to 19 times. Then fail.

Issue-ID: RELENG-3711

Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org>
Change-Id: I51d23fa9a2da1dc7cc30afceae4f35942bb42182

2 years agoMerge "Fix: Force delay between docker get calls"
Andrew Grimberg [Wed, 23 Mar 2022 20:16:19 +0000 (20:16 +0000)]
Merge "Fix: Force delay between docker get calls"

2 years agoFix: Force delay between docker get calls 84/69884/1
Bengt Thuree [Wed, 23 Mar 2022 04:09:06 +0000 (15:09 +1100)]
Fix: Force delay between docker get calls

Docker has introduced a 429 error return code
if there site is called to quickly.

Delay 0.5 seconds after every pull, to avoid to fast requests.

Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org>
Issue-ID: RELENG-3711
Change-Id: Ic5ac8da65903c0445092d74168ff9fd1dc0068bd

2 years agoFeat: New method add_maven_config for JCasC config 02/69802/4 v0.36.0
Eric Ball [Fri, 4 Mar 2022 20:21:19 +0000 (12:21 -0800)]
Feat: New method add_maven_config for JCasC config

This method allows for adding settings files for new projects via
JCasC, rather than the old method of using a Groovy script to manually
add the file to Jenkins.

This also removes the __del__ function. The function was not entirely
necessary, and was causing issues with unit testing. All work is done
in /tmp, so these files will be automatically cleaned by the system.

Issue: RELENG-3893
Change-Id: I03511b9c3e1c9f9c9f79054bd6f8991cd274e8f5
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoFeat: Move git functions to use python git lib 17/69717/9
Eric Ball [Wed, 2 Feb 2022 23:33:03 +0000 (15:33 -0800)]
Feat: Move git functions to use python git lib

Issue: RELENG-4052
Change-Id: Iafaa078b24838135dd67ec0ac53b1d83de13ae8b
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoTest: Speed up Nexus tests 20/69720/3
Eric Ball [Tue, 22 Feb 2022 18:58:04 +0000 (10:58 -0800)]
Test: Speed up Nexus tests

By patching the sleep function, we can remove about 25 seconds of
pauses during unit testing of release_staging_repos method.

Issue: RELENG-4052
Change-Id: I8692c1183d70873348616435074b9b69193dda41
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
2 years agoFeat: Add get-secrets to lftools.jenkins 23/69623/1
Eric Ball [Thu, 3 Feb 2022 00:13:31 +0000 (16:13 -0800)]
Feat: Add get-secrets to lftools.jenkins

Get-credentials only produces username/password credentials, which
does not include "secret text" stores. This feature will add the
command "get-secrets" in order to print these as well.

Change-Id: Iac1911b486be1dc125a42b23595431c7065adfce
Signed-off-by: Eric Ball <eball@linuxfoundation.org>
3 years agoFix: Create temp file in empty dirs for S3 log dir 93/68993/17 v0.35.11
Anil Belur [Wed, 20 Oct 2021 03:32:44 +0000 (13:32 +1000)]
Fix: Create temp file in empty dirs for S3 log dir

Since S3 buckets does not have an underlying file system to view empty
directories, an temp file has to be created when referencing the directory.
This allows empty folders to be viewed through cloudfront, without
returning a 404 error.

Create temp file in the format: "_%d%m%Y_%H%M%S", would
help with future clean or debugging.

Issue-ID: RELENG-4016
Change-Id: I0a635cd32da860deaada0ac0cc15bf1aa5fc2d4a
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
3 years agoChore: Configure Flake8 linter 91/68391/8
Thanh Ha [Sat, 31 Jul 2021 11:47:00 +0000 (07:47 -0400)]
Chore: Configure Flake8 linter

This adds Flake8 to pre-commit and removes the unused config in tox.ini.
Not sure why Flake8 was disabled but config in tox.ini suggests that
it was there at one point.

Change-Id: I93c9a6e4562f957f75f28a3842ae29eb8df67fb9
Signed-off-by: Thanh Ha <zxiiro@gmail.com>
3 years agoRefactor: Resolve remaining flake8 violations 62/68962/1
Thanh Ha [Sat, 9 Oct 2021 14:39:41 +0000 (10:39 -0400)]
Refactor: Resolve remaining flake8 violations

- E304 blank lines found after function decorator
- E402 module level import not at top of file
- E741 ambiguous variable name 'l'
- F522 '...'.format(...) has unused named argument(s): end
- W601 .has_key() is deprecated, use 'in'

Change-Id: I2607e7bb195f6175a7b331e89870fa23e225e31c
Signed-off-by: Thanh Ha <zxiiro@gmail.com>