Merge "Fix: Update GHA workflow for common-packer"

Fix: Update GHA workflow for common-packer

Issue: RELENG-5175
Change-Id: I4077f6ae5df9cf4b9559ada5f331323a110613f0
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Re-factor repo to work with ansible 9.2.x

- The ansible roles have been updated to run on latest version on
  Ansible and python 3.10.x are pulled in by common-packer returns
  several errors with newer version of Ansible.
- The new version of ansible 9.2.x requires the code to be refactored
  and moderenized accordingly.
- Update tox to run ansible lint.
- Fixes the following Violation Summary:
     count tag                   profile    rule associated tags
     1 command-instead-of-module basic      command-shell, idiom
     2 key-order[task]           basic      formatting
     4 literal-compare           basic      idiom
     6 jinja[spacing]            basic      formatting (warning)
     5 no-free-form              basic      syntax, risk
     4 partial-become[play]      basic      unpredictability
     4 schema[playbook]          basic      core
     4 name[missing]             basic      idiom
    11 name[play]                basic      idiom
     3 yaml[octal-values]        basic      formatting, yaml
    18 yaml[truthy]              basic      formatting, yaml
     5 name[casing]              moderate   idiom
     2 risky-file-permissions    safety     unpredictability
     3 no-changed-when           shared     command-shell, idempotency
    38 fqcn[action-core]         production formatting
    11 fqcn[action]              production formatting

Issue: RELENG-5175
Change-Id: I2c6af03d197236328e2389f4694edab3fe40bfc4
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Chore: Update lfit/checkout-gerrit-change-action

Update to latest v0.8
Update pre-commit deps to the latest

Change-Id: I7a07de690a17218157d1f65898e4cf296b0428a4
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Update ansible and python > 3.10

ERROR: 9.0.1 Requires-Python >=3.10; 9.1.0
Requires-Python >=3.10; 9.2.0 Requires-Python >=3.10

Update ansible to 9.2.0

Change-Id: I46d78f3e77a5cad0d7ce1cc1074fc8e7ac53c3d0
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Chore: Update to gerrit-review-action@v0.5

The gerrit-review-action@v0.3 shows the deprecation warnings that is
fixed in v0.5.

Warning: Node.js 16 actions are deprecated. Please update the
following actions to use Node.js 20: shimataro/ssh-key-action@v2.5.1.
For more information see:

Ref: https://github.blog/changelog/2023-09-22-github-actions-transitioning-from-node-16-to-node-20/.
Change-Id: I1f193dd1f8e9bae2b35ca5c3864aa2e8283ba99c
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Feat!: Upgrade to Ansible v2.15.9

Change-Id: I7f33da87c13724da6111992017d78bd0edd22aad
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Add missing double quote

The 7f5b5f010949c introduced a typo which break the GHA verify.

Issue: RELENG-5094
Change-Id: I767da30bb98b3c4f75d3a94fca76259b0e1a6cc0
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Chore: Update CentOS Stream 9 to latest

Issue: RELENG-5094
Change-Id: If5d851e1a49f7052e6a4a9e8307109cdf87b4ac7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

CI: Remove release email

The lf-releng@lists.linuxfoundation.org mailing list is going away.
GitHub releases are already being generated (though the release notes
generation doesn't seem to be working 100% correctly) but this needs to
happen or we start getting failures soon.

Issue: RELENG-4931
Change-Id: I0a2e61cf67b1fd6fef38718d83a1531bc65825ef
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Chore!: Deprecate JSON format var and templates

With the release of common-paker v0.14.0 (6e2fdc9fb5be1d9843d14b6a)
the packer version v1.9.x supports only HCL format templates and var
files. These older JSON format files are no longer used with the
packer verify and merge jobs.

All  packer templates have been migrated from JSON to HCL2 format
with v0.14.X release.

JSON format templates are deprecated and no longer used with packer
version > 1.9.x. Therefore remove the deprecated files from the
repository.

Change-Id: I95c9a7fa434d57555ecdc8b02af5ef10b70f0ed7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Rename HCL packer files example

Change-Id: Ibf65b3c2264c393934c6c8f1459e48c0970b02f6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Run command should be a standard text fold

Using >- breaks as it tells the yaml parser to stick all lines together
as a single command which is incorrect.

Issue: RELENG-4974
Change-Id: I5d362c44efc948242edb40619a731f0096625ec4
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix: Move the git fetch depth

It is not possible to specify a depth larger than 1 with the tag
checkout that is performed. Move the depth increase to where it's
actually needed.

Issue: RELENG-4974
Change-Id: If5e01eebbd9100023a2e442c7682219bee51d4d2
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Generate GitHub releases

* Increase the checkout depth from 1 to 30 to handle reno needing to be
  able to find all relevant tags (current and current -1) and also pull
  the tags
* Setup Python to run reno
* Generate a reno report for the given tag and then modify the report to
  strip out all the extra garbage that is added by the report process to
  get it into a valid markdown file and not RST file
* Use `gh` cli tool to generate the release notes using the
  auto-changelog generation plus the reno release notes

Issue: RELENG-4974
Change-Id: Iff10b3b6bbf1e88708a89a12338cb042bafe42fe
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Merge "Chore: Openstack/devstack template updates"

CI: Remove actionline step

Actionlint is throwing shellcheck errors on bash that cannot be worked
around at this time.

Issue: RELENG-4764
Change-Id: If5fe2c320616b19f7cc13557de4386b3ffd3264c
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Update GH actions workflow for common-packer

Issue: RELENG-4764
Change-Id: I611c0e15519aa25f6510b19d9f63285bf247e0b5
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Correct typo in GHA packer validation workflow

Issue: RELENG-4765
Change-Id: Ie21c687d92a16a6f24f390d99dfdab6d3ec2ac45
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>

Fix: Remove unwanted extra args

RSA/SHA-1 was deprecated since the OpenSSH release 8.8.
This causes builds with latest version of packer to fail with the
below error:

Error:

Data could not be sent to remote host "127.0.0.1". Make sure this
host can be reached over ssh: command-line: line 0: Bad
configuration option: pubkeyacceptedalgorithms.

Add workaroud and pass required HostKeyAlgorithms through ssh extra
argumements. Testing with cloud builds and since we are using multiple
flavors the only options required are "IdentitiesOnly=yes"
and "HostKeyAlgorithms=+ssh-rsa".

Issue: RELENG-4764
Ref: https://github.com/hashicorp/packer-plugin-ansible/issues/69
Change-Id: I80ff152d5153d739d6586c217fbc392e8be80f2a
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Feat!: Convert packer templates to HCL2 format"

Chore: Openstack/devstack template updates

Add further Ubuntu packages and fix missing conditional statements

Issue: RELENG-4765
Change-Id: Ic1a42f501a688eeb8202cd8baa1e1da21512aed3
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>

Feat!: Convert packer templates to HCL2 format

As of packer version 1.7.0 HCL2 is the preferred way to write Packer
templates. HCL2 preserves existing workflows while leveraging HCL2’s
advanced features like variable interpolation and configuration
composability.

Migrate packer templates from JSON to HCL2 format. JSON format
templates are deprecated and no longer works with packer
version > 1.9.x.

Packer version 1.9.1 will be minimum required version for packer jobs.
This version requires installing the cloud specific plugins through
packer config and needs to be initalized and downloaded with
`packer init` before running `packer build`.

Add support for host key algorithms to work with local ssh proxy
without which packer builds results in "failed to handshake" error.
Workaround is to pass additional params with "extra_arguments".

Support for '.json' templates will be removed from common-packer in
subsequent releases. All projects specific templates not available in this
repository are required to convert existing '.json' to '.pkr.hcl' format.

This change requires updating CI jobs with the additional steps.

Ref:
https://developer.hashicorp.com/packer/docs/templates/hcl_templates
https://github.com/hashicorp/packer-plugin-openstack/blob/main/README.md
https://github.com/hashicorp/packer-plugin-ansible/issues/140

Issue: RELENG-4764
Change-Id: Ie63d9551bd1bab224dc9335d45a21d5ee3e09550
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Feat: Modify Devstack templates to include Debian/Ubuntu

Issue: RELENG-4765
Signed-off-by: Matthew Watkins <mwatkins@linuxfoundation.org>
Change-Id: I3dbd5152b32a79673d92d00fa022793cf3caecfb

Fix: Remove delta rpm deps for CentOS Appstream 8

delta rpm is no longer available.

Issue: RELENG-4760
Change-Id: I172445e022fea08f20ef35f1802393ca8d01b722
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

CI: Remove packer-validation temporarily

The job needs to be re-designed for github
disable the job for voting until then.

Issue: RELENG-4761
Change-Id: Id9ba4e706f7802fb4cfd3770d977359e3052d0d4
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Feat: Add Openstack devstack template

Move the Openstack devstack templates to build VM's with devstack
installed and ready for testing. ORAN community has requested devstack
images to be available on the CI env.

The templates and provision files have been tested to build the latest
version of the devstack yoga on the CI.

ZZCI - CentOS Stream 8 - devstack-yoga - x86_64 - 20230612-132235.763

Issue: RELENG-4760
Change-Id: I60d37d769158f34b22b84111fd5229c616232c27
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: prefix github.workspace

Issue: RELENG-4761
Change-Id: Iefb62656aa0d6ba4e5e4b69ae6b7c739e8184155
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: pre-fix $HOME before var and templates

Issue: RELENG-4761
Change-Id: Iae022ef868236ccaf3d84bb76f87cecf941395cd
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Update packer validate script

Issue: RELENG-4761
Change-Id: Idefc0a43c2f47aa6834fe7809911add73289c3de
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

CI: Add GHA packer validation job

Issue: RELENG-4761
Change-Id: I48283360f553d4c4f1fd902e8868f6d7a86a4bd7
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Correct version label for GHA call

Issue: RELENG-4563
Change-Id: Ib677bb53ac47e27501c668d9bd744d61bee9613e
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix: Correct bad actions call

Issue: RELENG-4563
Change-Id: Ia368fed2b62d51bef3895b6f6cf9bd49042d6456
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix: Correct bad var def in release workflow

Issue: RELENG-4563
Change-Id: Ifcd528f511410ed1b3363890e58e37903de3b32f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Merge "Chore: Update pre-commit hooks"

Merge "CI: Add GHA release workflow"

Merge "Refactor: Cleanup some pre-commit issues"

CI: Add GHA release workflow

Issue: RELENG-45633
Change-Id: Id0ce3d3888047a11c3f674cf2c9ba8b06a64c690
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Chore: Update pre-commit hooks

* github.com/pre-commit/pre-commit-hooks: v4.0.1 -> v4.4.0
* github.com/pre-commit/mirrors-prettier: v2.3.2 -> v3.0.0-alpha.6
* github.com/jorisroovers/gitlint: v0.15.1 -> v0.19.1
* github.com/jumanjihouse/pre-commit-hooks: 2.1.5 -> 3.0.0

Issue: RELENG-4563
Change-Id: Ie147b72b9e939ec57f4da56a9c2f220e2759fff2
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Refactor: Cleanup some pre-commit issues

* Cleanup some pre-commit issues
* Re-enable pre-commit as part of the default tox run
* Fix shellcheck error

Issue: RELENG-4563
Change-Id: I40b94b8dd2512118ebe0afcac556a42161cedbc8
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Docs tests require full repo history

Issue: RELENG-4563
Change-Id: Id3bcb21f1369c490e0dd35eccb35a488c27b2586
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Add GitHub Actions verify

Issue: RELENG-4563
Change-Id: Ie1d605c40e0aa3e7a9db7fe3bcfde059b50070ba
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Docs: Fix broken docs link

Correct a docs link that should be using an ignored example domain

Issue: RELENG-4563
Change-Id: Id8dbf72c6cc55a46d30248738b57813fad08663f
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Fix: Skip ansible provisioners version check

Packer provisioners invokes ansible version check which can be
skipped since the provisioner is invoking a custom script.

Issue-ID: RELENG-4473
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I661984bfc34857ff5ec42c63a695074f27e1492b

Feat!: Install ansible tools from PyPI

Install ansible through system packages causes dependencies
conflicts on CentOS 8 platform therefore update packer
templates to use ansible provisioner created
through venv.

Error:
Problem: package ansible-5.4.0-3.el8.noarch requires
(ansible-core >= 2.12.2 with ansible-core < 2.13), but none
of the providers can be installed

Issue-ID: RELENG-4473
Change-Id: I1d562386b4408c9674271e813dcd2aea6632e709
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Update Ubuntu installs on aarch64

Do not change package mirror for aarch64 systems as this breaks since
most mirrors do not carry the packages

Change-Id: I800e83295bba8b55e9376fc735cd9f7b21fddf32
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Require RELENG changes in commit messages

To make sure that JSD issues are not being referenced since that is not
public data, we will now start enforcing a requirement that commits have
a RELENG issue associated with them.

Issue: RELENG-4375
Change-Id: I37150383e0e986438fea01d549aa803f2f038100
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Feat: Upgrade git to v2.36 for CentOS7

- v2.24 packages are no longer available on the CentOS mirrors.
  Disable warning to use yum module.
- Fix install python script to check python/python3 to test, since
  the default python3 is not available on CentOS7 platforms.
- Print the default version of python installed.

Issue-ID: IT-24376
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: Id48ad72aba776ed4092a292c4db1ad6459d9ab64
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Import the correct gpg keys for sigul and EL8

Sigul 1.1.1 is signed by the Fedora infrastructure key
therefore import the Fedora infra key before installing
the updated version on Sigul for CentOS8.

Import the EL8 GPG keys without which would fail
while installing several dependencies.

Issue-ID: IT-24054
Change-Id: I440b263ebb5f424496f21aa15e58bf7b34279f6e
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Update doc refs to acumos

Acumos resources on the infra are decommissioned,
update the examples pointing to another project.

Change-Id: Ie3ea1892ed99d9ed7917c700fac35bf566a92c47
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Feat: Add support for CentOS Stream 9

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: If80413b418a1783efbc5f5c81d315abd5c64cb07

Chore: Update Ubuntu/Centos base images

Update RAW base images for Ubuntu 18.04, 20.04
and Centos 7

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I2de5f6fb3aa354b85821e317fb2ceca0ac3b5eb0

CI: Disable pre-commit in CI

Packer has been having issues creating new images for a bit and
pre-commit is no longer working in CI because of something upstream
because of this.

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I55cbfdb656294c980b1c499746404fc523202f1c

Fix: Install Sigul 1.1.1 for EL8 (CentOS Stream 8)

Sigul requires python3-nss that is only available through
dnf module repo (pki-{core,deps}). These additional repo
need to be enabled for the Sigul to pull in the required
dependencies.

Note: `dnf module install|enable` is available through
Ansible playbooks, so use the command module instead.

Issue-ID: LF-JIRA IT-23826
Change-Id: Iff194240fc417ae92a2ea6caf0511c85cc973b41
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Chore: Update to python38

The provisioning script fails with errors while
trying to install python36 on CentOS8 image build.

python 3.6 is EOL, bump the install script to use python 3.8.

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I0431ee938c9da1c254e9ccc80c0e7d760bbde0ff

Fix: Use lowercase for CentOS Stream var file

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I32edf055ce807fbcfc2b176fdfbd943256efa782

Feat: Add support for CentOS Streams 8

Issue-ID: RELENG-4141
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I172aa7399e5f235082f058c7ab4690d83c5ad381

Chore: Update base images for Ubuntu

Update base images for Ubuntu 18.04 and 20.04
ARM and x86

Issue: RELENG-4010
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I243b0547173afb79f38755c74dc4891a71b551ea

Chore: Update Ubuntu 18.04

Update base image for Ubuntu 18.04

Issue: RELENG-3989
Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I1821b6678745c89842936ced72e8cda06abf939b

Chore: Upgrade pre-commit hooks

* github.com/pre-commit/pre-commit-hooks: v3.4.0 -> v4.0.1
* github.com/pre-commit/mirrors-prettier: v2.2.1 -> v2.3.2

Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>
Change-Id: I5499abc30a514568d7a4fe30f679d10c4fff5a22

Fix: Add missing Release Notes for latest packer

Add Release Notes for packer requirements changed
recently.

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: I459c7da09c3a5262e4093d98c763a21dd73df0b3

Fix: format of requirements.yaml

Signed-off-by: quentinDERORY <quentin.derory@ecole.ensicaen.fr>
Change-Id: Ibaef85987792566938a0ea7ef397148701c371ca

Chore: Add new galaxy requirement for magma project

Signed-off-by: quentinDERORY <quentin.derory@ecole.ensicaen.fr>
Change-Id: I6a884a6d3c831222a095d1f75f958f1eed18c815

Fix: Use Vexx provided base images

Use base images provided by Vexx instead of
LF's ones.

Signed-off-by: Jessica Wagantall <jwagantall@linuxfoundation.org>
Change-Id: If2ecdf622235ae82211bd0051314713775676c23

Fix: Enable powertools repo for CentOS 8.* vers

The CR I43b943ddfc38faca does not work as expected since
ansible_facts does not match/return the minor versions of
the Repoid correctly.

For CentOS 8.2.2004 and earlier versions uses repoid as
'PowerTools' while CentOS 8.3.2011 and later versions uses repoid as
'powertools'. To handle this, check the repo file name under
/etc/yum.repos.d/ and enable the correct repository.

Ref: https://wiki.centos.org/Manuals/ReleaseNotes/CentOS8.2011\
Issue: RELENG-3710
Change-Id: Ib6a8d78664bbb5f20d2889fae3ae3b4238007141
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: AMI product codes need to be defined

While trying to upgrade the internal Jenkins to latest global-jjb and
common-packer it's been found that all of our configurations for AWS
systems are missing vital filters.

The Ubuntu product codes were found by doing the following:

aws ec2 describe-images --region us-west-2 \
  --owners aws-marketplace --filters \
  "Name=architecture,Values=arm64" \
  "Name=name,Values=*ubuntu*20.04*" \
  "Name=manifest-location,Values=aws-marketplace/ubuntu/*"

This is per documentation found at
https://ubuntu.com/server/docs/cloud-images/amazon-ec2

Issue: RELENG-3757
Change-Id: I9391f6bec59318e00bc1b097c7a27181defeccff
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Configure gitlint for Conventional Commits

Turn on Conventional Commit message subject validation. This will affect
CI specifically, but developers can avoid having CI fail by assuring
that they have installed pre-commit and that they have also run

pre-commit install --hook-type commit-msg

The above is needed because pre-commit does not install commit-msg hooks
by default

Change-Id: I99779c6188ab2a4e57022a4ac552cbc3749accc2
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

CI: Update pre-commit and make it work properly in CI

Change-Id: Idf2dbf580ca14af8a3c868a385658b4d51c4de9e
Signed-off-by: Andrew Grimberg <agrimberg@linuxfoundation.org>

Feat: Add support for Docker builder on Windows

The original change e24c07369afd514abdf3efb0f596f772261412ed
missed updating Windows var files, while the builder templates were
updated. This breaks the packer verify jobs.

Error:
    required variable not set: docker_source_image'

Change-Id: Iac258a0ff132e12e00a49d9d02ce0f1806bef016
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Feat: Add support for Docker builder on arm64

The original change e24c07369afd514abdf3efb0f596f772261412ed
missed updating arm64 var files and Ubuntu 20:04 var file,
while the builder template were updated. This breaks the
packer verify jobs.

Error:
* required variable not set: docker_source_image'

Issue: RELENG-3717
Change-Id: I1f3acf1479bf7a4ab271f747da5261ee2619e566
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Fix: Change powertools repoid to lowercase

The repoids are renamed with CentOS 8.3 update breaks the packer
builds. Now the correct repoid to use is 'powertools' instead
of 'PowerTools'

Error: No matching repo to modify: PowerTools.

Ref:
https: //wiki.centos.org/Manuals/ReleaseNotes/CentOS8.2011#Yum_repo_file_and_repoid_changes
Issue: RELENG-3710
Change-Id: I43b943ddfc38facaa8c02f2d6ee98254e7ee3241
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add docker-aws template

We now have at least one project on AWS that needs a docker template.

Issue: IT-21917
Change-Id: Ia08a1a32eb2ffaab46b1f01468018de688423852
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Merge "Use official CentOS & Ubuntu images via prodId"

Use official CentOS & Ubuntu images via prodId

The previous filter method could result in getting an unexpected image
even one that's entirely different than what is intended. This patch
uses a product-code search of the marketplace for the official upstream
supported images rather than the custom ones provided by Amazon.

This patch is based on Zack William's suggestion on the lf-releng
mailinglist.

Reference:
https://lists.linuxfoundation.org/pipermail/lf-releng/2020-February/000135.html

Change-Id: Ia6208bd7a61036eb210d07533e3ceedbbc787678
Co-authored-by: Zack Williams <zdw@opennetworking.org>
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Add support for a Docker builder

Adding a Docker builder will allow us to more easily test build images
locally in a container before pushing a patch to production to build
the VMs themselves. While not guarenteed to be exactly the same it's
a close enough approximation that many issues can be caught before
patches are pushed.

Additionally this allows projects to also use the same packer templates
to build container based builder nodes if there's any projects using
Docker for their Jenkins jobs.

Issue: RELENG-1052
Change-Id: If89801cea16046900e7e880265ad859a96595fa1
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Merge "Update CentOS8 image"

Fixing netselect in install-python

Actually use the result from netselect

Issue-ID: CIMAN-30

Signed-off-by: Bengt Thuree <bthuree@linuxfoundation.org>
Change-Id: I31b5858dc4b348f383f3b801b17c1aa8547296bd

Update CentOS8 image

Change-Id: If34cb35b7b54b7015e7c20a53c9ace9c10db5500
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Migrate jobs from lf-standard-1 flavor to v3"

Update shellcheck pre-commit hook to 2.1.5

With 2.1.5 release the workaround added in
d7d264e733e5 is no longer required.

Change-Id: I7e890d03844a2fb47159ad471f166310290fbf9f
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Migrate jobs from lf-standard-1 flavor to v3

v3 flavors guarantees jobs spin on newer hardware that
are faster and cost-efficient than the v2 flavors.

Issue: RELENG-3329
Change-Id: I97f8d540f02fdccb3115bc624b167eb12464833b
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add workaround to for shellcheck failure

The shellcheck hook breaks with the latest version of pre-commit (2.1.1)

[ERROR] The hook `shellcheck` specifies `additional_dependencies`
but is using language `script` which does not install an environment.

Ref:
https://github.com/jumanjihouse/pre-commit-hooks/pull/81

Change-Id: I19d8b26a7589d0bde7f1d3c6f768b738289ab937
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Revert "Set packer builder type with env variable"

This reverts commit cc035619ac1673a5b5ea2f6bfb843eac75ea4a9d.

Based on the input provided on the Gihub packer issue
hard-coded for our parser to be able to decode the rest of the config
properly."

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: If63b83eae7baa8ab6b30d8b9b187aa219ec2ba44

Revert "Set packer builder type with env variable"

This reverts commit 8041971ef211709579f919bdeb9a77fef0a29433.

Based on the input provided on the Gihub packer issue
hard-coded for our parser to be able to decode the rest of the config
properly."

Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I52ef1448fc53b2b9777786994683fbd705a1f8ba

Set packer builder type with env variable

Using the -only CLI option for packer build does not work as
expected. The #CR 90dd675df482a8 (global-jjb) submitted with
common-packer v0.7.0 fails to build packer jobs because of a
bug in the packer build CLI.

The `-only` option packer build CLI does not set the cloud
provider name/type as per the documentation. The alternative
is to use an environment variable that is passed through the
packer job and can be reference in the packer templates.

The CR cc035619ac16 missed including the changes to the other
templates.

Issue: https://github.com/hashicorp/packer/issues/10495
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>
Change-Id: I14976aa77312a3d887d30b7d6e2cc32ab8073b72

Set packer builder type with env variable

Using the -only CLI option for packer build does not work as
expected. The #CR 90dd675df482a8 (global-jjb) submitted with
common-packer v0.7.0 fails to build packer jobs because of a
bug in the packer build CLI.

The `-only` option packer build CLI does not set the cloud
provider name/type as per the documentation. The alternative
is to use an environment variable that is passed through the
packer job and can be reference in the packer templates.

Issue: https://github.com/hashicorp/packer/issues/10495
Change-Id: I1c1e2e7c5545df5a2a374a02714634a0f4086378
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Remove openstack AZ from templates

The availability zone started causing issues with packer builds. Per
Vexxhost help, there is only one AZ, and removing this line
alleviates the issue.

Issue: RELENG-3344
Change-Id: Icf60fe527ae328d7883ef38c3efba9972d2f2669
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Update prettier URL for pre-commit

Issue: RELENG-3344
Change-Id: I07daf63bcb03252367b11a64f44c938bf807eea6
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Merge "Workflow for updating images."

Workflow for updating images.

documenation on:
"Update Packer Base Image"
and
"Update Packer Images to reflect changes
in LF ansible galaxy roles"

ISSUE: RELENG-2363
Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: Ia2bac9c336772742bf58058114b1668498cfcbd3

Add Ubuntu 20.04 arm64 image

Issue: JSD IT-20435
Change-Id: I5f21934ec15754892d3ebea826965167edb84601
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Add Ubuntu 20.04 amd64 image

Issue: JSD IT-20435
Change-Id: Iec986b683fe168c417c40c0815d743d28c288dd6
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Merge "Add support for Ubuntu 20.04 and newer"

Ensure sudo is installed as Ansible requirement

Ansible requires sudo to be available and Docker images do not
typically come with sudo pre-installed so add code to ensure it
get's pulled in.

Issue: RELENG-1052
Change-Id: I8e67f7048f2199f208c7596cb7b7c6182e61ed51
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Rename vexxhost to openstack for builder names

Considering the AWS builders are named AWS after the service let's
rename the vexxhost ones to openstack. As far as I am aware we are
not supporting multiple providers with the same backend at the same
time so this will make things consistent.

When we later add docker support it will just be called "docker" as
well.

Issue: RELENG-1052
Change-Id: I8f46d544961e508cdeee28d4e761c2feae5e744e
Signed-off-by: Thanh Ha <zxiiro@gmail.com>

Add support for Ubuntu 20.04 and newer

Ubuntu 20.04 no longer has python-* packages and instead the packages
are now more explicitly either python2-* or python3-* with packages
named python-is-python[23] to set the default. This patch when run
on Ubuntu systems will check if python-is-python3 is available and
installs that as the system python version, otherwise installs
python-minimal.

Also adjust the comments since they are no longer accurate or in the
right places.

Signed-off-by: Thanh Ha <zxiiro@gmail.com>
Change-Id: I830e0250ddbee395fdeddd78fcc7824f7855d75d

Update Ubuntu 18.04 base image

Change-Id: I4b40ff1c84cfa2f64235b3a8132e6d43baea1f3a
Signed-off-by: Anil Belur <abelur@linuxfoundation.org>

Update Ubuntu base image to 2020-07-28 snapshot

base image was uploaded in qcow2 format.
this casued timeout in packer builds.
new image is in raw format.

Signed-off-by: Aric Gardner <agardner@linuxfoundation.org>
Change-Id: I0151e6b8677625e4477d93faa67cb1abdf84515c

Add release notes for sigul client on CentOS 7

Issue: RELENG-3077
Change-Id: I3314b0770a0f0280ee162bbb646f95312cff6196
Signed-off-by: Eric Ball <eball@linuxfoundation.org>

Add install of Sigul client on CentOS 7

Our current signing scripts download and install Sigul only when
executing the signing scripts. However, the servers hosting this
package are not reliable, and we should see significant performance
improvements by having the package pre-loaded on CentOS 7 builders
(the only builders capable of using Sigul).

Issue: RELENG-3077
Change-Id: I35ac34a3619f4018331f280745f4ff3d5c864fa9
Signed-off-by: Eric Ball <eball@linuxfoundation.org>