Documentation
Basics
Plugins
Advanced
- Detailed result contents
- Configuration Options
- Custom Registries & Airgap Testing
- Using Private Images
- Advanced Customization
Resources
Release
Preparing release version
- Update the
version
defined in the code to the new version number. As of the time of writing, the version is defined inpkg/buildinfo/version.go
.
Kubernetes release
Is this release for a Kubernetes release? If so, apply the following steps:
Conformance images
Ensure the upstream conformance script is working appropriately:
- Build the kind images for this new version.
- Checkout K8s locally at the tag in question
- Run
make check_kind_env
to ensure the repo/tag are correct - Run
make kind_images
- Run
make push_kind_images
- Update the
kind-config.yaml
file with the new image version here.
Setup e2e image registry for new version
Add the new list of E2E test images for the targed version.
Within pkg/image/
, copy the latest v1.x.go
file to a file which corresponds to the new Kubernetes release number.
For example, if the new Sonobuoy release corresponds to Kubernetes v1.20
, copy the v1.19.go
file to v1.20.go
.
cd pkg/image
cp v1.{19,20}.go
This file will contain a function to return the list of test images via a map[int]Config
value.
- Update the name of the function accordingly. For example, if the file is for the v1.20 release,
ensure the function name is
v1_20
. - Copy all
map
entries stored in variableconfigs
from upstream Kubernetes filekubernetes/test/utils/image/mafnifest
. Remove the previous map entries and replace them wi the The copied entries. - Update the
GetImageConfigs
function withinpkg/image/manifest.go
and add a newcase
statement to the minor version check which will be the minor version of the new Kubernetes release. In this new case, call the newly created function (e.g.r.v1_20()
). - Add the new default image registry configuration by updating the function
GetDefaultImageRegistries
withinpkg/image/manifest.go
to return the default image registries for the new version.- Add a new case to the minor version check which will correspond the minor version of the new Kubernetes release.
- Follow previous case statements (i.e.
case 19:
), return a newRegistryList
object which includes only the registry keys used within the registry config for that version. Some registries are not applicable to include in this object as they are there to test specific image pull behavior such as pulling from a private or non-existent registry. This object should only include registries that can be successfully pulled from. The other registries are not used within the end-to-end tests.
Updating the versioned docs
Explicit doc changes (if any) should be made to the appropriate files in directory site/docs/master
.
Next, generate a set of versioned docs for v0.x.y. For instance, the new docs be generated by running the command:
./scripts/update_docs.sh v0.20.0
This will copy the current master
docs into the version given and update
a few of the links in the README to be correct. It will also update
the website config to add the new version and consider it the newest
version of the docs.
Create PR
- Commit previous changes and open a new PR
- Ensure your commits signed
- Follow PR build progress in circleci.com
- Once all checks passes, merge accordingly
Tag release
This step will tag the code and triggers a release.
From your local branch, create an annotated
tag
for the commit that was merged:git tag -a v0.x.y -m "Release v0.x.y"
NOTE: Tag the new tip of
master
, not the branch you just merged.Push the
tag
to thegithub.com/vmware-tanzu/sonobuoy
repository.To ensure that the tag is pushed to the correct repository, check which remote corresponds to that repository using the following command:
git remote -v
The output of this command should include at least two configured remotes, typically
origin
, which refers to your personal fork, andupstream
which refers to the upstream Sonobuoy repository. For example:origin git@github.com:<username>/sonobuoy.git (fetch) origin git@github.com:<username>/sonobuoy.git (push) upstream https://github.com/vmware-tanzu/sonobuoy (fetch) upstream https://github.com/vmware-tanzu/sonobuoy (push)
For the following steps, use the remote configured for the
vmware-tanzu/sonobuoy
repository. The following instructions will useupstream
.Push the tag with the following command.
NOTE: This will push all tags.
git push upstream --tags
To push just one tag, use the following command format (replacing
v0.x.y
with the tag created in the previous step):git push upstream refs/tags/v0.x.y
If there is a problem and you need to remove the tag, run the following commands:
git tag -d v0.x.y git push upstream :refs/tags/v0.x.y
NOTE: The
:
preceding the tag ref is necessary to delete the tag from the remote repository. Git refspecs have the format<+><src>:<dst>
. By pushing an emptysrc
to the remotedst
, it makes the destination ref empty, effectively deleting it. For more details, see thegit push
documentation or this concise explanation on Stack Overflow.
Release Validation
Open a browser tab and go to: https://circleci.com/gh/vmware-tanzu/sonobuoy and verify go releaser for tag v0.x.y completes successfully.
Upon successful completion of build job above, check the releases tab of Sonobuoy and verify the artifacts and changelog were published correctly.
Run the following command to make sure the image was pushed correctly to Docker Hub:
docker run -it sonobuoy/sonobuoy:v0.x.y /sonobuoy version
The
Sonobuoy Version
in the output should match the release tag above.Go to the GitHub release page and download the release binaries and make sure the version matches the expected values.
Run a Kind cluster locally and ensure that you can run
sonobuoy run --mode quick
. If this release corresponds to a new Kubernetes release as well, ensure:you’re using the correct Kubernetes context by checking the output from:
kubectl config current-context
and verifying that it is set to the context for the Kind cluster just created (
kind-kind
orkind-<custom_cluster_name>
)you’re testing with the new Kind images by checking the output from:
kubectl version --short
and verifying that the server version matches the intended Kubernetes version.
you can run
sonobuoy images
and get a list of test images as expected
Update the release notes if desired on GitHub by editing the newly created release.
Notes
- Before releasing, ensure all parties are available to resolve any issues that come up. If not, just bump the release.
- If you are building a Windows release you must currently build/push the Windows image outside of CI and push the manifest to also include it. To do this you must:
- Have built the Windows binaries (can be done on a Linux box and should be the default now)
- Have a Windows machine available for the build. The steps below will assume a
docker context
which is a Windows machine. - (Recommended) Build the sample Windows plugin (in our examples directory) to test the image
- (Recommended) Have a cluster with Windows available for testing
docker context use default
make build/windows/amd64/sonobuoy.exe
docker context use 2019-box
make windows_containers
PUSH_WINDOWS=true make push