Add CI scenario: Pulsar v5 with Oxia and Pulsar Functions#699
Merged
Conversation
Add .ci/clusters/values-pulsar-v5-functions.yaml that tests the apachepulsar/pulsar:5.0.0-M1 image with Oxia (no ZooKeeper) and Pulsar Functions backed by broker-hosted FileSystemPackagesStorage. This combines the examples/values-oxia.yaml and examples/values-functions-fs-storage.yaml scenarios on the Pulsar v5 milestone image. Add the matrix entry "Pulsar v5 with Oxia and Pulsar Functions" to the install-chart-tests job.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Motivation
Add CI coverage for Pulsar v5 running together with Oxia (no ZooKeeper) and Pulsar Functions.
This validates the
apachepulsar/pulsar:5.0.0-M1image in the metadata-store-on-Oxia + broker-hosted Functions configuration, ensuring the upcoming Pulsar 5.0 release works end to end with the chart's Oxia and FileSystemPackagesStorage support.Modifications
.ci/clusters/values-pulsar-v5-functions.yaml:defaultPulsarImageRepository: apachepulsar/pulsar+defaultPulsarImageTag: 5.0.0-M1(slim image at the v5 milestone tag).examples/values-oxia.yaml(ZooKeeper off, Oxia on) andexamples/values-functions-fs-storage.yaml(Functions on with broker-hosted FileSystemPackagesStorage) scenarios..ci/clusters/values-oxia.yaml.shortname: pulsar-v5-functions) to theinstall-chart-testsjob in.github/workflows/pulsar-helm-chart-ci.yaml.The existing function smoke test (
ci::test_pulsar_function) runs automatically becausecomponents.functions: true; it creates a function from the bundledapi-examples.jar, uploading the package via the broker's FileSystem-backed Packages Management Service, andci::verify_package_storage_filesasserts the package landed on the volume.Verification
helm template+kubeconform -strictpass for k8s 1.25.0 and 1.34.0 (43/43 resources valid); render usesapachepulsar/pulsar:5.0.0-M1, no ZooKeeper resources,metadataStoreUrl: oxia://..., andPULSAR_PREFIX_STORAGE_PATH: /pulsar/test-packages-storage.apachepulsar/pulsar:5.0.0-M1image tag is published on Docker Hub.