Skip to content

chore: add spark 3.5.6 #1142

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 10 commits into
base: main
Choose a base branch
from
Open

chore: add spark 3.5.6 #1142

wants to merge 10 commits into from

Conversation

razvan
Copy link
Member

@razvan razvan commented Jun 4, 2025

Description

Part of: #1141

Definition of Done Checklist

Note

Not all of these items are applicable to all PRs, the author should update this template to only leave the boxes in that are relevant.

Please make sure all these things are done and tick the boxes

  • Changes are OpenShift compatible
  • All added packages (via microdnf or otherwise) have a comment on why they are added
  • Things not downloaded from Red Hat repositories should be mirrored in the Stackable repository and downloaded from there
  • All packages should have (if available) signatures/hashes verified
  • Add an entry to the CHANGELOG.md file
  • Integration tests ran successfully
TIP: Running integration tests with a new product image

The image can be built and uploaded to the kind cluster with the following commands:

bake --product <product> --image-version <stackable-image-version>
kind load docker-image <image-tagged-with-the-major-version> --name=<name-of-your-test-cluster>

See the output of bake to retrieve the image tag for <image-tagged-with-the-major-version>.

@razvan razvan self-assigned this Jun 4, 2025
@@ -107,6 +109,7 @@ All notable changes to this project will be documented in this file.
- druid: Remove `30.0.0` ([#1110]).
- nifi: Remove `2.2.0` ([#1114]).
- kafka: Remove `3.7.1` and `3.8.0` ([#1117])
- spark-connect-client: Remove `3.5.5` ([#1142])
Copy link
Member

@NickLarsenNZ NickLarsenNZ Jun 4, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this is deprecated, not removed in this release

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As discussed, the client it being removed as it is only used in demos.

If it is being used in tests, it will need to stay in for the release.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Spark connect support is experimental has not been released yet. The tests are performed with the version of our choosing which has been 3.5.5 until now but we update it to 3.5.6.
There is no requirement to keep the connect client for 3.5.5 around, unless we discover major bugs with 3.5.6.

@razvan razvan requested a review from NickLarsenNZ June 5, 2025 09:55
@razvan razvan linked an issue Jun 6, 2025 that may be closed by this pull request
17 tasks
@razvan razvan enabled auto-merge June 6, 2025 09:43
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

chore(spark): Update container images ahead of Stackable Release 25.7.0
2 participants