Skip to content

[docker] Add docker images for linux/aarch64 platform #31537

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
krfricke opened this issue Jan 9, 2023 · 2 comments · Fixed by #31861
Closed

[docker] Add docker images for linux/aarch64 platform #31537

krfricke opened this issue Jan 9, 2023 · 2 comments · Fixed by #31861
Assignees
Labels
enhancement Request for new feature and/or capability

Comments

@krfricke
Copy link
Contributor

krfricke commented Jan 9, 2023

Description

#31522 added ARM64 wheel builds to CI. However, as discussed in the PR and in #28103, ideally users can use rayproject/ray images directly.

We should thus add a docker image build step to CI that builds the linux/aarch64 docker images.

The main open question (at least for me) is how we make sure the platform-specific images are kept in sync and added to the potentially existing images from other platforms. Concretely:

  • rayproject/ray:commithash for linux/x86_64 and linux/aarch64 should be the same
  • Do we allow rayproject/ray:nightly for linux/x86_64 and linux/aarch64 to point to different commits?
  • Does uploading an aarch64 image to dockerhub "add to" or replace an existing x86_64 image?

Use case

No response

@krfricke krfricke added the enhancement Request for new feature and/or capability label Jan 9, 2023
@krfricke krfricke self-assigned this Jan 12, 2023
@KastanDay
Copy link

For others searching about this issue, my error was

Error response from daemon: image with reference my-ray-image:latest was found but does not match the specified platform: wanted linux/arm64, actual: linux/amd64

Thank you for your efforts.

@krfricke
Copy link
Contributor Author

We've just merged the build job for arm64 docker images with a tag suffix: #31537

This means you can now use e.g. rayproject/ray:nightly-aarch64 on arm machines.

We haven't released images for Ray 2.2.0 - first release with Docker images will be Ray 2.3.0 (targeted for mid february)

See here for all available arm64 images: https://hub.docker.com/r/rayproject/ray/tags?page=1&name=aarch64

And here for a roadmap RFC for our arm64 docker images: #31966

kevin85421 added a commit to ray-project/kuberay that referenced this issue Jan 30, 2023
The nightly docker images for arm64 are available. See ray-project/ray#31537 (comment) for more details. Hence, users can run Ray in Docker containers on ARM machines (including Mac M1) and on ARM cloud instances (e.g. AWS Graviton).
lowang-bh pushed a commit to lowang-bh/kuberay that referenced this issue Sep 24, 2023
The nightly docker images for arm64 are available. See ray-project/ray#31537 (comment) for more details. Hence, users can run Ray in Docker containers on ARM machines (including Mac M1) and on ARM cloud instances (e.g. AWS Graviton).
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement Request for new feature and/or capability
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants