Skip to content

upgrade base image to vllm 0.8 of dockerfile and fix ffmpeg with apt install ffmpeg #3176

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
verigle opened this issue Apr 3, 2025 · 4 comments · May be fixed by #3228
Open

upgrade base image to vllm 0.8 of dockerfile and fix ffmpeg with apt install ffmpeg #3176

verigle opened this issue Apr 3, 2025 · 4 comments · May be fixed by #3228
Labels
feature stale
Milestone
v1.x

Comments

@verigle
Copy link

verigle commented Apr 3, 2025

Feature request / 功能建议

the version of vllm is very old
ffmpeg can not used

Motivation / 动机

some new model can not used bacause vllm version is old

ffmpeg can not used, please install it use follow command
sudo add-apt-repository ppa:ubuntuhandbook1/ffmpeg6
sudo apt update
sudo apt install ffmpeg

Your contribution / 您的贡献
@verigle verigle added the feature label Apr 3, 2025
@XprobeBot XprobeBot added this to the v1.x milestone Apr 3, 2025
@qinxuye
Copy link
Contributor

qinxuye commented Apr 3, 2025

Could you submit a PR to fix the ffmpeg?

About the version of vllm, because we packed both vllm and sglang, sglang v0.4.4.post3 cannot live with vllm>=0.8.0, this is the main dilemma.

@verigle
Copy link
Author

verigle commented Apr 8, 2025

sorry, if vllm still version 0.6.0, fail to install ffmpeg, because the base image of vllm 0.6.0 is ubuntu 20.04, test is not ok.

@qinxuye
Copy link
Contributor

qinxuye commented Apr 8, 2025

#2946 tried to address ffmpeg issue, it does not work now?

For vllm 0.8 version of image, we could upgrade until sglang is compatible with vllm >=0.8.0.

@qinxuye qinxuye linked a pull request Apr 11, 2025 that will close this issue
Draft
@github-actions GitHub Actions
Copy link

This issue is stale because it has been open for 7 days with no activity.

@github-actions github-actions bot added the stale label Apr 15, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature stale
Projects
None yet
Milestone
v1.x
Development

Successfully merging a pull request may close this issue.

BLD: upgrade vllm docker image version to latest amumu96/inference
3 participants
@qinxuye @verigle @XprobeBot