Skip to content

[Doc]: v1 supported model list? #16179

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
1 task done
Aganlengzi opened this issue Apr 7, 2025 · 2 comments
Open
1 task done

[Doc]: v1 supported model list? #16179

Aganlengzi opened this issue Apr 7, 2025 · 2 comments
Labels
documentation Improvements or additions to documentation

Comments

@Aganlengzi
Copy link

📚 The doc issue

hi, please tell me where can I check v1 supported models?

https://docs.vllm.ai/en/stable/models/supported_models.html

are these models in this link supported in v1 (tag v0.8.3)?

Suggest a potential alternative/fix

No response

Before submitting a new issue...

  • Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
@Aganlengzi Aganlengzi added the documentation Improvements or additions to documentation label Apr 7, 2025
@DarkLight1337
Copy link
Member

Please refer to https://docs.vllm.ai/en/stable/getting_started/v1_user_guide.html#feature-model

@ywang96
Copy link
Member

ywang96 commented Apr 7, 2025

Another way to see if a model is supported on V1 is to see if the model has a SupportsV0Only protocol in its definition.

For example, whisper (an encoder-decoder model) currently only works on V0

class WhisperForConditionalGeneration(nn.Module, SupportsTranscription,
SupportsMultiModal, SupportsV0Only):

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

3 participants