Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Salesforce xLAM-2 series of model handlers and update vLLM version from 0.6.3 to 0.6.5 #972

Merged
merged 6 commits into from
Apr 9, 2025

Conversation

zuxin666
Copy link
Contributor

@zuxin666 zuxin666 commented Apr 3, 2025

This PR adds support for the Salesforce xLAM-2 series of models and updates the vLLM dependency from 0.6.3 to 0.6.5 to address a long context issue with Qwen models (referenced in vllm-project/vllm#9769).

Changes

  • Added new Salesforce xLAM-2 model handlers:

    • SalesforceLlamaHandler for Llama-based models (xLAM-2-70b-fc-r, xLAM-2-8b-fc-r)
    • SalesforceQwenHandler for Qwen-based models (xLAM-2-32b-fc-r, xLAM-2-3b-fc-r, xLAM-2-1b-fc-r)
  • Updated model metadata and supported models documentation to include the new xLAM-2 models

  • Bumped vLLM version from 0.6.3 to 0.6.5 in pyproject.toml to fix Qwen's long context issue

Testing

The implementation has been tested with the supported xLAM-2 models to ensure proper function calling capabilities and compatibility with the Berkeley Function Call Leaderboard evaluation framework.

@HuanzhiMao HuanzhiMao added the BFCL-New Model Add New Model to BFCL label Apr 5, 2025
Copy link
Collaborator

@HuanzhiMao HuanzhiMao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for the PR @zuxin666 ! Excited to see the new xLAM models on the leaderboard 💯💯💯

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
BFCL-New Model Add New Model to BFCL
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants