New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support for AsyncOpenai client #1164

Open

shoang22 opened this issue Mar 31, 2025 · 1 comment

shoang22 commented Mar 31, 2025

Hi, is there support for using an async Openai client for calls involving the llm_client?

Member

afourney commented Apr 7, 2025

Yeah, the inference code needs an overhaul in general. It's something I'm thinking about how to tackle all-up.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment