Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add the ability to configure LLMs via the web interface #1421

Open
changchichung opened this issue Mar 18, 2025 · 3 comments
Open

Add the ability to configure LLMs via the web interface #1421

changchichung opened this issue Mar 18, 2025 · 3 comments
Labels

Comments

@changchichung
Copy link

Is your feature request related to a problem? Please describe.
No

Describe the solution you'd like

"I've encountered quite a bit of trouble when configuring different LLMs. I frequently see 'invalid API key' errors in the Docker logs, but I've double and triple-checked that the GEMINI/DEEPSEEK/OPENAI API keys I have in my ~/.wrenai/.env file are correct.

I'd like to suggest simplifying these configurations as much as possible, adopting a program setting method similar to Chatbox/AnythingLLM, where there's a web interface to select which LLM to connect to, allowing users to input their API keys or API URLs, and then have a dropdown menu for model selection, similar to this:"

@cyyeh cyyeh added the good first issue Good for newcomers label Mar 19, 2025
@cyyeh
Copy link
Member

cyyeh commented Mar 19, 2025

let me put this as good first issue. We welcome the community to contribute to this idea. You could discuss with us how you would like to design the solution first. Thank you

@changchichung
Copy link
Author

This is the interface of Open Web UI. I think it's clean and powerful, which makes it a pretty solid design. Users can choose which services to enable on their own. After enabling, they can manually input an API URL (or use the system default?) and an API Key. When saving, the system will verify if the entries are correct.
In the future, the official team might even consider offering their own database analysis models for lease or commercial use.

During conversations, users can freely select different models.

@coderprovider
Copy link

I think it's a good suggestion to input the API key and select the model using web interface

One thing I would add to my suggestion is to first test it after specifying the API key or model, and then storing it
Use the input values ​​to perform a simple test call, analyze the response, and then store it

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants