-
Notifications
You must be signed in to change notification settings - Fork 568
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Make self-hosting easier #383
Comments
I just found your project (via awesome-mcp), and addressing the bumps in the setup process would be huge. It seems like you've built something really great that's struck a chord!! Well done. This issue is very timely – I literally opened the github issues here to see if there was some guidance for self-hosting, and this was the first issue I saw. In my case, I'd ideally like to run this on my Portainer install with Ollama. Both cost of the commercial models and privacy are concerns, and while I'm confident I could get everything running on my laptop or a dev container, having a docker-compose infrastructure that simplifies upgrades and involves only minimal config would be better. The two issues I've run into are:
The issue I'm expecting to run into once I've gotten past the above is that the docker-compose currently doesn't include Ollama. This is easy to fix, but again requires forking the docker-compose. I'd probably start with this: https://github.com/mythrantic/ollama-docker Unfortunately, I don't really have cycles to do a fork and get all this working, or to set up all this by hand on a dev container (my ultimate goal here is to do a one-time install and hit the ground running – email overload is real! ❤️😂), but I'm very happy to help test fixes and provide feedback/screenshots/loom recordings if that's helpful at all. |
Really cool project. I managed to get it up and running on Coolify, and while it’s working decently now, I have a few thoughts: It’d be great if we could have a published Docker image for the project. 1. Run Docker in Prod ModeThe Docker container currently runs the app in development mode. I tried modifying it to run in production, but it required spinning up too many services and setting a bunch of environment variables. 2. Simplifying the SetupTo make deployments easier, I’d like to suggest introducing a new environment variable, something like: INBOX_ZERO_MANAGED=false
3. OpenAI-Compatible APIWould it make sense to switch to an OpenAI-compatible API instead of integrating Ollama separately? -- Below is bare minimum of required environments with Ollama
|
People are struggling to get set up atm, so making it as easy possible would help.
Ideally you just set some env vars and it works.
You will need to set up Google, but otherwise we should make it as easy as possible to start.
Improving README in areas where people run into pain points will help. And improved Docker Compose for production.
The text was updated successfully, but these errors were encountered: