Skip to content

Hey, this is InftyAI 🪂

InftyAI is a non-profit organization focused on building AI infrastructure. We 💙 Open Source.

All kinds of contributions are welcomed to the community, like PR, Issue, Idea, Documentation and more.

If you have made multiple contributions to the community or projects, enough to demonstrate an ongoing and long-term commitment to the community, please Open an issue against the InftyAI/community repo to join us.

We also have an official fundraising venue through OpenCollective. We'll use the fund transparently to support the development, maintenance, and adoption of our community.

Link us via Slack, Twitter as well.

Pinned Loading

  1. Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    Python 86 16

  2. llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 125 20

  3. community Public

    The InftyAI community.

    1

Repositories

Showing 10 of 12 repositories
  • llmaz Public

    ☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!

    Go 125 Apache-2.0 20 39 (6 issues need help) 3 Updated Apr 21, 2025
  • scheduler-plugins Public

    Scheduler plugins designed for smart scheduling with llmaz.

    Go 5 Apache-2.0 1 0 0 Updated Apr 21, 2025
  • Awesome-LLMOps Public

    🎉 An awesome & curated list of best LLMOps tools.

    Python 86 Apache-2.0 16 1 (1 issue needs help) 0 Updated Apr 19, 2025
  • community Public

    The InftyAI community.

    0 Apache-2.0 1 0 0 Updated Apr 18, 2025
  • template-repo Public template

    A template repo.

    0 Apache-2.0 1 1 0 Updated Mar 15, 2025
  • .github Public
    0 Apache-2.0 1 0 0 Updated Feb 15, 2025
  • llmaz-dashboard Public

    ChatUI for LLMs on llmaz.

    Python 3 Apache-2.0 5 1 0 Updated Feb 8, 2025
  • website Public

    Website and Blogs.

    HTML 1 MIT 1 2 0 Updated Feb 5, 2025
  • Manta Public

    💫 A lightweight p2p-based cache system for model distributions on Kubernetes. Reframing now to make it an unified cache system with POSIX promise 🎯

    Go 21 Apache-2.0 2 14 (1 issue needs help) 1 Updated Dec 6, 2024
  • omnistore Public

    🎯 An unified python client to communicate with various kinds of object-store providers.

    Python 2 MIT 2 3 0 Updated Nov 11, 2024