Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 45.6k 7k

2. ray-project/ray ray-project/ray Public

   Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

   Python 36.7k 6.2k

3. ray-project/kuberay ray-project/kuberay Public

   A toolkit to run Ray applications on Kubernetes

   Go 1.7k 522

4. ai-gateway ai-gateway Public

   Forked from envoyproxy/ai-gateway

   Envoy AI Gateway is an open source project for using Envoy Gateway to handle request traffic from application clients to Generative AI services.

   Go

5. kubernetes/kubernetes kubernetes/kubernetes Public

   Production-Grade Container Scheduling and Management

   Go 115k 40.4k

6. kubernetes/client-go kubernetes/client-go Public

   Go client for Kubernetes.

   Go 9.4k 3k