Pinned Loading

1. aphrodite-engine/aphrodite-engine aphrodite-engine/aphrodite-engine Public

   Large-scale LLM inference engine

   C++ 1.4k 150

2. pygmalion.cpp pygmalion.cpp Public archive

   C/C++ implementation of PygmalionAI/pygmalion-6b

   C 56 6

3. sparsegpt-for-LLaMA sparsegpt-for-LLaMA Public

   Forked from IST-DASLab/sparsegpt

   Code for the paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot" with LLaMA implementation.

   Python 71 5

4. tplib tplib Public

   A torch-based, universal tensor-parallel library.

   Python 3 1

5. huggingface/transformers huggingface/transformers Public

   🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

   Python 143k 28.6k

6. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 44.6k 6.8k