Pinned Loading

1. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 6.2k 540

2. flashinfer-ai/flashinfer flashinfer-ai/flashinfer Public

   FlashInfer: Kernel Library for LLM Serving

   Cuda 1.5k 145

3. InternLM/lmdeploy InternLM/lmdeploy Public

   LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

   Python 4.7k 431

4. TensorRT-LLM-Hacks TensorRT-LLM-Hacks Public

   TensorRT LLM Hacks

   Python