sgl-project

Pinned Loading

1. sglang sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 37.4k 9.7k

2. SpecForge SpecForge Public

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python 1.2k 368

3. sglang-omni sglang-omni Public

   SGLang-Omni is a high-performance serving framework for audio models (TTS, ASR) and unified multimodal models.

   Python 1.6k 618

4. mini-sglang mini-sglang Public

   A compact implementation of SGLang, designed to demystify the complexities of modern LLM serving systems.

   Python 5.4k 931

5. sglang-jax sglang-jax Public

   JAX backend for SGL

   Python 366 157