Popular repositories Loading

1. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

2. slime slime Public

   Forked from THUDM/slime

   slime is an LLM post-training framework for RL Scaling.

   Python

3. verl_dev verl_dev Public

   Forked from verl-project/verl

   verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

   Python

4. TransferQueue TransferQueue Public

   Forked from Ascend/TransferQueue

   An asynchronous streaming data management module for efficient post-training.

   Python

5. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

6. MagiAttention MagiAttention Public

   Forked from SandAI-org/MagiAttention

   A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training

   Python