Uccl
LLM OrchestrationOpen Source AI & Machine Learning

Uccl

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

Open Source

About

UCCL is designed to enhance communication efficiency among GPUs, focusing on collective operations, peer-to-peer transfers, and extensible performance across heterogeneous hardware. It aims to provide flexibility and portability for machine learning applications, allowing seamless integration with various GPU and networking vendors. The library includes components like UCCL-collective for optimized collective operations, UCCL-P2P for advanced data transfers, and UCCL-EP for running deep learning tasks on diverse hardware setups.

Open Source Health

Not enough history
Stars
1,513
Forks
172
License
Apache-2.0
Last commit
27 days ago
C++

Related Categories