Uniffle

Uniffle is a high performance, general purpose Remote Shuffle Service.

Service Mesh ManagementOpen Source

About

Uniffle is a high performance, general purpose remote shuffle service for distributed computing engines. It provides the ability to push shuffle data into centralized storage service, changing the shuffle style from "local file pull-like style" to "remote block push-like style". It brings in several advantages like supporting disaggregated storage deployment, super large shuffle jobs, and high elasticity. Currently it supports Apache Spark, Apache Hadoop MapReduce and Apache Tez.

Open Source Health

Not enough history
Stars
454
Forks
172
License
Apache-2.0
Last commit
1 months ago
Java

Resources & Links

Related Categories

Using Uniffle?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Apache

Publisher of Apache Jena, Fuseki and Apache Kafka

View vendor profile

More by Apache