Tutel
Tutel MoE: Optimized Mixture-of-Experts Library, Support GptOss/DeepSeek/Kimi-K2/Qwen3 using FP8/NVFP4/MXFP4
About
Tutel MoE: An Optimized Mixture-of-Experts Implementation, also the first parallel solution proposing "No-penalty Parallism/Sparsity/Capacity/.. Switching" for modern training and inference that have dynamic behaviors. Support direct NVFP4/MXFP4/BlockwiseFP8 Inference for MoE-based GLM-5.x / DeepSeek-3.x / Kimi-2.x / Kimi-3.x / Qwen3 / Gpt-OSS using A100/A800/H100/MI300/..
Open Source Health
- Stars
- 1,018
- Forks
- 110
- License
- MIT
- Last commit
- 1 months ago
Related Categories
Vendor
Microsoft
Empower every person and organization to achieve more.
Quick Links
Open Source
More by Microsoft
Related Products
Recognizers-Text
Recognizers-Text offers entity recognition and resolution for numbers, dates, and units in multiple languages.
More from this vendor
Language Server Protocol
Defines a common protocol for language servers.
More from this vendor
Azure AI Speech
Azure Speech in Foundry Tools
More from this vendor
Lamar Benchmark
Source code for the ECCV 2022 paper "Benchmarking Localization and Mapping for Augmented Reality".
More from this vendor
Pyright
Static Type Checker for Python
More from this vendor