LLM OrchestrationOpen Source AI & Machine Learning
Guidellm
byvLLM
Guidance platform for deploying and managing large language models.
Open Source
About
SLO-aware Benchmarking and Evaluation Platform for Optimizing Real-World LLM Inference
Open Source Health
- Stars
- 1,605
- Forks
- 232
- License
- Apache-2.0
- Last commit
- 28 days ago
Python
Related Categories
Vendor
vLLM
Publisher of Vllm
Quick Links
Open Source
More by vLLM
Related Products
The Algorithm
Source code for the X Recommendation Algorithm
Shared categories
Recommenders
TensorFlow Recommenders is a library for building recommender system models using TensorFlow.
Shared categories
RPG_KDD2025
This repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
Shared categories
Pairec
A Go web framework for quickly building recommendation online services based on JSON configuration.
Shared categories
Textrank
TextRank implementation for Python 3.
Shared categories