Vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
About
High-throughput and memory-efficient inference and serving engine for Large Language Models. Deploy AI faster with state-of-the-art performance.
Resources & Links
Related Categories
Vendor
vLLM
Publisher of Vllm
Quick Links
More by vLLM
Related Products
Rclip
Semantic photo search for the command line
Top category match
ChineseNER
A neural network model for Chinese named entity recognition
Top category match
Head Pose Estimation
Realtime human head pose estimation with ONNXRuntime and OpenCV.
Top category match
Video Subtitle Extractor
视频硬字幕提取，生成srt文件。无需申请第三方API，本地实现文本识别。基于深度学习的视频字幕提取框架，包含字幕区域检测、字幕内容提取。A GUI tool for extracting hard-coded subtitle (hardsub) from videos and generating srt files.
Top category match
U 2 Net
The code for our newly accepted paper in Pattern Recognition 2020: "U^2-Net: Going Deeper with Nested U-Structure for Salient Object Detection."
Top category match