TinyChatEngine
TinyChatEngine: On-Device LLM Inference Library
Machine Learning Model TrainingML FrameworksOpen Source
About
Running large language models (LLMs) and visual language models (VLMs) on the edge is useful: copilot services (coding, office, smart reply) on laptops, cars, robots, and more. Users can get instant responses with better privacy, as the data is local.
Open Source Health
- Stars
- 962
- Forks
- 102
- License
- MIT
- Last commit
- 2 years ago
C++
Alternatives to TinyChatEngine
Rclipby Yurij MikhalevichSemantic photo search for the command line
ChineseNERby jingyuanzhangA neural network model for Chinese named entity recognition
Head Pose Estimationby Yin GuobingRealtime human head pose estimation with ONNXRuntime and OpenCV.
Video Subtitle Extractorby 天涯古巷视频硬字幕提取，生成srt文件。无需申请第三方API，本地实现文本识别。基于深度学习的视频字幕提取框架，包含字幕区域检测、字幕内容提取。A GUI tool for extracting hard-coded subtitle (hardsub) from videos and generating srt files.
U 2 Netby Xuebin QinThe code for our newly accepted paper in Pattern Recognition 2020: "U^2-Net: Going Deeper with Nested U-Structure for Salient Object Detection."
Resources & Links
Related Categories
Using TinyChatEngine?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
MIT HAN Lab
Efficient AI Computing. PI: Song Han
