Nobodywho
NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.
About
NobodyWho is an inference engine designed to run large language models (LLMs) locally and efficiently on any device. It supports multiple platforms including Kotlin, Swift, Python, Flutter, React Native, Expo, and Godot. The engine allows for offline operation without the need for API keys, enabling features like text-to-speech and speech-to-text, while also supporting multimodal input. Users can load models directly from various sources, making it versatile for developers looking to integrate on-device AI capabilities.
Open Source Health
- Stars
- 1,107
- Forks
- 79
- License
- EUPL-1.2
- Last commit
- 27 days ago
Resources & Links
Related Categories
Vendor
NobodyWho
Inference engine that lets you run LLMs locally and efficiently on any device
Quick Links
Open Source
Related Products
CHaiDNN
HLS based Deep Neural Network Accelerator Library for Xilinx Ultrascale+ MPSoCs
Top category match
SoulX-FlashTalk
SoulX-FlashTalk is the first 14B model to achieve sub-second start-up latency (0.87s) while maintaining a real-time throughput of 32 FPS on an 8xH800 node.
Top category match
Ts Pattern
The exhaustive Pattern Matching library for TypeScript, with smart type inference.
Top category match
ds4
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Top category match
RECCON
This repository contains the dataset and the PyTorch implementations of the models from the paper Recognizing Emotion Cause in Conversations.
Top category match