Pure C inference of Mistral Voxtral Realtime 4B speech to text model

TranscriptionVoice, Speech & Audio AIOpen Source

About

This is a C implementation of the inference pipeline for the Mistral AI's Voxtral Realtime 4B model. It has zero external dependencies beyond the C standard library. The MPS inference is decently fast, while the BLAS acceleration is usable but slow (it continuously convert the bf16 weights to fp32).

Open Source Health

Not enough history
Stars
1,747
Forks
123
License
MIT
Last commit
8 months ago
C

Resources & Links

Related Categories

Using voxtral.c?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Salvatore Sanfilippo

Computer programmer based in Sicily, Italy. I mostly write OSS software. Born 1977. Not a puritan

View vendor profile

More by Salvatore Sanfilippo