GGUF implementation in C as a library and a tools CLI program

LLM OrchestrationOpen Source AI & Machine LearningOpen Source

About

This is a work in progress library to manipulate GGUF files. While the library aims to be useful, one of the main goals is to provide an accessible code base that as a side effect documents the GGUF files used by the awesome llama.cpp project: GGUF files are becoming increasingly more used and central in the local machine learning scene, so to have multiple implementations of parsers and files generators may be useful.

Open Source Health

Not enough history
Stars
363
Forks
39
License
MIT
Last commit
5 months ago
C

Resources & Links

Related Categories

Using Gguf Tools?

Track its cost next to the rest of your stack and get a reminder before it renews.

Add to my stack

Vendor

Salvatore Sanfilippo

Computer programmer based in Sicily, Italy. I mostly write OSS software. Born 1977. Not a puritan

View vendor profile

More by Salvatore Sanfilippo