Open Source Marketplace

HLS based Deep Neural Network Accelerator Library for Xilinx Ultrascale+ MPSoCs

SoulX-FlashTalk is the first 14B model to achieve sub-second start-up latency (0.87s) while maintaining a real-time throughput of 32 FPS on an 8xH800 node.

Ts Pattern

by Gabriel Vergnaud

The exhaustive Pattern Matching library for TypeScript, with smart type inference.

NobodyWho is an inference engine that lets you run LLMs locally and efficiently on any device.

ds4

by Salvatore Sanfilippo

DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm

This repository contains the dataset and the PyTorch implementations of the models from the paper Recognizing Emotion Cause in Conversations.

BitNet

by Microsoft

Official inference framework for 1-bit LLMs

Whisper.Cpp

by ggml

Port of OpenAI's Whisper model in C/C++

Peft

by Hugging Face

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

Sophia Script For Windows

by Dmitry Nefedov

zap: The most powerful PowerShell module for fine-tuning Windows 10 & Windows 11 on GitHub

KTransformers

by kvcache.ai

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

LongWriter

by THUKEG

[ICLR 2025] LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs