LLM OrchestrationOpen Source AI & Machine Learning

delta-Mem

The official repo of the paper: $delta$-mem: Efficient Online Memory for Large Language Models

Open Source

About

δ-mem introduces a compact Online State of Associative Memory alongside a frozen full-attention backbone. When a new token or interaction segment arrives, the model projects the current information into a low-dimensional memory space and writes it into the state through delta-rule learning.

Open Source Health

Not enough history
Stars
257
Forks
26
License
Not stated
Last commit
4 months ago
Python

Related Categories