Memory
Machine Learning Model TrainingML Frameworks

Memory

Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, sparsely activated memory layers complement compute-heavy dense feed-forward layers, providing dedicated capacity to store and retrieve…

Open Source

About

This repo contains a reference implementation of the paper memory Layers at Scale.

Open Source Health

Not enough history
Stars
379
Forks
32
License
Not stated
Last commit
2 years ago
Python

Related Categories