Streaming LLM
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
LLM OrchestrationOpen Source AI & Machine LearningOpen Source
About
https://github.com/mit-han-lab/streaming-llm/assets/40906949/2bd1cda4-a0bd-47d1-a023-fbf7779b8358
Open Source Health
- Stars
- 7,267
- Forks
- 401
- License
- MIT
- Last commit
- 2 years ago
Python
Alternatives to Streaming LLM
The Algorithmby TwitterSource code for the X Recommendation Algorithm
Recommendersby TensorFlowTensorFlow Recommenders is a library for building recommender system models using TensorFlow.- RPG_KDD2025by FacebookresearchThis repository provides the code for implementing RPG described in our KDD'25 paper "Generating Long Semantic IDs in Parallel for Recommendation".
- Pairecby AlibabaA Go web framework for quickly building recommendation online services based on JSON configuration.
Textrankby Summa NLPTextRank implementation for Python 3.
Resources & Links
Related Categories
Using Streaming LLM?
Track its cost next to the rest of your stack and get a reminder before it renews.
Add to my stackVendor
MIT HAN Lab
Efficient AI Computing. PI: Song Han
