Streaming LLM

[ICLR 2024] Efficient Streaming Language Models with Attention Sinks

LLM OrchestrationOpen Source AI & Machine LearningOpen Source