LayerSkip

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

LLM OrchestrationOpen Source AI & Machine LearningOpen Source