LayerSkip

Code for "LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding", ACL 2024

LLM-OrchestrierungOpen Source KI & Maschinelles LernenOpen Source