SpecPilot: Autonomous Algorithm Discovery and Systems Optimization for Speculative Decoding
Introduction Speculative decoding is a technique that commits multiple tokens together when a large model is invoked once, accelerating language model decoding where…
![[Paper Review] Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality](https://icml.cc/media/PosterPDFs/ICML%202024/32613.png)