FLOP-Aware Scheduling

[Paper Review] Marconi: Prefix Caching for the Era of Hybrid LLMs

Paper Link Marconi: Rethinking Prefix Caching for the Hybrid LLM EraTL;DRMarconi introduces a prefix-caching framework for hybrid LLM …