Prefill

RidgeFill: Training-Free Late-Layer Cache Fill for Faster Prefill

Introduction: The wait before an answer appears With a long prompt, the model must pass the entire document through before the first token emerges, and the user waits the…