Kalman Delta Networks: Uncertainty-aware Associative Memory
Linear Attention Rewritten with a Kalman Filter: Kalman Delta NetworksTL;DRThe fixed-size recurrent memory update of linear attention is …
16 min
KV Cache
Long Context
Efficient Inference
SSM
Attention Optimization
Kalman Filter