![[Paper Review] Memory Retrieval and Consolidation in Large Language Models through Function Tokens](https://moonlight-paper-snapshot.s3.ap-northeast-2.amazonaws.com/arxiv/memory-retrieval-and-consolidation-in-large-language-models-through-function-tokens-4.png)
[Paper Review] Memory Retrieval and Consolidation in Large Language Models through Function Tokens
Paper Function Token Hypothesis: Why Punctuation and Newlines Gate LLM “Memory Retrieval”One-line Summary (TL;DR)This paper …
23 min
Interpretability
feature-retrieval
pretraining-dynamics
steering
token-frequency
![[Paper Review] Massive Activations in Large Language Models](https://eric-mingjie.github.io/massive-activations/assets/main_teaser_final.png)