A Guide to Migrating from Jekyll to Hugo
A Guide to Migrating from Jekyll to HugoWhen I decided to migrate from Jekyll to Hugo, I consulted numerous documents and tutorials but …
6 min
hugo
migration
blog
jekyll
Posts
All posts on technology, daily life, and thoughts.
74 pages
11 /
13
K-Beauty: On the Verge of a New Leap Forward?
K-Beauty: Poised for a New Leap ForwardThe K-beauty industry has recently been capturing the spotlight once again. As an investor looking …
9 min
K-Beauty
cosmetics
industry-outlook
global-market
ODM
Migrating My Blog from Jekyll to Hugo
Why I Migrated My Blog from Jekyll to HugoWhen I first started blogging back in 2021, I chose Jekyll because it was officially supported by …
3 min
hugo
daily
blog
jekyll
![[Paper Review] Massive Activations in Large Language Models](https://eric-mingjie.github.io/massive-activations/assets/main_teaser_final.png)
[Paper Review] Massive Activations in Large Language Models
Paper Link Massive Activations, Hidden Biases: A Reinterpretation of Self-Attention’s Secrets TL;DRJust 4–10 extreme scalar values (×10,000) …
21 min
Transformer
Interpretability
NeuralMechanisms
Massive Activations
Explicit Attention Bias
[Paper Review] Peri-LN: Revisiting Normalization Layer in the Transformer Architecture
Paper Link Peri-LayerNorm: A Third Option Beyond Post-LN and Pre-LNTL;DRBy simply adding another LayerNorm right after the residual …
24 min
Large Language Models
FP16 Training
Empirical Evaluation
Gradient Explosion
Benchmark Evaluation
![[paper review] SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-bit Training](https://cdn-uploads.huggingface.co/production/uploads/66c0a08bac74db25de8427ec/Tb20E3IJSV6PjcD9Nkvfg.png)
[paper review] SageAttention3: Microscaling FP4 Attention for Inference and An Exploration of 8-bit Training
[Paper Review] SageAttention 3 & SageBwd — FP4-Powered Inference and 8-bit TrainingPaper link: https://arxiv.org/abs/2505.11594v1 📝 …
23 min
Transformer Optimization
Inference Acceleration
TrainingEfficiency
CUDA
Triton