Reading Notes

Notes and summaries from reading ML/AI papers (and some blog posts). All credit to the content in the papers and blog posts goes to the original authors.

Position-aware Automatic Circuit Discovery

position aware circuits

5 min read · March 20, 2026

2026 · distillation
Arithmetic Without Algorithms: Language Models Solve Math With a Bag of Heuristics

arithmetic heuristics

7 min read · March 19, 2026

2026 · distillation
Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights

neural thickets

2 min read · March 18, 2026

2026 · distillation
Attention Residuals

attention residuals

2 min read · March 17, 2026

2026 · distillation
Fine-Tuning Enhances Existing Mechanisms: A Case Study on Entity Tracking

circuits in fine-tunes

7 min read · March 16, 2026

2026 · distillation