the goomblog

H-Nets - the Future

25 min read · July 11, 2025

2025
H-Nets - the Past

36 min read · July 10, 2025

2025
On the Tradeoffs of SSMs and Transformers

(or - tokens are bs)

42 min read · July 08, 2025

2025
Understanding and Improving Length Generalization in Recurrent Models

23 min read · July 06, 2025

2025
Cross-Architecture Distillation Part II - Phi-Mamba-1.5B Model and Training Laws

7 min read · August 20, 2024

2024