the goomblog

H-Nets - the Past

36 min read   ·   July 10, 2025

2025

On the Tradeoffs of SSMs and Transformers

(or - tokens are bs)

42 min read   ·   July 08, 2025

2025

Understanding and Improving Length Generalization in Recurrent Models

23 min read   ·   July 06, 2025

2025

Cross-Architecture Distillation Part II - Phi-Mamba-1.5B Model and Training Laws

7 min read   ·   August 20, 2024

2024

Cross-Architecture Distillation Part I - The MOHAWK Framework

11 min read   ·   August 20, 2024

2024