the goomblog

Cross-Architecture Distillation Part II - Phi-Mamba-1.5B Model and Training Laws

7 min read · August 20, 2024

2024
Cross-Architecture Distillation Part I - The MOHAWK Framework

11 min read · August 20, 2024

2024
Hydra Part II - The Model

10 min read · July 16, 2024

2024
Hydra Part I - Matrix Mixer Framework

14 min read · July 16, 2024

2024
State Space Duality (Mamba-2) Part IV - The Systems

6 min read · May 31, 2024

2024