Architectures

How AI models and systems are built, inside and out.

13 articles
Architectures

CUDA, Nvidia's Real Moat

Nvidia owes its dominance to CUDA, the software platform that since 2006 has turned GPUs into a standard that is hard to walk away from, more than to the quality of its chips.

38 min
Architectures

Weight-Space Programming and Model Surgery

What Weight-Space Programming, presented by MIT, actually is, how to read its results, and why the idea of fixing a model by operating surgically on its representations, without retraining it, was at the heart of my 2024 paper Brain Surgery.

16 min