CUDA, Nvidia's Real Moat
Nvidia owes its dominance to CUDA, the software platform that since 2006 has turned GPUs into a standard that is hard to walk away from, more than to the quality of its chips.
How AI models and systems are built, inside and out.
13 articlesNvidia owes its dominance to CUDA, the software platform that since 2006 has turned GPUs into a standard that is hard to walk away from, more than to the quality of its chips.
What Weight-Space Programming, presented by MIT, actually is, how to read its results, and why the idea of fixing a model by operating surgically on its representations, without retraining it, was at the heart of my 2024 paper Brain Surgery.
At Algoretico, we have developed a framework that does something no Transformer does today: it develops a cognitive personality that evolves with experience.
Artificial intelligence approached with scientific rigor, engineering precision, and human depth.
Continuous Latent Reasoning: 16x-128x Semantic Compression and End-to-End Optimization for Next-Generation RAG Systems
A technical analysis of why the self-attention architecture makes modern LLMs much more than mere \\\\\\\"stochastic parrots.\\\\\\\"
Why the real productive revolution does not come from LLMs.
Apple computers are now widely used in software and AI development, but they lack certain tools that would help standardize work and facilitate migration to platforms better suited for training.
How orchestrated AI agents are transforming complex problem-solving through coordinated autonomy and specialized capabilities.
Most organizations don't have labeled datasets. They have processes, constraints, and domain expertise. Here's how to build AI systems that learn from structure, not just examples.
When AI systems trained on AI-generated content degrade over time, losing diversity and capability. Understanding the mechanics of model collapse and architectural solutions that preserve knowledge.
Building Retrieval-Augmented Generation systems that actually understand your organization's knowledge, not just find semantically similar text snippets.
The loss landscape of deep networks is high-dimensional, non-convex, and full of local minima. Yet gradient descent finds good solutions anyway. Understanding why reveals fundamental insights about deep learning.