Blog

Essays about AI evaluation, machine learning, programming, mathematics, physics, and scientific reasoning.

The Only Linear Algebra You Must Know

A conceptual guide to linear algebra built around vector spaces, linear transformations, matrices, bases, and coordinate systems.

Understanding Transformers III - Cross Attention

A visual explanation of cross-attention and how it connects encoder and decoder stacks in the original Transformer architecture.

Why do Magnetic Field Lines go from South to North inside of a bar magnet?

A first-principles explanation of why magnetic field lines run south to north inside a bar magnet and form closed loops.

Understanding Transformers II - The Encoder

A visual guide to encoder-only Transformers and BERT, covering tokenization, embeddings, attention, and classification heads.

Don't Use Truthy/Falsy Values

Why implicit truthy and falsy checks can obscure intent, hide type errors, and make production code harder to reason about.

Understanding Transformers I - The Decoder

A visual and intuitive introduction to decoder-only Transformer architecture, including embeddings, attention, and language modeling.

Creating Meaningful Evaluations for Agentic App Builders

How to build meaningful evaluations for AI app-building agents using prompt sets, code-based scorers, and automated analysis.