Tag: explainer

All the articles with the tag "explainer".

• What metacognition means for an AI model, concretely

  Published:Oct 16, 2026 |  at 02:50 AM

  Breaking "metacognition" into six mechanisms you can actually test in a language model, and why the model saying "I'm not sure" is the weakest evidence of all.

• Sinkhorn distance and optimal transport, explained with piles of sand

  Published:Aug 1, 2026 |  at 09:55 PM

  Optimal transport measures how far apart two distributions are by asking how much work it takes to move one onto the other. Sinkhorn makes it fast.

• Why Adam won

  Published:Jul 25, 2026 |  at 08:40 PM

  One level deeper on Adam: per-parameter steps, bias correction, the sign-descent view, why it wins on language, and AdamW. With a short NumPy version.

• Optimizers: SGD to Adam to what's next

  Published:Jul 18, 2026 |  at 09:20 PM

  How a network takes a step downhill, from gradient descent and momentum to Adam, AdamW, Muon and Shampoo, and which ones big labs really use.