Posts
All the articles I've posted. 46 posts, page 10 of 12.
How a word gets meaning inside a model
Published: at 09:05 PMFrom token IDs to embeddings to the residual stream, why king minus man plus woman lands near queen, when it fails, and what a dimension actually means.
Tokenization: why counting the letters in strawberry can trip up a model
Published: at 10:30 PMHow tokenizers turn text into IDs, why that can make letter counting harder, and how token costs differ across languages.
Trajectory at BISV Hacks 2026
Published: at 01:00 AMWe built Trajectory, a personalized learning platform, at BISV Hacks 2026. We did not win, and it was still one of the most fun builds I have done.
Attention Is All You Need, read in 2026
Published: at 09:20 PMI reread the 2017 Transformer paper as a 2026 reader. What it claimed, what survived, what got quietly replaced, and the thing it under-sold.