6 min read
Lessons From Implementing a Neural Network From ScratchBackpropagation is simple in theory and unforgiving in practice. Here's what actually went wrong when I built one with nothing but numpy, and how gradient checking saved me.
← All tags
Posts tagged "machine-learning"
4 posts
6 min read
LLMs and the Changing Role of Software EngineersThe part of the job that's shrinking isn't the part most people worry about. It's not thinking that's getting outsourced — it's typing.
6 min read
What Gradient Descent Actually DoesStripped of the vector calculus notation, gradient descent is just a rule for guessing better. Here's the mechanical version I wish someone had shown me first.
6 min read
Learning Machine Learning From First PrinciplesNotes on the gap between knowing how to call a library and actually understanding what it's doing, and why I decided to close it the slow way.