6 min read
The Tax You Can't Avoid PayingA pattern I keep running into across very different parts of learning: every real shortcut turns out to just move the difficulty somewhere less visible, not remove it.
Thoughts on code, product, and life.
A pattern I keep running into across very different parts of learning: every real shortcut turns out to just move the difficulty somewhere less visible, not remove it.
Being able to retrieve an answer and understanding it are different capacities, and it's never been easier to confuse them for each other.
Backpropagation is simple in theory and unforgiving in practice. Here's what actually went wrong when I built one with nothing but numpy, and how gradient checking saved me.