Why?
When I started in deep learning, I felt frustrated that I was spending most of my time debugging instead of the "fun" stuff. (Later, I discovered that debugging never goes away, and the best practitioners still spend most of their time on it.)
As I learned more and began helping others train models, I realized that much of my advice consisted of walking people through a mental decision tree for how to improve their model's performance.
This guide is an attempt to codify that decision tree.