Hyperparameter Tuning Is a Resource Scheduling Problem
jchandra.comI dont think its just a resource scheduling problem, there are more to it as well. The goal is Model Performance, not just efficient resource use.
Nice article but I can see your point.
Totally fair point — at the end of the day, it's all about getting the best model performance. I was mostly trying to highlight how, under the hood, a lot of modern HPO algos really boil down to smart scheduling decisions.
Total Computational Budget in Hyperband need to be elaborated. There are more things to it.