Bilevel Optimization of Topology and Hyperparameters (BOTH)
It is shown that evaluating just one or two steps of TO is sufficiently informative and that the method scales favorably to thousands of hyperparameters at an expense comparable to only a few standard TO runs, and that the method scales favorably to thousands of hyperparameters at an expense comparable to only a few st...