[ICLR 2020] Drawing Early-Bird Tickets: Towards More Efficient Training of Neural Networks
Accepted as spotlight oral paper! Abstract: (Frankle & Carbin, 2019) shows that there exist winning tickets (small but critical subnetworks) for dense, randomly initialized networks, that can be trained alone to achieve comparable accuracies to the latter in a similar number of iterations.