Papers by Hongyuan Zhan
Evaluating Lottery Tickets Under Distributional Shifts (D19-61)
Copied to clipboard
| Challenge: | Recent research suggests deep neural networks are dramatically over-parametrized. |
| Approach: | They propose that large, over-parameterized neural networks consist of small, sparse subnetworks that can be trained in isolation to reach a similar (or better) test accuracy. |
| Outcome: | The proposed models can achieve commensurate performance using the same initialization as the original model. |