robustness

Interpolation can hurt robust generalization even when there is no noise

We reveal unexpected benefits of regularization even in the overparameterized regime by proving that for both linear regression and classification, avoiding interpolation significantly improves generalization.

Konstantin Donhauser, Alexandru Țifrea, Michael Aerni, Reinhard Heckel, Fanny Yang