Training Neural Networks on Data That’s Lying
Learning from corrupted data
Oh no! You find out that your data is corrupted — there are enough instances of training data being attached to the incorrect label for it to be a significant problem. What should you do?
If you want to be a radical optimist, you could think of this data corruption as a form of regularization — depending on the…