Type

Conference Proceedings

Authors

Kevin McGuinness
Noel E. O'Connor
Paul Albert
Diego Ortego
Eric Arazo

Subjects

Computer Science

Topics
gradient methods component model machine learning state of the art artificial intelligence noise correction neural networks

Unsupervised label noise modeling and loss correction (2019)

Abstract Despite being robust to small amounts of label noise, convolutional neural networks trained with stochastic gradient methods have been shown to easily fit random labels. When there are a mixture of correct and mislabelled targets, networks tend to fit the former before the latter. This suggests using a suitable two-component mixture model as an unsupervised generative model of sample loss values during training to allow online estimation of the probability that a sample is mislabelled. Specifically, we propose a beta mixture to estimate this probability and correct the loss by relying on the network prediction (the so-called bootstrapping loss). We further adapt mixup augmentation to drive our approach a step further. Experiments on CIFAR-10/100 and TinyImageNet demonstrate a robustness to label noise that substantially outperforms recent state-of-the-art. Source code is available at https://git.io/fjsvE and Appendix at https://arxiv.org/abs/1904.11238.
Collections Ireland -> Dublin City University -> Publication Type = Conference or Workshop Item
Ireland -> Dublin City University -> Subject = Computer Science: Artificial intelligence
Ireland -> Dublin City University -> DCU Faculties and Centres = DCU Faculties and Schools: Faculty of Engineering and Computing: School of Electronic Engineering
Ireland -> Dublin City University -> Status = In Press
Ireland -> Dublin City University -> DCU Faculties and Centres = Research Initiatives and Centres: INSIGHT Centre for Data Analytics
Ireland -> Dublin City University -> Subject = Computer Science: Machine learning

Full list of authors on original publication

Kevin McGuinness, Noel E. O'Connor, Paul Albert, Diego Ortego, Eric Arazo

Experts in our system

1
Kevin McGuinness
Dublin City University
Total Publications: 93
 
2
Noel E. O'Connor
Dublin City University
Total Publications: 474
 
3
Diego Ortego
Dublin City University
Total Publications: 3
 
4
Eric Arazo
Dublin City University
Total Publications: 4