Graph explorer

Integrated Weak Learning

We introduce Integrated Weak Learning, a principled framework that integrates weak supervision into the training process of machine learning models. Our approach jointly trains the end-model and a label model that aggregates multiple sources of weak supervision. We introduce a label model that can learn to aggregate weak supervision sources differently for different datapoints and takes into consideration the performance of the end-model during training. We show that our approach outperforms existing weak learning techniques across a set of 6 benchmark classification datasets. When both a small amount of labeled data and weak supervision are present the increase in performance is both consistent and large, reliably getting a 2-5 point test F1 score gain over non-integrated methods.

8 nodes7 linksoverview previewIntegrated Weak Learning
8 nodes7 links
Integrated Weak Learning8 visible / 8 total nodes / 22 links
Co-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipAuthorshipAuthorshipAuthorshipAuthorshipTopic signalAuthorshipAuthorshipWIntegrated Weak Learningpreprint / 2022APeter HayesResearcherAMingtian ZhangResearcherARaza HabibResearcherAJordan BurgessResearcherTMachine Learning49008 worksAEmine YilmazResearcherADavid BarberResearcher
PaperSignal 107 links

Integrated Weak Learning

preprint / 2022

Open