Publications

Enabling low-resource transfer learning across COVID-19 corpora by combining event-extraction and co-training

Abstract

Social-science investigations can benefit from a direct comparison of heterogenous corpora: in this work, we compare US state-level COVID-19 policy announcements with policy discussions on Twitter. To perform this task, we require classifiers with high transfer accuracy to both (1) classify policy announcements and (2) classify tweets. We find that cotraining using event-extraction views significantly improves the transfer accuracy of our RoBERTa classifier by 3% above a RoBERTa baseline and 11% above other baselines. The same improvements are not observed for baseline views. With a set of 576 COVID-19 policy announcements, hand-labeled into 1 of 6 categories, our classifier observes a maximum transfer accuracy of. 77 f1-score on a handvalidated set of tweets. This work represents the first known application of these techniques to an NLP transfer learning task and facilitates cross-corpora comparisons necessary for studies of social science phenomena.

Date
2020
Authors
Alexander Spangher, Nanyun Peng, Jonathan May, Emilio Ferrara
Conference
Proceedings of the 1st Workshop on NLP for COVID-19 at ACL 2020