Loading...
Thumbnail Image
Publication

Mitigation of Unintended Biases against Non-Native English Texts in Sentiment Analysis

Type
Article
Journal Title
CEUR Workshop Proceedings
Book title
Publication Date
2019-12
Volume
2563
Issue
Start page
317
End page
328
Publication Number of pages
Research Projects
Organizational Units
Journal Issue
Abstract
Proceedings for the 27th AIAI Irish Conference on Artificial Intelligence and Cognitive Science NUI Galway, Galway, Ireland, December 5-6th, 2019. Currently the demand for text analytics grows due to the fact that textual data is being created online in large amounts. A number of tools are available for various tasks related to natural language process- ing such as sentiment analysis and text pre-processing. The majority of these tools are trained using unrepresentative data, which may lead to unintended biases altering the results. Previous research indicates that sentiment analysis tools show gender and race biases, and word embed- dings discriminate against women. This research investigates previously undefined non-native speaker bias in sentiment analysis, i.e. unintended discrimination against English texts written by non-native speakers of English. Non-native speakers of English tend to use cognates, English words that have origin in the speaker’s language. To measure the non- native speaker bias in 4 lexicon-based sentiment analysis systems, a new Cognate Equity Evaluation Corpus was created, based on previous work in the literature for measuring racial and gender biases. The tools gave significantly different scores to English texts with features of non-native speakers. The bias discovered in lexicon-based tools was mitigated by updating 4 lexicons for English cognates in 3 languages. This paper pro- poses a generalisable framework for measuring and mitigating non-native speaker bias.
Keywords
Fairness in machine learning, Natural language processing, Bias mitigation, Non-native speaker bias, Sentiment analysis
Publisher
Citation
Topic
Collections