The paper “Challenges in Designing Games with a Purpose for Abusive Language Annotation” authored by Federico Bonetti and Sara Tonelli has been accepted at the First Workshop on Bridging Human-Computer Interaction and Natural Language Processing, co-located with EACL 2021.  The paper described the development of High School Superhero, an online game aimed at raising awareness on cyberbullying while collecting hate speech data.

Abstract

In this paper we discuss several challenges related to the development of a 3D game, whose goal is to raise awareness on cyberbullying while collecting linguistic annotation on offensive language.  The game is meant to be used by teenagers, thus raising a number of issues that need to be tackled during development. For example, the game aesthetics should be appealing for players belonging to this age group, but at the same time all possible solutions should be implemented to meet privacy requirements.  Also, the task of linguistic annotation should be possibly hidden, adopting so-called orthogonal game mechanics, without affecting the quality of collected data. While some of these challenges are being tackled in the game development, some others are discussed in this paper but still lack an ultimate solution.