The paper “EasyTurk: A User-Friendly Interface for High-Quality Linguistic Annotation with Amazon Mechanical Turk” by Lorenzo Bocchi, Valentino Frasnelli and Alessio Palmero Aprosio has been accepted for publication in the demo track of the 16th conference of the European Chapter of the Association for Computational Linguistics. The work describes EasyTurk, a free tool that adds a UI and new features to Amazon Mechanical Turk.

EasyTurk can be downloaded from its Github page.

Abstract

Amazon Mechanical Turk (AMT) has recently become one of the most popular crowd-sourcing platforms, allowing researchers from all over the world to create linguistic datasets quickly and at a relatively low cost. Amazon provides both a web interface and an API for AMT, but they are not very user-friendly and miss some features that can be useful for NLP researchers. In this paper, we present EasyTurk, a free tool that improves the potential of Amazon Mechanical Turk by adding to it some new features. The tool is free and released under an open source license.