You are here
Aggregation Methods for Collective Annotation
Title: Aggregation Methods for Collective Annotation
Speaker: Raquel Fernandez
Institute for Logic, Language & Computation
University of Amsterdam
Abstract: Crowdsourcing provides new ways of cheaply and quickly gathering large amounts of information contributed by volunteers online. This method has revolutionised the collection of linguistic judgements, in computational linguistics and elsewhere. However, to create annotated linguistic resources from crowdsourced data we face the problem of having to combine the judgements of a potentially large group of individuals. In this talk I will present joint work with Ulle Endriss, Justin Kruger, and Ciyang Qing where we put forward the idea of using principles of social choice theory (which has traditionally dealt with the aggregation of the preferences of individual voters in an election) to design new methods for aggregating individual linguistic annotations into a single collective annotation.