You are here

Aggregation Methods for Collective Annotation

Event date: 
Tuesday, 24 February, 2015 - 11:00 to 12:00

Title: Aggregation Methods for Collective Annotation

Speaker: Raquel Fernandez
Institute for Logic, Language & Computation
University of Amsterdam

Abstract: Crowdsourcing provides new ways of cheaply and quickly gathering large amounts of information contributed by volunteers online. This method has revolutionised the collection of linguistic judgements, in computational linguistics and elsewhere. However, to create annotated linguistic resources from crowdsourced data we face the problem of having to combine the judgements of a potentially large group of individuals. In this talk I will present joint work with Ulle Endriss, Justin Kruger, and Ciyang Qing where we put forward the idea of using principles of social choice theory (which has traditionally dealt with the aggregation of the preferences of individual voters in an election) to design new methods for aggregating individual linguistic annotations into a single collective annotation.


Federico Sangati,

Room 101, FBK, Via Sommarive, 18 Povo (Trento)