Reputation management in crowdsourcing systems

Mohammad Allahbakhsh*, Aleksandar Ignjatovic, Boualem Benatallah, Seyed Mehdi Reza Beheshti, Elisa Bertino, Norman Foo

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

36 Citations (Scopus)

Abstract

Worker selection is a significant and challenging issue in crowdsourcing systems. Such selection is usually based on an assessment of the reputation of the individual workers participating in such systems. However, assessing the credibility and adequacy of such calculated reputation is a real challenge. In this paper, we propose a reputation management model which leverages the values of the tasks completed, the credibility of the evaluators of the results of the tasks and time of evaluation of the results of these tasks in order to calculate more dependable quality metrics for workers and evaluators. The model has been implemented and experimentally validated.

Original languageEnglish
Title of host publicationCollaborateCom 2012 - Proceedings of the 8th International Conference on Collaborative Computing
Subtitle of host publicationNetworking, Applications and Worksharing
Pages664-671
Number of pages8
DOIs
Publication statusPublished - 1 Dec 2012
Externally publishedYes
Event8th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, CollaborateCom 2012 - Pittsburgh, PA, United States
Duration: 14 Oct 201217 Oct 2012

Conference

Conference8th IEEE International Conference on Collaborative Computing: Networking, Applications and Worksharing, CollaborateCom 2012
CountryUnited States
CityPittsburgh, PA
Period14/10/1217/10/12

Keywords

  • Crowdsourcing
  • Degree of Fairness
  • Reputation

Fingerprint

Dive into the research topics of 'Reputation management in crowdsourcing systems'. Together they form a unique fingerprint.

Cite this