WorP: a novel worker performance prediction model for general tasks on crowdsourcing platforms

Qianli Xing*, Weiliang Zhao, Jian Yang, Jia Wu, Qi Wang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

Crowdsourcing platforms are widely used for requesters to find workers for general tasks. The answers to general tasks are usually open and not constrained by multiple choices. For the general tasks, the worker performance prediction models can facilitate the task assignment process in crowdsourcing. Worker performance prediction is affected by the three roles: the worker, the requester, and the task. The existing worker performance prediction models mainly consider the features of tasks and workers. However, these models rarely consider the features of requesters. And the existing worker performance prediction models for multiple-choice tasks are not suitable for general tasks as they are built based on the workers' accuracy on choices. In this work, we propose a worker performance prediction model by taking account of features of workers, tasks, and requesters to help requesters select workers for their general tasks on crowdsourcing platforms. We design a relationship learning module to learn the low dimension relationship representations of workers, tasks, and requesters. Furthermore, we design a performance learning model to predict workers' performance based on the features and relationship representations of workers, tasks, and requesters. A set of experiments against the realworld dataset from the Zhubajie platform has been conducted. Experimental results show that the proposed approach has better prediction results than the existing baseline methods.

Original languageEnglish
Title of host publicationProceedings - 2021 IEEE International Conference on Web Services, ICWS 2021
EditorsCarl Chang, Ernesto Damiani, Jing Fan, Parisa Ghodous, Michael Maximilien, Zhongjie Wang, Robert Ward, Jia Zhang
Place of PublicationPiscataway, NJ
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages161-166
Number of pages6
ISBN (Electronic)9781665416818
DOIs
Publication statusPublished - 2021
Event14th IEEE International Conference on Web Services, ICWS 2021 - Virtual, Online, United States
Duration: 5 Sept 202111 Sept 2021

Publication series

NameProceedings - 2021 IEEE International Conference on Web Services, ICWS 2021

Conference

Conference14th IEEE International Conference on Web Services, ICWS 2021
Country/TerritoryUnited States
CityVirtual, Online
Period5/09/2111/09/21

Keywords

  • Crowdsourcing
  • Worker Performance Prediction
  • General tasks
  • Requester Relationship
  • Requester Feature

Fingerprint

Dive into the research topics of 'WorP: a novel worker performance prediction model for general tasks on crowdsourcing platforms'. Together they form a unique fingerprint.

Cite this