PB-Worker: a novel participating behavior-based worker ability model for general tasks on crowdsourcing platforms

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

General tasks on crowdsourcing platforms attract more and more workers with different skills and experiences. Existing approaches only leverage the information from tasks with feedback to evaluate worker ability. However, there are millions of tasks without feedback on the platforms. The participating behavior of workers involved in these tasks has not been exploited. In this work, we propose a worker ability model PB-Worker to support general tasks on crowdsourcing platforms. We model the worker latent relation and task latent relation by exploiting the worker participating behavior. To the best of our knowledge, this is the first work to consider the worker participating behavior. Our model is a semi-supervised model that can cover tasks with feedback and tasks without feedback. We employ the ladder network to generate the representations of workers and employ the neural network to predict the worker ability scores. A set of experiments against the real-world dataset from the Zhubajie platform has been conducted. Experimental results show that the output quality of the proposed approach is better than the existing baseline methods.

Original languageEnglish
Title of host publicationProceedings - 2020 IEEE 13th International Conference on Web Services, ICWS 2020
Place of PublicationLos Alamitos, Ca
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages37-44
Number of pages8
ISBN (Electronic)9781728187860
DOIs
Publication statusPublished - 2020
Event13th IEEE International Conference on Web Services, ICWS 2020 - Virtual, Beijing, China
Duration: 18 Oct 202024 Oct 2020

Publication series

NameProceedings - 2020 IEEE 13th International Conference on Web Services, ICWS 2020

Conference

Conference13th IEEE International Conference on Web Services, ICWS 2020
CountryChina
CityVirtual, Beijing
Period18/10/2024/10/20

Keywords

  • Crowdsourcing
  • General tasks
  • Participating Behavior
  • Worker Ability

Fingerprint Dive into the research topics of 'PB-Worker: a novel participating behavior-based worker ability model for general tasks on crowdsourcing platforms'. Together they form a unique fingerprint.

Cite this