CrowdSR: enabling high-quality video ingest in crowdsourced livecast via super-resolution

Zhenxiao Luo, Zelong Wang, Jinyu Chen, Miao Hu, Yipeng Zhou, Tom Z. J. Fu, Di Wu

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

The prevalence of personal devices motivates the rapid development of crowdsourced livecast in recent years. However, there exists huge diversity of upstream bandwidth among amateur broadcasters. Moreover, the highest video quality that can be streamed is limited by the hardware configuration of broadcaster devices (e.g., 540p for low-end mobile devices). The above factors pose significant challenges to the ingestion of high-resolution live video streams, and result in poor quality-of-experience (QoE) for viewers. In this paper, we propose a novel live video ingest approach called CrowdSR for crowdsourced livecast. CrowdSR can transform a low-resolution video stream uploaded by weak devices into a high-resolution video stream via super-resolution, and then deliver the stream to viewers. CrowdSR can exploit crowdsourced high-resolution video patches from similar broadcasters to speedup model training. Different from previous work, our approach does not require any modification at the client side, and thus is more practical and easy to implement. Finally, we implement and evaluate CrowdSR by conducting a series of real-world experiments. The results show that CrowdSR significantly outperforms the baseline approaches by 0.42-1.09 dB in terms of PSNR and 0.006-0.014 in terms of SSIM.
Original languageEnglish
Title of host publicationNOSSDAV ’21
Subtitle of host publicationProceedings of the 2021 Workshop on Network and Operating System Support for Digital Audio and Video
Place of PublicationNew York, NY
PublisherAssociation for Computing Machinery (ACM)
Pages91-97
Number of pages7
ISBN (Electronic)9781450384353
DOIs
Publication statusPublished - 2021
Event31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2021 - Istanbul, Turkey
Duration: 28 Sep 20211 Oct 2021

Conference

Conference31st ACM Workshop on Network and Operating Systems Support for Digital Audio and Video, NOSSDAV 2021
CountryTurkey
CityIstanbul
Period28/09/211/10/21

Keywords

  • Crowdsourced Livecast
  • Video Streaming
  • Super-Resolution
  • Video Ingest

Fingerprint

Dive into the research topics of 'CrowdSR: enabling high-quality video ingest in crowdsourced livecast via super-resolution'. Together they form a unique fingerprint.

Cite this