Publication detail

On Use of Crowdsourcing for H.264/ AVC and H.265/HEVC Video Quality Evaluation

ZACH, O. SEUFERT, M. HIRTH, M. SLANINA, M. TRAN-GIA, P.

Original Title

On Use of Crowdsourcing for H.264/ AVC and H.265/HEVC Video Quality Evaluation

English Title

On Use of Crowdsourcing for H.264/ AVC and H.265/HEVC Video Quality Evaluation

Type

conference paper

Language

en

Original Abstract

Crowdsourcing has become a popular method in the field of video quality evaluation. Gathering the opinion of theusers using crowdsourcing is quick and relatively cheap but such a study has to be designed very carefully in order to give relevant results. So far, the majority of the QoE studies using crowdsourcing has been focusing on the performance of H.264/AVC algorithm in different situations (such as encoder settings, stalling effects, etc). Modern video coding methods, however, are only rarely tested using the crowdsourcing approach. We designed a study comparing the performance of both H.264/AVC and H.265/HEVC standards in the crowdsourcing environment. We deal with the possibilities of delivering and presenting the HEVC encoded content to the participants of the crowdsourcing study and potential challenges. Finally, the study was performed using Microworkers platform and gathered results are then compared with three different objective video quality metrics.

English abstract

Crowdsourcing has become a popular method in the field of video quality evaluation. Gathering the opinion of theusers using crowdsourcing is quick and relatively cheap but such a study has to be designed very carefully in order to give relevant results. So far, the majority of the QoE studies using crowdsourcing has been focusing on the performance of H.264/AVC algorithm in different situations (such as encoder settings, stalling effects, etc). Modern video coding methods, however, are only rarely tested using the crowdsourcing approach. We designed a study comparing the performance of both H.264/AVC and H.265/HEVC standards in the crowdsourcing environment. We deal with the possibilities of delivering and presenting the HEVC encoded content to the participants of the crowdsourcing study and potential challenges. Finally, the study was performed using Microworkers platform and gathered results are then compared with three different objective video quality metrics.

Keywords

video coding; H.264/AVC; H.265/HEVC; crowdsourcing; subjective quality

Released

19.04.2017

Location

Brno

ISBN

978-1-5090-4591-4

Book

Proceedings of 27th International Conference Radioelektronika 2017

Pages from

1

Pages to

6

Pages count

6

BibTex


@inproceedings{BUT135222,
  author="Ondřej {Zach} and Michael {Seufert} and Matthias {Hirth} and Martin {Slanina} and Phuoc {Tran-Gia}",
  title="On Use of Crowdsourcing for H.264/ AVC and H.265/HEVC Video Quality Evaluation",
  annote="Crowdsourcing has become a popular method in the field of video quality evaluation. Gathering the opinion of theusers using crowdsourcing is quick and relatively cheap but such a study has to be designed very carefully in order to give relevant results. So far, the majority of the QoE studies using crowdsourcing has been focusing on the performance of H.264/AVC algorithm in different situations (such as encoder settings, stalling effects, etc). Modern video coding methods, however, are only rarely tested using the crowdsourcing approach. We designed a study comparing the performance of both H.264/AVC and H.265/HEVC standards in the crowdsourcing environment. We deal with the possibilities of delivering and presenting the HEVC encoded content to the participants of the crowdsourcing study and potential challenges. Finally, the study was performed using Microworkers platform and gathered results are then compared with three different objective video quality metrics.",
  booktitle="Proceedings of 27th International Conference Radioelektronika 2017",
  chapter="135222",
  doi="10.1109/RADIOELEK.2017.7937581",
  howpublished="electronic, physical medium",
  year="2017",
  month="april",
  pages="1--6",
  type="conference paper"
}