Influencing Factors in Speech Quality Assessment using Crowdsourcing

Influencing Factors in Speech Quality Assessment using Crowdsourcing PDF

Author: Rafael Zequeira Jiménez

Publisher: Springer Nature

Published: 2022-04-04

Total Pages: 129

ISBN-13: 3030933105

DOWNLOAD EBOOK →

This book evaluates the impact of relevant factors affecting the results of speech quality assessment studies carried out in crowdsourcing. The author describes how these factors relate to the test structure, the effect of environmental background noise, and the influence of language differences. He details multiple user-centered studies that have been conducted to derive guidelines for reliable collection of speech quality scores in crowdsourcing. Specifically, different questions are addressed such as the optimal number of speech samples to include in a listening task, the influence of the environmental background noise in the speech quality ratings, as well as methods for classifying background noise from web audio recordings, or the impact of language proficiency in the user perception of speech quality. Ultimately, the results of these studies contributed to the definition of the ITU-T Recommendation P.808 that defines the guidelines to conduct speech quality studies in crowdsourcing.

Assessing the Quality of Experience of Cloud Gaming Services

Assessing the Quality of Experience of Cloud Gaming Services PDF

Author: Steven Schmidt

Publisher: Springer Nature

Published: 2022-09-07

Total Pages: 230

ISBN-13: 3031060113

DOWNLOAD EBOOK →

This book provides an overview of concepts and challenges in intis investigated using structural equation modeling. The conveyed understanding of gaming QoE, empirical eraction quality in the domain of cloud gaming services. The author presents a unified evaluation approach by combining quantitative subjective assessment methods in a concise way. The author discusses a measurement tool, Gaming Input Quality Scale (GIPS), that assesses the interaction quality of such a service available. Furthermore, the author discusses a new framework to assess gaming Quality of Experience (QoE) using a crowdsourcing approach. Lastly, based on a large dataset including dominant network and encoding conditions, the evaluation method is investigated using structural equation modeling. The conveyed understanding of gaming QoE, empirical findings, and models presented in this book should be of particular interest to researchers working in the fields of quality and usability engineering, as well as service providers and network operators.

Crowdsourcing for Speech Processing

Crowdsourcing for Speech Processing PDF

Author: Maxine Eskenazi

Publisher: John Wiley & Sons

Published: 2013-02-15

Total Pages: 343

ISBN-13: 1118541251

DOWNLOAD EBOOK →

Provides an insightful and practical introduction to crowdsourcing as a means of rapidly processing speech data Intended for those who want to get started in the domain and learn how to set up a task, what interfaces are available, how to assess the work, etc. as well as for those who already have used crowdsourcing and want to create better tasks and obtain better assessments of the work of the crowd. It will include screenshots to show examples of good and poor interfaces; examples of case studies in speech processing tasks, going through the task creation process, reviewing options in the interface, in the choice of medium (MTurk or other) and explaining choices, etc. Provides an insightful and practical introduction to crowdsourcing as a means of rapidly processing speech data. Addresses important aspects of this new technique that should be mastered before attempting a crowdsourcing application. Offers speech researchers the hope that they can spend much less time dealing with the data gathering/annotation bottleneck, leaving them to focus on the scientific issues. Readers will directly benefit from the book’s successful examples of how crowd- sourcing was implemented for speech processing, discussions of interface and processing choices that worked and choices that didn’t, and guidelines on how to play and record speech over the internet, how to design tasks, and how to assess workers. Essential reading for researchers and practitioners in speech research groups involved in speech processing

Human Information Processing in Speech Quality Assessment

Human Information Processing in Speech Quality Assessment PDF

Author: Stefan Uhrig

Publisher:

Published: 2021

Total Pages: 0

ISBN-13: 9783030713904

DOWNLOAD EBOOK →

This book provides a new multi-method, process-oriented approach towards speech quality assessment, which allows readers to examine the influence of speech transmission quality on a variety of perceptual and cognitive processes in human listeners. Fundamental concepts and methodologies surrounding the topic of process-oriented quality assessment are introduced and discussed. The book further describes a functional process model of human quality perception, which theoretically integrates results obtained in three experimental studies. This book's conceptual ideas, empirical findings, and theoretical interpretations should be of particular interest to researchers working in the fields of Quality and Usability Engineering, Audio Engineering, Psychoacoustics, Audiology, and Psychophysiology. Presents a new process-oriented approach towards speech quality assessment to uncover influences of speech transmission quality on human information processing; Proposes a multi-method assessment approach including subjective, behavioral, and neurophysiological levels of analysis; Reports findings from three experimental studies, that demonstrate interactions between perceived speech quality, contextual, and content-related influencing factors.

The Influence of Delay on Cloud Gaming Quality of Experience

The Influence of Delay on Cloud Gaming Quality of Experience PDF

Author: Saeed Shafiee Sabet

Publisher: Springer Nature

Published: 2022-06-18

Total Pages: 166

ISBN-13: 303099869X

DOWNLOAD EBOOK →

This book provides an understanding of the impact of delay on cloud gaming Quality of Experience (QoE) and proposes techniques to compensate for this impact, leading to a better gaming experience when there are network delays. The author studies why some games in the cloud are more delay sensitive than others by identifying game characteristics influencing a user's delay perception and predicting the gaming QoE degraded by the delay. The author also investigates the impact of jitter and serial-position effects on gaming QoE and delay. Using the insight gained, the author presents delay compensation techniques that can mitigate the negative influence of delay on gaming QoE that use the game characteristics to adapt the games.

Quality of Experience

Quality of Experience PDF

Author: Sebastian Möller

Publisher: Springer

Published: 2014-07-08

Total Pages: 431

ISBN-13: 331902681X

DOWNLOAD EBOOK →

This pioneering book develops definitions and concepts related to Quality of Experience in the context of multimedia- and telecommunications-related applications, systems and services and applies these to various fields of communication and media technologies. The editors bring together numerous key-protagonists of the new discipline “Quality of Experience” and combine the state-of-the-art knowledge in one single volume.

Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments

Evaluation in the Crowd. Crowdsourcing and Human-Centered Experiments PDF

Author: Daniel Archambault

Publisher: Springer

Published: 2017-09-27

Total Pages: 191

ISBN-13: 3319664352

DOWNLOAD EBOOK →

As the outcome of the Dagstuhl Seminar 15481 on Crowdsourcing and Human-Centered Experiments, this book is a primer for computer science researchers who intend to use crowdsourcing technology for human centered experiments. The focus of this Dagstuhl seminar, held in Dagstuhl Castle in November 2015, was to discuss experiences and methodological considerations when using crowdsourcing platforms to run human-centered experiments to test the effectiveness of visual representations. The inspiring Dagstuhl atmosphere fostered discussions and brought together researchers from different research directions. The papers provide information on crowdsourcing technology and experimental methodologies, comparisons between crowdsourcing and lab experiments, the use of crowdsourcing for visualisation, psychology, QoE and HCI empirical studies, and finally the nature of crowdworkers and their work, their motivation and demographic background, as well as the relationships among people forming the crowdsourcing community.

Quality of Synthetic Speech

Quality of Synthetic Speech PDF

Author: Florian Hinterleitner

Publisher: Springer

Published: 2017-04-07

Total Pages: 157

ISBN-13: 9811037345

DOWNLOAD EBOOK →

This book reviews research towards perceptual quality dimensions of synthetic speech, compares these findings with the state of the art, and derives a set of five universal perceptual quality dimensions for TTS signals. They are: (i) naturalness of voice, (ii) prosodic quality, (iii) fluency and intelligibility, (iv) absence of disturbances, and (v) calmness. Moreover, a test protocol for the efficient indentification of those dimensions in a listening test is introduced. Furthermore, several factors influencing these dimensions are examined. In addition, different techniques for the instrumental quality assessment of TTS signals are introduced, reviewed and tested. Finally, the requirements for the integration of an instrumental quality measure into a concatenative TTS system are examined.

Macrotask Crowdsourcing

Macrotask Crowdsourcing PDF

Author: Vassillis-Javed Khan

Publisher: Springer

Published: 2019-08-06

Total Pages: 279

ISBN-13: 3030123340

DOWNLOAD EBOOK →

Crowdsourcing is an emerging paradigm that promises to transform several domains: creative work, business work, cultural cooperation, etc. Crowdsourcing reflects the close-knit interplay between the latest computer technologies, the rapidly changing work model of the 21st century, and the very nature of people. The interplay makes for an exciting but at the same time challenging new field to investigate under the lens of a diverse set of disciplines, ranging from the technical to the social and from the theoretical to the applied. Early research has focused on an aspect of crowdsourcing known as micro-tasking. Micro-tasks are simple tasks (like image annotations) that anyone could perform. An emerging area is how to utilize crowdsourcing to solve problems that go beyond simple tasks towards more complex ones, that require collaboration and creativity. In juxtaposition to micro-task crowdsourcing, this book investigates macro-task crowdsourcing and its potential.

Motivation of Workers on Microtask Crowdsourcing Platforms

Motivation of Workers on Microtask Crowdsourcing Platforms PDF

Author: Babak Naderi

Publisher: Springer

Published: 2018-01-24

Total Pages: 112

ISBN-13: 3319727001

DOWNLOAD EBOOK →

This book studies the motivation of crowdworkers to find out how to attract more people and reach a higher quality of outcomes. The book first proposes a taxonomy for studying the motivation of crowdworkers including the potential influencing factors, different types of motivation, and possible consequences and outcomes related to the motivation. Next, the CWMS questionnaire, an instrument for measuring the underlying motivation of crowdworkers is developed. It considers different dimensions of motivation suggested by the Self-Determination Theory of motivation which is a well-established and empirically validated psychological theory used in various domains. This instrument can be used to study the effect of platform and user characteristics on the general motivation of crowdworkers. Later, the task-specific motivation of crowdworkers is studied in detail: Influencing factors are investigated, subjective methods for measuring them are evaluated, a model for predicting worker’s decision on taking a task is proposed, the relative importance of different factors for two populations of crowdworkers is studied, and finally, a model for predicting the expected workload (as one of the major influencing factors) given the task design is proposed.