Discriminative Learning for Speech Recognition

Discriminative Learning for Speech Recognition PDF

Author: Xiadong He

Publisher: Morgan & Claypool Publishers

Published: 2008

Total Pages: 121

ISBN-13: 1598293087

DOWNLOAD EBOOK →

In this book, we introduce the background and mainstream methods of probabilistic modeling and discriminative parameter optimization for speech recognition. The specific models treated in depth include the widely used exponential-family distributions and the hidden Markov model. A detailed study is presented on unifying the common objective functions for discriminative learning in speech recognition, namely maximum mutual information (MMI), minimum classification error, and minimum phone/word error. The unification is presented, with rigorous mathematical analysis, in a common rational-function form. This common form enables the use of the growth transformation (or extended Baum-Welch) optimization framework in discriminative learning of model parameters. In addition to all the necessary introduction of the background and tutorial material on the subject, we also included technical details on the derivation of the parameter optimization formulas for exponential-family distributions, discrete hidden Markov models (HMMs), and continuous-density HMMs in discriminative learning. Selected experimental results obtained by the authors in firsthand are presented to show that discriminative learning can lead to superior speech recognition performance over conventional parameter learning. Details on major algorithmic implementation issues with practical significance are provided to enable the practitioners to directly reproduce the theory in the earlier part of the book into engineering practice.

Automatic Speech Recognition

Automatic Speech Recognition PDF

Author: Dong Yu

Publisher: Springer

Published: 2014-11-11

Total Pages: 329

ISBN-13: 1447157796

DOWNLOAD EBOOK →

This book provides a comprehensive overview of the recent advancement in the field of automatic speech recognition with a focus on deep learning models including deep neural networks and many of their variants. This is the first automatic speech recognition book dedicated to the deep learning approach. In addition to the rigorous mathematical treatment of the subject, the book also presents insights and theoretical foundation of a series of highly successful deep learning models.

Discriminative Learning for Speech Recognition

Discriminative Learning for Speech Recognition PDF

Author: Xiadong He

Publisher: Springer Nature

Published: 2022-06-01

Total Pages: 112

ISBN-13: 3031025571

DOWNLOAD EBOOK →

In this book, we introduce the background and mainstream methods of probabilistic modeling and discriminative parameter optimization for speech recognition. The specific models treated in depth include the widely used exponential-family distributions and the hidden Markov model. A detailed study is presented on unifying the common objective functions for discriminative learning in speech recognition, namely maximum mutual information (MMI), minimum classification error, and minimum phone/word error. The unification is presented, with rigorous mathematical analysis, in a common rational-function form. This common form enables the use of the growth transformation (or extended Baum–Welch) optimization framework in discriminative learning of model parameters. In addition to all the necessary introduction of the background and tutorial material on the subject, we also included technical details on the derivation of the parameter optimization formulas for exponential-family distributions, discrete hidden Markov models (HMMs), and continuous-density HMMs in discriminative learning. Selected experimental results obtained by the authors in firsthand are presented to show that discriminative learning can lead to superior speech recognition performance over conventional parameter learning. Details on major algorithmic implementation issues with practical significance are provided to enable the practitioners to directly reproduce the theory in the earlier part of the book into engineering practice. Table of Contents: Introduction and Background / Statistical Speech Recognition: A Tutorial / Discriminative Learning: A Unified Objective Function / Discriminative Learning Algorithm for Exponential-Family Distributions / Discriminative Learning Algorithm for Hidden Markov Model / Practical Implementation of Discriminative Learning / Selected Experimental Results / Epilogue / Major Symbols Used in the Book and Their Descriptions / Mathematical Notation / Bibliography

Automatic Speech and Speaker Recognition

Automatic Speech and Speaker Recognition PDF

Author: Joseph Keshet

Publisher: John Wiley & Sons

Published: 2009-04-27

Total Pages: 268

ISBN-13: 9780470742037

DOWNLOAD EBOOK →

This book discusses large margin and kernel methods for speech and speaker recognition Speech and Speaker Recognition: Large Margin and Kernel Methods is a collation of research in the recent advances in large margin and kernel methods, as applied to the field of speech and speaker recognition. It presents theoretical and practical foundations of these methods, from support vector machines to large margin methods for structured learning. It also provides examples of large margin based acoustic modelling for continuous speech recognizers, where the grounds for practical large margin sequence learning are set. Large margin methods for discriminative language modelling and text independent speaker verification are also addressed in this book. Key Features: Provides an up-to-date snapshot of the current state of research in this field Covers important aspects of extending the binary support vector machine to speech and speaker recognition applications Discusses large margin and kernel method algorithms for sequence prediction required for acoustic modeling Reviews past and present work on discriminative training of language models, and describes different large margin algorithms for the application of part-of-speech tagging Surveys recent work on the use of kernel approaches to text-independent speaker verification, and introduces the main concepts and algorithms Surveys recent work on kernel approaches to learning a similarity matrix from data This book will be of interest to researchers, practitioners, engineers, and scientists in speech processing and machine learning fields.

Robust Automatic Speech Recognition

Robust Automatic Speech Recognition PDF

Author: Jinyu Li

Publisher: Academic Press

Published: 2015-10-30

Total Pages: 306

ISBN-13: 0128026162

DOWNLOAD EBOOK →

Robust Automatic Speech Recognition: A Bridge to Practical Applications establishes a solid foundation for automatic speech recognition that is robust against acoustic environmental distortion. It provides a thorough overview of classical and modern noise-and reverberation robust techniques that have been developed over the past thirty years, with an emphasis on practical methods that have been proven to be successful and which are likely to be further developed for future applications. The strengths and weaknesses of robustness-enhancing speech recognition techniques are carefully analyzed. The book covers noise-robust techniques designed for acoustic models which are based on both Gaussian mixture models and deep neural networks. In addition, a guide to selecting the best methods for practical applications is provided. The reader will: Gain a unified, deep and systematic understanding of the state-of-the-art technologies for robust speech recognition Learn the links and relationship between alternative technologies for robust speech recognition Be able to use the technology analysis and categorization detailed in the book to guide future technology development Be able to develop new noise-robust methods in the current era of deep learning for acoustic modeling in speech recognition The first book that provides a comprehensive review on noise and reverberation robust speech recognition methods in the era of deep neural networks Connects robust speech recognition techniques to machine learning paradigms with rigorous mathematical treatment Provides elegant and structural ways to categorize and analyze noise-robust speech recognition techniques Written by leading researchers who have been actively working on the subject matter in both industrial and academic organizations for many years

Pattern Recognition in Speech and Language Processing

Pattern Recognition in Speech and Language Processing PDF

Author: Wu Chou

Publisher: CRC Press

Published: 2003-02-26

Total Pages: 413

ISBN-13: 0203010523

DOWNLOAD EBOOK →

Over the last 20 years, approaches to designing speech and language processing algorithms have moved from methods based on linguistics and speech science to data-driven pattern recognition techniques. These techniques have been the focus of intense, fast-moving research and have contributed to significant advances in this field. Pattern Reco

New Era for Robust Speech Recognition

New Era for Robust Speech Recognition PDF

Author: Shinji Watanabe

Publisher: Springer

Published: 2017-10-30

Total Pages: 436

ISBN-13: 331964680X

DOWNLOAD EBOOK →

This book covers the state-of-the-art in deep neural-network-based methods for noise robustness in distant speech recognition applications. It provides insights and detailed descriptions of some of the new concepts and key technologies in the field, including novel architectures for speech enhancement, microphone arrays, robust features, acoustic model adaptation, training data augmentation, and training criteria. The contributed chapters also include descriptions of real-world applications, benchmark tools and datasets widely used in the field. This book is intended for researchers and practitioners working in the field of speech processing and recognition who are interested in the latest deep learning techniques for noise robustness. It will also be of interest to graduate students in electrical engineering or computer science, who will find it a useful guide to this field of research.

Machine Learning in Signal Processing

Machine Learning in Signal Processing PDF

Author: Sudeep Tanwar

Publisher: CRC Press

Published: 2021-12-10

Total Pages: 488

ISBN-13: 1000487814

DOWNLOAD EBOOK →

Machine Learning in Signal Processing: Applications, Challenges, and the Road Ahead offers a comprehensive approach toward research orientation for familiarizing signal processing (SP) concepts to machine learning (ML). ML, as the driving force of the wave of artificial intelligence (AI), provides powerful solutions to many real-world technical and scientific challenges. This book will present the most recent and exciting advances in signal processing for ML. The focus is on understanding the contributions of signal processing and ML, and its aim to solve some of the biggest challenges in AI and ML. FEATURES Focuses on addressing the missing connection between signal processing and ML Provides a one-stop guide reference for readers Oriented toward material and flow with regards to general introduction and technical aspects Comprehensively elaborates on the material with examples and diagrams This book is a complete resource designed exclusively for advanced undergraduate students, post-graduate students, research scholars, faculties, and academicians of computer science and engineering, computer science and applications, and electronics and telecommunication engineering.

Handbook of Neural Networks for Speech Processing

Handbook of Neural Networks for Speech Processing PDF

Author: Shigeru Katagiri

Publisher: Artech House Publishers

Published: 2000

Total Pages: 560

ISBN-13:

DOWNLOAD EBOOK →

Here are the comprehensive details on cutting edge technologies employing neural networks for speech recognition and speech processing in modern communications. Going far beyond the simple speech recognition technologies on the market today, this new book, written by and for speech and signal processing engineers in industry, R&D, and academia, takes you to the forefront of the hottest emergent neural net-based speech processing techniques.

Techniques for Noise Robustness in Automatic Speech Recognition

Techniques for Noise Robustness in Automatic Speech Recognition PDF

Author: Tuomas Virtanen

Publisher: John Wiley & Sons

Published: 2012-11-28

Total Pages: 514

ISBN-13: 1119970881

DOWNLOAD EBOOK →

Automatic speech recognition (ASR) systems are finding increasing use in everyday life. Many of the commonplace environments where the systems are used are noisy, for example users calling up a voice search system from a busy cafeteria or a street. This can result in degraded speech recordings and adversely affect the performance of speech recognition systems. As the use of ASR systems increases, knowledge of the state-of-the-art in techniques to deal with such problems becomes critical to system and application engineers and researchers who work with or on ASR technologies. This book presents a comprehensive survey of the state-of-the-art in techniques used to improve the robustness of speech recognition systems to these degrading external influences. Key features: Reviews all the main noise robust ASR approaches, including signal separation, voice activity detection, robust feature extraction, model compensation and adaptation, missing data techniques and recognition of reverberant speech. Acts as a timely exposition of the topic in light of more widespread use in the future of ASR technology in challenging environments. Addresses robustness issues and signal degradation which are both key requirements for practitioners of ASR. Includes contributions from top ASR researchers from leading research units in the field