This paper presents an early study on building Vietnamese large vocabulary continuous speech recognition with concentration on choosing type of units and feature set. Our experiments were done using the HTK Toolkit and VOV broadcast corpus. The results sho
Vietnamese Large Vocabulary Continuous Speech Recognition
Thang Tat Vu*, Dung Tien Nguyen**, Mai Chi Luong**, John-Paul Hosom***.
* Graduate School of Information Science Japan Advanced Institute of Science and Technology
vu-thang@jaist.ac.jp
**Institute of Information Technology
Vietnamese Academy of Science and Technology.
dungtn@gmail.com, lcmai@ioit.ncst.ac.vn
***Center for Spoken Language Understanding (CSLU-OGI)
Oregon Health & Science University (OHSU)
hosom@cslu.ogi.edu
Abstract
This paper presents an early study on building Vietnamese large vocabulary continuous speech recognition with concentration on choosing type of units and feature set. Our experiments were done using the HTK Toolkit and VOV broadcast corpus. The results show that the recognizer with mixture units achieved better performance than recognizers with initial-final units or phoneme units. Among feature sets applied to the mixture unit recognizer, MFCC has performance somewhat better than PLP, and the combination of MFCC and F0 features increases the accuracy of the Vietnamese recognition system.
The MFCC and PLP features do not captured the F0 contour – which is the most important characteristic to distinguish different tones [11, 13]. The use of a bigram language model improves the accuracy but is not enough to resolve the tonal problem. Therefore, the combination of MFCC and F0 features was used to improve the accuracy of a Vietnamese large vocabulary continuous speech recognition system.
The rest of this paper is organized as follows:
- In the next section, a brief description Vietnamese
phonetics is given. - In Section 3, we described the VOV corpus – the speech
corpus was used in our experiments and evaluations. - In Sections 4, 5 and 6, the Vietnamese speech recognition
system and a number of experiments are described along with their results that show the interaction between unit types, feature sets and recognition performance. - Finally, conclusions and future research are given in the
last section.
1. Introduction
Automatic speech recognition (ASR) is one branch of the field of speech processing, and related with a number of different fields of knowledge such as acoustics, linguistics, pattern recognition, and artificial intelligence [6]. The complexity of an ASR system depends on its limitations, such as (a) speaker independence or dependence (b) large, medium or small vocabulary, (c) complexity of grammar, or (d) continuous, connected or isolated speech.
Large vocabulary, continuous speech recognition is only at the beginning of development for Vietnamese. The equivalent task is considered challenging even in English. Many existing methods for speech recognition have been developed for spoken English and other European languages. The purpose of our work is to apply language independent ASR techniques using Hidden Markov Models [6, 7, 8, and 9] to the Vietnamese language, to investigate the effect of different types of phonetic units on recognition performance, and evaluate feature sets used in classification.
Another difficulty is that Vietnamese is a syllabic tonal language, which has six lexical tones for most syllables. In such a tonal language, the meaning of a syllable is dependent on the tones, and tone classification is an essential issue for a Vietnamese ASR system. Although there are some good results for other tonal languages [11, 13], Vietnamese tone classification has nearly no results [10], especially for continuous speech.
2. Basic Phonetic Structure of Vietnamese
Vietnamese is a monosyllable tonal language. Each Vietnamese syllable may be considered as a combination of Initial, Final and Tone components.
Table 1. Structure of Vietnamese syllable
Tone
Initial
Final
The Initial component is always a consonant, or it may be omitted in some syllables (or seen as zero initial). There are 21 Initials in Vietnamese and 155 Final components in Vietnamese. The total of pronounceable distinct syllables in Vietnamese is 18958 but the used syllables in practice are only around 7000 different syllables [1].
The Final can be decomposed into Onset, Nucleus and Coda. The Onset and Coda are optional and may not exist in a syllable. The Nucleus consists of a vowel or a diphthong, and
Vietnamese Large Vocab... 暂无评价 4页 免费 (HMMANN) Large Vocabul... ...speech recording in Large Vocabulary Continuous Speech Recognition (LVCSR) ...
Vietnamese Large Vocabul... 暂无评价 4页 免费 A large vocabulary conti... 5页 免费 An Amharic Speech Corpus... 4页 免费 Continuous Recognition o.....
Vietnamese Large Vocabul... 暂无评价 4页 免费 (HMMANN) Large Vocabular.....Accent Issues in Large Vocabulary Continuous Speech Recognition CHAO HUANG, ...
Vietnamese Large Vocabul... 暂无评价 4页 免费 (HMMANN) Large Vocabular..... An Amharic Speech Corpus for Large Vocabulary Continuous Speech Recognition ...
Large Vocabulary Continu... 暂无评价 4页 免费 Vietnamese Large Vocabul...... Fast speakers in large vocabulary continuous speech recognition Analysis and ...
Vietnamese Large Vocabul... 暂无评价 4页 免费 (HMMANN) Large Vocabular..... Large Vocabulary Continuous Speech Recognition of Uyghur Basic Research of ...
Large Vocabulary Continu... 暂无评价 4页 免费 Vietnamese Large Vocabul...... training of acoustic models for large vocabulary continuous speech recognition...
Large Vocabulary Continu... 暂无评价 4页 免费 Vietnamese Large Vocabul...... training of acoustic models for large vocabulary continuous speech recognition...
Continuous audio-visual ... 17页 免费 Vietnamese Large Vocabul... 暂无... Audio-visual large vocabulary continuous speech recognition in the broadcast ...
Continuous audio-visual ... 17页 免费 Vietnamese Large Vocabul... 暂无... AUDIO-VISUAL LARGE VOCABULARY CONTINUOUS SPEECH RECOGNITION IN THE BROADCAST ...
热门文档