recurrent neural network based language modeling in meeting recognition

... to- kens). The resulting clusterings are then used in training partially class -based language mod- els. We show that combining them with word- based n-gram models in the log-linear model of a state-of-the-art ... class- based language model as well as a word -based model as separate feature functions in the log-linear com- bination in Eq. (11). The weights are trained using minimum error rate training (Och, ... increase the gains resulting from using class -based models by using more sophisticated techniques for combining them with word -based models such as linear inter- polations of word- and class -based models...

Ngày tải lên: 31/03/2014, 00:20

Ngày tải lên: 21/06/2014, 20:20

Ngày tải lên: 21/06/2014, 20:20

... in Howrah, India, in 1966. He graduated from the Electrical Engineering Department, Bengal Engineering College, Calcutta, India, and received the Ph.D. degree in electrical engineering from Indian ... 10. Machine line voltage and phase current waves in mode 1 (10 Hz). (a) Neural- network- based SVM. (b) Equivalent DSP -based SVM. Fig. 11. Machine line voltage and phase current waves in mode 2 ... evaluated in detail by simulation with the neural network which was trained and tested offline in the undermodulation range ( 10–1603 V and 0–50 Hz) with sampling time ms ( kHz). The training data...

Ngày tải lên: 22/12/2013, 08:16

... describes trigger -based language modeling. Section 5 gives one of its applications: PINYIN-to-Character Conversion. Finally, a conclusion is given. 1 Concept of Trigger Pair Based on the above ... distances 2.2 Selecting Trigger Pair Given a window, we define two events: 1466 Word Association and MI-Trigger -based Language Modeling GuoDong ZHOU KimTeng LUA Department of Information Systems ... group neighboring Chinese characters in a sentence into two-character words by making use of a measure of character association based on mutual information. Here, we will focus instead on the...

Ngày tải lên: 23/03/2014, 19:20

... many floating point operations as are needed to classify a window in our system, in which the main costs are in preprocessing and applying neural networks to the window. Although there is insufficient ... Geoffrey Hinton, Kiyohiro Shikano, and Kevin J. Lang. Phoneme recognition using time-delay neural networks. Readings in Speech Recognition, pages 393–404, 1989. weights computed by training in the ... differences in camera input gains, as well as improving contrast in some cases. The preprocessed window is then passed through a neural network. The network has retinal connec- tions to its inputlayer;...

Ngày tải lên: 28/04/2014, 09:58

... network. This network assumes that its input window contains a face, and is trained to estimate its orientation. The inputs to the network are the intensity values in a20x20pixel window of the ... outputs used in the autonomous driving domain [ Pomerleau, 1992 ] . Examples of the training data are given in Figure 3. Figure 3: Example inputs and outputs for training the router network. Previous ... match this distribution as closely as possible during training. The positive examples used in training are already in upright positions. During training, we can also run the scenery images from which negative...

Ngày tải lên: 28/04/2014, 09:58

... maximum of 951 training pairs was used. Due to time constraints, more training pairs were not employed. 5.2.2 Difficulty of training and testing data The other factor that influenced the recognition ... common training algorithm. The networks used were feed-forward neural networks. There was only one hidden layer for all kinds of networks in this research. The number of neurons in the input layer ... had 1,056 training pairs. As can be seen from the above table, the classification rates increased when the number of training pairs increased. Of course, since the number of training iterations...

Ngày tải lên: 28/04/2014, 10:10

Ngày tải lên: 28/04/2014, 10:11

Ngày tải lên: 28/04/2014, 10:11

Ngày tải lên: 28/04/2014, 10:16

Ngày tải lên: 21/06/2014, 08:20

Ngày tải lên: 23/06/2014, 01:20

Ngày tải lên: 27/06/2014, 18:20

... non-terminals associated with lexical items. In 3(b), each word in the string is asso- ciated with the beginning or continuation of a shal- low phrase or “chunk” in the tree. We include any non-terminals ... The use of a linguistically motivated language model in conver- sational speech recognition. In Proc. ICASSP. Wen Wang. 2003. Statistical parsing and language model- ing based on constraint dependency ... training utter- ance was processed by the baseline ASR system. In a naive approach, we would simply train the base- line system (i.e., an acoustic model and language model) on the entire training...

Ngày tải lên: 20/02/2014, 15:20

... ambiguity in finding the best matching string. The performance can further be improved if the acoustic matching information used in the recognition process is incorporated into the language decoding ... operations grows linearly with the number of arcs in the decoding network. As the overall number of arcs in the decoding network is a linear function of the number of ares in the syntactic network, ... obtained by expanding all the non-terminals into the corresponding vocabulary words and each word in terms of phonetic units. Finally a matching between the string of phones describing the...

Ngày tải lên: 08/03/2014, 07:20

Ngày tải lên: 05/09/2013, 14:58

... leadscrew grinding process using neural networks, Computers in Industry, 23, 169, 1993. 86. Chen, J. S., Neural network- based modeling and error compensation of thermally-induced spindle errors, International ... applications in intelligent manufacturing. Neural Network Applications in Intelligent Manufacturing System Modeling and Design Process Modeling, Planning and Scheduling Process Monitoring and Control Quality ... types of neural networks included ART networks, Hopfield networks, and SOM neural networks. Weaknesses of neural networks for modeling and design of manufacturing systems result from neural networks...

Ngày tải lên: 17/12/2013, 06:15

... continues with the next epoch. 3 Language Modeling Language modeling is important for many text pro- cessing applications, e.g., speech recognition or ma- chine translation, as well as for the kind ... confusing. Finally, language model integration with RSVP is relatively straightforward, as we shall demonstrate. See Roark et al. (2010) for methods integrating language modeling into grid scanning. 2 ... Fried-Oken. 2010. Scanning methods and language modeling for binary switch typing. In Proceedings of the NAACL HLT 2010 Workshop on Speech and Language Pro- cessing for Assistive Technologies, pages...

Ngày tải lên: 20/02/2014, 05:20

... be used in the construction. That is, beginning with only characters in the lexi- con and using the training data to alter the current lexicon in each iteration. This is also an interesting direction. References Maximilian ... constraints to combine phonemes into short chunks while the language model combines phonemes into longer chunks by more global con- straints. However, it’s almost impossible to include all words into ... for chinese language modeling. In ICASSP, pages 169–172. 763 4.4 Application: Character -based Spoken Document Indexing and Retrieval Pan et al. (2007) recently proposed a new Subword- based Confusion...

Ngày tải lên: 20/02/2014, 07:20