Toward an automatic speech recognition system using ultrasound images
DOI:
https://doi.org/10.17469/O2101AISV000032Abstract
We provide a proposal for a silent speech interface based on Ultrasound Tongue Imaging (UTI) data. The model we present appears to be the first proposal for a silent speech interface based on UTI for the Italian language. The model is fed with ultrasonic data only (e.g. lips movements are not included in the model) and the extraction of information from ultrasound images is accomplished via a model of artificial neural network instead of standard hidden Markov Model. In the paper, we illustrate the phases of acquisition, filtering and modeling of articulatory data. Then, we describe the training of the neural network, with particular emphasis on the problems associated with the process of identification and extraction of salient information. Eventually, we report the success rate for the model when recognizing Italian real words.
Downloads
Published
Issue
Section
License
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.