APPROCHE BIMODALE DU TRAITEMENT AUTOMATIQUE DE LA PAROLE : APPLICATION A LA RECONNAISSANCE DU MESSAGE ET DU LOCUTEUR

Abstract : This work addresses the problem of integrating visual information about the lip movements into acoustic-based speech processing systems. In a first part, the different problems and methods related to this particular approach are discussed. The first chapter is dedicated to the asynchrony phenomenon (or temporal independence) of the two sources of information and to the different ways of handling it in HMM-based speech processing systems. The second chapter concerns the problem of combining two modalities which may have very different behaviours from a reliability point of view : Different methods for finding an optimal weighting are discussed. In the second part are reported the different experiments I have done in the acoustic-labial speech processing field. In the chapter 3 are reported my own experiments in the acoustic-labial speech recognition field and in the framework of AMIBE (French CNRS project). I also present in this chapter the results of the novel methods described in chapter 1 and 2. Chapter 4 is dedicated to acoustic-labial person authentication systems and experiments, in the framework of the European project M2VTS (program ACTS). These experiments are the very first conduced in the field of acoustic-labial speaker recognition and verification.
Complete list of metadatas

Cited literature [287 references]  Display  Hide  Download

https://hal-univ-avignon.archives-ouvertes.fr/tel-02152912
Contributor : Pierre Jourlin <>
Submitted on : Tuesday, June 11, 2019 - 5:48:08 PM
Last modification on : Saturday, June 15, 2019 - 1:24:36 AM

File

thesePJ98.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : tel-02152912, version 1

Collections

Citation

Pierre Jourlin. APPROCHE BIMODALE DU TRAITEMENT AUTOMATIQUE DE LA PAROLE : APPLICATION A LA RECONNAISSANCE DU MESSAGE ET DU LOCUTEUR. Informatique et langage [cs.CL]. Université d'Avignon et des Pays de Vaucluse, 1998. Français. ⟨tel-02152912⟩

Share

Metrics

Record views

27

Files downloads

9