Acoustic-labial speaker verification

Pierre Jourlin (1) , D Genoud , H Wassner

1 LIA - Laboratoire Informatique d'Avignon

This paper describes a multimodal approach for speaker verification. The system consists of two classifiers, one using visual features, the other using acoustic features. A lip tracker is used to extract visual information from the speaking face which provides shape and intensity features. We describe an approach for normalizing and mapping different modalities onto a common confidence interval. We also describe a novel method for integrating the scores of multiple classifiers. Verification experiments are reported for the individual modalities and for the combined classifier. The integrated system outperformed each subsystem and reduced the false acceptance rate of the acoustic subsystem from 2.3% to 0.5%. © 1997 Elsevier Science B.V.

Keywords: Bimodal speech; Person authentication; Lip feature extraction; Decision fusion; Hidden Markov models

Domains: Computer Science [cs]; Artificial Intelligence [cs.AI]; Computer Science [cs]; Computation and Language [cs.CL]; Computer Science [cs]; Machine Learning [cs.LG]; Computer Science [cs]; Signal and Image Processing; Computer Science [cs]; Document and Text Processing; Computer Science [cs]; Multimedia [cs.MM]

Pierre Jourlin, D Genoud, H Wassner. Acoustic-labial speaker verification. Pattern Recognition Letters, 1997, 18, pp.853 - 858. ⟨hal-02152874⟩