Synthesis of disordered voices

The context of this project is the clinical assessment of voice. Auditory and acoustic assessment of voice (and by extension speech) is to laryngology and speech therapy what electrocardiography is to cardiology and electroencephalography to neurology. That is, it reports the function of the laryngeal oscillator and the adequacy of the produced vocal timbre by relying on methods of investigation that are not intrusive and do not obstruct the patient’s production of speech. Synthetic speech contributes to that purpose as a computational tool to facilitate tests and training, and also to explore and understand the genesis of abnormal vocal qualities.

Vocal tract

A disordered voice is a voice that is perceived as abnormal with regard to pitch, loudness or timbre, and is often the consequence of a laryngeal pathology or some physiological dysfunction. In this project, we develop a synthesizer of speech sounds which is capable of simulating the timbre of disordered voices with an acceptable level of naturalness. We follow a physics-based strategy using models of the vocal fold vibration, glottal airflow and acoustic wave propagation in the vocal tract.

alt text 

Listen: synthetic voice samples

Colaborations

Dr. Jean Schoentgen, Université Libre de Bruxelles, Belgium.
Dr. Mara Behlau, Center for Voice Studies and Federal University of São Paulo.
Dr. Glaucya Madazio, Center for Voice Studies, São Paulo.

Students

Henrique Rodrigues Costa, undergraduate, University of Brasília.
Marina T. Englert, Master's course, Federal University of São Paulo.
Elias Amadeus, undergraduate, University of Brasilia.

Publications and conferences

(For published papers on other subjects, follow this link)

  1. M. Englert, G. Madazio, I. Gielow, J. C. Lucero & M. Behlau. “Perceptual error identification of human and synthesized voices”, 44th Annual Symposium of the Voice Foundation (Philadelphia, 2015). Poster

  2. J. C. Lucero, J. Schoentgen, J. Haas, P. Luizard & X. Pelorson. “Self-entrainment of the right and left vocal fold oscillators”, Journal of the Acoustical Society of America, 137, 2036-2046 (2015). PDF (*copyright note) | Info

  3. M. Behlau, G. Madazio, M. Englert, J. C. Lucero & J. Schoentgen. “Vocal fold model for disordered voice synthesis to develop auditory perception in speech-language pathologists”, Annual Convention of the American Speech-Language-Hearing Association (Orlando, 2014).

  4. M. Englert, G. Madazio, I. Gielow, J. C. Lucero & M. Behlau. “Erro de identificação perceptiva de vozes naturais e sintetizadas por ouvintes especialistas”, XXII Brazilian Congress on Phonoaudiology (Joinville, 2014).

  5. M. Behlau, G. Madazio, M. Englert, J. C. Lucero & J. Schoentgen. “A vocal fold model for disordered voice synthesis to develop auditory perception in speech language pathologists”, XXII Annual Pacific Voice Conference (Krakow, Poland, 2014). Invited talk

  6. J. C. Lucero, J. Schoentgen, M. Behlau & G. Madazio. ‘‘A vocal fold model for disordered voice synthesis,’’ 9th International Conference on Voice Physiology and Biomechanics (Salt Lake City, 2014). Poster and examples

  7. J. Schoentgen & J. C. Lucero. “Solving the Riccati–Titze equation of the glottal airflow rate”, 9th International Conference on Voice Physiology and Biomechanics (Salt Lake City, 2014).

  8. J. Schoentgen & J. C. Lucero. “Is formant frequency jitter audible?”, 9th International Conference on Voice Physiology and Biomechanics (Salt Lake City, 2014).

  9. J. C. Lucero. "Physics-based synthesis of disordered voices’, Buenos Aires Voice Meeting 2013 (Buenos Aires, Argentina, 2013).

  10. J. Schoentgen e J.C. Lucero. “Is jitter irregularity the missing link between measured speech cycle length jitter and perceived vocal timbre?”, 10th PanEuropean Voice Conference – PEVOC (Prague, 2013).

  11. J. C. Lucero, J. Schoentgen & M Behlau. “Physics-based synthesis of disordered voices”, Interspeech 2013 (Lyon, France, 2013). PDF | synthetic samples

  12. J. C. Lucero & J. Schoentgen. “Modeling vocal fold asymmetries with coupled van der Pol oscillators”, 21st International Congress on Acoustics - ICA (Montreal, 2013). PDF (*copyright note) | Info

  13. M. Behlau, G. Madazio, J. C. Lucero & J. Schoentgen. “Um novo paradigma no ensino da avaliação auditiva da voz Uso de amostras sintetizadas”, XXI Brazilian Congress and II IberoAmerican on Phonoaudiology (Porto de Galinhas, September 2013), 157-160. PDF

  14. J. Schoentgen & J. C. Lucero. “Synthesis by rule of disordered voices”, in: T. Drugman & T. Dutroit (eds.), Advances in Nonlinear Speech Processing (Lecture Notes in Artificial Intelligence)], Springer, 120-127 (2013). Info

Support

CNPq


* Copyright Acoustical Society of America. This article may be downloaded for personal use only. Any other use requires prior permission of the author and the Acoustical Society of America.