首页    期刊浏览 2024年11月27日 星期三
登录注册

文章基本信息

  • 标题:SynFace—Speech-Driven Facial Animation for Virtual Speech-Reading Support
  • 本地全文:下载
  • 作者:Giampiero Salvi ; Jonas Beskow ; Samer Al Moubayed
  • 期刊名称:EURASIP Journal on Audio, Speech, and Music Processing
  • 印刷版ISSN:1687-4714
  • 电子版ISSN:1687-4722
  • 出版年度:2009
  • 卷号:2009
  • DOI:10.1155/2009/191940
  • 出版社:Hindawi Publishing Corporation
  • 摘要:

    This paper describes SynFace, a supportive technology that aims at enhancing audio-based spoken communication in adverse acoustic conditions by providing the missing visual information in the form of an animated talking head. Firstly, we describe the system architecture, consisting of a 3D animated face model controlled from the speech input by a specifically optimised phonetic recogniser. Secondly, we report on speech intelligibility experiments with focus on multilinguality and robustness to audio quality. The system, already available for Swedish, English, and Flemish, was optimised for German and for Swedish wide-band speech quality available in TV, radio, and Internet communication. Lastly, the paper covers experiments with nonverbal motions driven from the speech signal. It is shown that turn-taking gestures can be used to affect the flow of human-human dialogues. We have focused specifically on two categories of cues that may be extracted from the acoustic signal: prominence/emphasis and interactional cues (turn-taking/back-channelling).

国家哲学社会科学文献中心版权所有