首页    期刊浏览 2024年09月19日 星期四
登录注册

文章基本信息

  • 标题:Automatic Motion Tracking of Lips using Digital Video and OpenFace 2.0
  • 本地全文:下载
  • 作者:Peter A. Krause ; Christopher A. Kay ; Alan H. Kawamoto
  • 期刊名称:Laboratory Phonology: Journal of the Association for Laboratory Phonology
  • 电子版ISSN:1868-6354
  • 出版年度:2020
  • 卷号:11
  • 期号:1
  • 页码:9-24
  • DOI:10.5334/labphon.232
  • 摘要:Because the lips are external organs, they can be easily observed by means that are non-invasive, including simple video recording. The current paper introduces a free-of-charge, highly portable, automatic solution for extracting oral posture from digital video, based on an existing facetracking utility. We describe how this solution might benefit various lines of laboratory phonology research, including analysis of articulatory coordination and audiovisual speech, as well as phonetic fieldwork. We then provide a tutorial, framed as a simple experiment in metronomic speech. The tutorial describes how to configure the software to work with one’s digital camera of choice, how to extract relevant articulatory parameters from the face tracker, and how to approach statistical analysis. We have supplied pre-written Python scripts to aid the reader in following along with the experiment. The portability, ease, and affordability of the described solution have important implications for the accessibility of articulatory measurement, both in the lab and out in the field.
  • 关键词:articulatory measurement; digital video; lip aperture; motion tracking
国家哲学社会科学文献中心版权所有