首页    期刊浏览 2024年10月05日 星期六
登录注册

文章基本信息

  • 标题:Modeling Nonlinear Transfer Functions from Speech Envelopes to Encephalography with Neural Networks
  • 本地全文:下载
  • 作者:Tobias de Taillez ; Florian Denk ; Bojana Mirkovic
  • 期刊名称:International Journal of Psychological Studies
  • 印刷版ISSN:1918-7211
  • 电子版ISSN:1918-722X
  • 出版年度:2019
  • 卷号:11
  • 期号:4
  • 页码:1-15
  • DOI:10.5539/ijps.v11n4p1
  • 出版社:Canadian Center of Science and Education
  • 摘要:Diferent linear models have been proposed to establish a link between an auditory stimulus and the neurophysiological response obtained through electroencephalography (EEG). We investigate if non-linear mappings can be modeled with deep neural networks trained on continuous speech envelopes and EEG data obtained in an auditory attention two-speaker scenario. An artificial neural network was trained to predict the EEG response related to the attended and unattended speech envelopes. After training, the properties of the DNN-based model are analyzed by measuring the transfer function between input envelopes and predicted EEG signals by using click-like stimuli and frequency sweeps as input patterns. Using sweep responses allows to separate the linear and nonlinear response components also with respect to attention. The responses from the model trained on normal speech resemble event-related potentials despite the fact that the DNN was not trained to reproduce such patterns. These responses are modulated by attention, since we obtain significantly lower amplitudes at latencies of 110 ms, 170 ms and 300 ms after stimulus presentation for unattended processing in contrast to the attended. The comparison of linear and nonlinear components indicates that the largest contribution arises from linear processing (75%), while the remaining 25% are attributed to nonlinear processes in the model. Further, a spectral analysis showed a stronger 5 Hz component in modeled EEG for attended in contrast to unattended predictions. The results indicate that the artificial neural network produces responses consistent with recent findings and presents a new approach for quantifying the model properties.
  • 关键词:auditory attention; EEG; machine learning; neural networks; nonlinear models
国家哲学社会科学文献中心版权所有