首页    期刊浏览 2024年10月07日 星期一
登录注册

文章基本信息

  • 标题:A multimodal dataset of spontaneous speech and movement production on object affordances
  • 本地全文:下载
  • 作者:Argiro Vatakis ; Katerina Pastra
  • 期刊名称:Scientific Data
  • 电子版ISSN:2052-4463
  • 出版年度:2016
  • 卷号:3
  • DOI:10.1038/sdata.2015.78
  • 语种:English
  • 出版社:Nature Publishing Group
  • 摘要:In the longstanding effort of defining object affordances, a number of resources have been developed on objects and associated knowledge. These resources, however, have limited potential for modeling and generalization mainly due to the restricted, stimulus-bound data collection methodologies adopted. To-date, therefore, there exists no resource that truly captures object affordances in a direct, multimodal, and naturalistic way. Here, we present the first such resource of ‘thinking aloud’, spontaneously-generated verbal and motoric data on object affordances. This resource was developed from the reports of 124 participants divided into three behavioural experiments with visuo-tactile stimulation, which were captured audiovisually from two camera-views (frontal/profile). This methodology allowed the acquisition of approximately 95 hours of video, audio, and text data covering: object-feature-action data (e.g., perceptual features, namings, functions), Exploratory Acts (haptic manipulation for feature acquisition/verification), gestures and demonstrations for object/feature/action description, and reasoning patterns (e.g., justifications, analogies) for attributing a given characterization. The wealth and content of the data make this corpus a one-of-a-kind resource for the study and modeling of object affordances.
国家哲学社会科学文献中心版权所有