出版社:The Japanese Society for Artificial Intelligence
摘要:It is necessary to establish a methodology of developing multimodal interactive systems as the spread of various input and output devices. Previous MMI (MultiModal Interaction) description language used a state transition model for defining interaction and that has low maintainability and extensibility. In this paper, we design and implement a new MMI description language named MrailsScript from the software engineering point of view. MrailsScript consists of the datamodel definition that can be inherited from semantic web class definition, and the annotations of interaction task and dialogue initiative. By expanding the existing web application development framework, our Mrails framework can automatically generate prototype codes of MMI application which is based on MVC (Model-View-Controller) model. We also developed a helper application of MMI system, MrailsBuilder, which assists coding of MrailsScript and realizes multilingual capability of the target MMI system.
关键词:multimodal interaction ; interactive system development ; semantic web