航空航天虚拟装配培训情境下的情感交互设计

Emotional Interaction Design in Aerospace Virtual Assembly Training

中文关键词: 虚拟现实  航空航天  装配培训  交互设计  情感交互

英文关键词: s on Human Factors in Computing Systems, 2014.

中文摘要:

      目的 将虚拟现实和情感交互设计应用于航空航天装配培训场景，提高培训效率，改善培训体验。方法 通过调研多模态情感交互研究现状，构建航空航天虚拟装配培训情境下的情感交互模型，使用基于生理信号的情感识别、语音提示、高亮提示、视频指导等进行情感交互。以航空航天球阀的虚拟装配培训为例，构建具有情感交互的培训系统。通过用户手指上佩戴皮肤电导传感器收集的生理数据进行情感实时监测，根据情感不同提供语音提示、高亮提示、视频指导3种交互方案。结果 通过在虚拟环境中完成装配任务的效率，验证情感交互在虚拟装配培训系统中的有效性。实验结果表明，在航空航天虚拟装配培训场景下的情感化交互设计能够有效缩短培训时间，有助于培训用户体验目标和可用性目标的达成。结论 研究成果促进了生理信号、语音交互、视觉交互等多模态情感交互范式的构建，并验证了在航空航天虚拟装配培训应用中的有效性，具有广泛的学术意义和应用前景。

英文摘要:

      This work combines virtual reality with emotional interaction design to explore the applications on aerospace assembly training and to improve training efficiency and improve training experience. By investigating the research on multimodal emotional interaction, the emotional interaction model in aerospace virtual assembly training is built by using emotion recognition based on physiological signals, speech interaction, highlights and videos. Taking the virtual assembly training of aerospace ball valve as an example, an aerospace virtual assembly training system with emotional interaction is constructed. Real-time emotional monitoring is performed by using physiological data collected from GSR sensors worn on the user’s finger. Three interactive schemes are provided according to different emotions:speech interaction, highlights and video. The effectiveness of emotional interaction in virtual assembly training system is verified by the efficiency of completing assembly tasks in the virtual environment. The experimental results show that the emotional interaction design can effectively shorten the training time and greatly improve the training experience of users. This work can promote the research on the multimodal emotional interaction paradigm by combining physiological signals, speech interaction, visual interaction, etc. This work verifies the effectiveness of the emotional interaction in the application of aerospace virtual assembly training, which has wide academic meaning and application prospects.