摘要
为拓展设计船舶航行中多模态人机交互模式,促进船舶航行所用导航系统的智能化发展,研究多模态人机交互系统在船舶航行中的应用,设计一种船舶航行使用的多模态人机交互系统。船员可在船舶航行时,以语音交互、手势交互这种多模态交互模式,完成指令输入,无需人工手动操舵。实验测试结果验证,多模态人机交互模式使用后,船舶航行时,控制指令通过语音与手势便可有效传达,船舶航行控制可靠,且无须手动控制舵机,可实现船舶航行智能化交互控制。
To expand the design of multimodal human-machine interaction modes in ship navigation,promote the intelligent development of navigation systems used in ship navigation,study the application of multimodal human-machine interaction systems in ship navigation,and design a multimodal human-machine interaction system for ship navigation.Crew members can complete command input through multimodal interaction modes such as voice interaction and gesture interaction during the shearing bed navigation,without the need for manual steering.The experimental test results verify that after using the multimodal human-machine interaction mode,the control instructions can be effectively conveyed through voice and gestures during ship navigation.The ship navigation control is reliable and does not require manual control of the servo,achieving intelligent interactive control of ship navigation.
作者
王卉
高家骥
曹福存
WANG Hui;GAO Jia-ji;CAO Fu-cun(Dalian Polytechnic University,Dalian 116034,China)
出处
《舰船科学技术》
北大核心
2024年第3期157-160,共4页
Ship Science and Technology
基金
辽宁省教育厅高等学校基本科研项目(J202154)
辽宁省社科规划基金项目(L22BJY009)。
关键词
多模态
人机交互
船舶航行
语音交互
手势交互
隐马尔科夫模型
multimodal
human computer interaction
ship navigation
voice interaction
gesture interaction
hidden Markov model
