摘要
为了使用户出行便利,尤其对于眼障人士,以语义分析和机器视觉技术为基础,设计了一款多模交互智能终端。整个系统在硬件上主要以树莓派为核心处理器,配合语音处理采集板、摄像头、扬声器、GPS定位模块来实现。软件上采用模块化插件的方式进行设计,综合运用了网络爬虫、语音识别与合成、语义理解、智能对话、天气新闻播报、障碍物检测、路线规划等技术。该系统具有完整的前后端设计,前端提供Web接入、聊天信息查看、障碍物实时查看和地图查看,后端提供后台管理。实际测试表明,该系统具有良好的稳定性和实用性,对于服务视障人士的日常出行具有较强的现实意义。
In order to improve the user’s travel convenience,especially for the visual impaired person,a multi-mode interactive intelligent terminal is designed based on semantic analysis and machine vision technology.The whole system is implemented in hardware,mainly with the Raspberry Pi as the core processor,together with a speech processing acquisition board,camera,speaker and GPS positioning module.The software is designed by means of modular plug-ins,and makes comprehensive use of web crawler technology,speech recognition and synthesis technology,semantic understanding,intelligent dialogue,weather news broadcast,obstacle detection,route planning and so on.The system has a complete front-end and back-end design,with the front-end providing Web access,chat information viewing,real-time obstacle viewing and map viewing,and the back-end providing back-end management.The result shows that the system has good stability,accuracy and practicality,which is of strong practical significance to serve people’s daily travel.
作者
阚保强
余容森
KAN Baoqiang;YU Rongsen(Concord University College,Fujian Normal University,Fuzhou 350003,China)
出处
《长春师范大学学报》
2024年第2期84-91,共8页
Journal of Changchun Normal University
基金
福建省教师教育科研项目“面向复杂环境的移动机器人路径规划理论与仿真研究”(JAT191117)
福建师范大学协和学院科研基金资助项目“移动智能体辅助的可靠组网技术”(KY20200202)
泉州市科技计划项目“面向复杂环境下的多智能服务机器人系统的研究”(2017T009)。
关键词
深度学习
目标识别
语音处理
智能终端
deep learning
target recognition
speech processing
intelligent terminals
