摘要
为突破综采工作面数据驱动实时监控技术瓶颈,进一步满足对综采工作面协同运行状态的深度感知,以虚拟现实(Virtual Reality, VR)监控技术及成果为基础,以HoloLens2增强现实(Augmented Reality, AR)头显为主要开发设备,结合工业互联网、云技术、数字孪生(Digital Twin, DT)等先进手段,进行AR/VR融合驱动的综采工作面智能监控关键技术研究与实践,充分利用AR技术的特性弥补VR监控与真实场景有割裂感、监测数据来源较为单一的缺陷,使综采工作面智能监控体系得到完善与扩充。提出3种关键技术,并对各关键技术的具体解决方案进行剖析,具体包括:(1)构建了通用高效可扩展端云协同异步网络框架,基于该框架研究了多终端协同工作关键技术,实现了空间虚实融合全息辅助标注功能。该技术可为综采工作面智能监控全过程中的多人协作提供便利;(2)将基于稀疏匹配的识别跟踪方法与基于AR标识的识别跟踪方法相结合,实现了对综采工作面全综采装备的识别跟踪,为综采工作面的AR监测与控制提供了先决条件;(3)在由物理综采工作面、云服务器、数字综采工作面3者构成的数字孪生闭环上,进行多传感器与视觉融合的综采装备位姿监测与运行状态识别,并通过AR交互手段完成了对物理综采工作面的反向控制。在实验室环境下展开测试验证,试验表明,系统数据传输压力小,延迟低,操作流畅无卡顿,在保留VR监控已有优势的基础上进一步提升了沉浸感、便捷性与虚实融合程度,具备单人或多人协作监测综采工作面运行状态并进行反向控制的能力。
In order to break through the bottleneck of data-driven real-time monitoring and control technology and satisfy the in-depth perception of the collaborative operation for a fully mechanized coal-mining face, a Virtual Reality(VR) monitoring and control technology and its research achievements are taken as the technical foundation. Also, the HoloLens2 Augmented Reality(AR) headset is taken as a main development device. Advanced methods such as industrial Internet, cloud technology, and Digital Twin(DT) are combined to carry out the research and practice of intelligent monitoring and control technology for a fully mechanized coal-mining face driven by AR/VR. The characteristics of AR technology are fully utilized to make up for the sense of separation between VR monitoring and control and real scenes, and to compensate for the shortcomings of a relatively single source of monitoring data, so that the intelligent monitoring and control system for fully mechanized coal-mining faces can be improved and expanded. Three key technologies are proposed and the specific solutions of each technology are analyzed. The details are as follows:(1) A universal, efficient, scalable, and asynchronous network framework for client-cloud collaboration is constructed. Based on this framework, the key technologies of multi-terminal collaborative work are studied, and the function of spatial holographic mark of the fusion of virtual and reality is realized. This technology can provide convenience for multi-person collaboration in the whole process of intelligent monitoring and control of fully mechanized coal-mining face.(2) The recognition and tracking method based on sparse matching is combined with the recognition and tracking method based on AR identification, so that the recognition and tracking of fully mechanized coal-mining equipment in fully mechanized coal-mining face is realized, which provides a prerequisite for the AR monitoring and control of fully mechanized coal-mining face.(3) In the DT closed-loop composed of physical f
作者
王学文
刘曙光
王雪松
谢嘉成
王彬彬
王振威
WANG Xuewen;LIU Shuguang;WANG Xuesong;XIE Jiacheng;WANG Binbin;WANG Zhenwei(College of Mechanical and Vehicle Engineering,Taiyuan University of Technology,Taiyuan030024,China;Shanxi Key Laboratory of Fully Mechanized Coal Mining Equipment,Taiyuan University of Technolgy,Taiyuan030024,China;State Key Laboratory of Mining Equipment and Intelligent Manufactur-ing,Taiyuan030024,China;Postdoctoral Science Research Workstation,Taiyuan Mining Machinery Group Co.,Ltd.,Taiyuan030024,China)
出处
《煤炭学报》
EI
CAS
CSCD
北大核心
2022年第2期969-985,共17页
Journal of China Coal Society
基金
国家自然科学基金资助项目(52004174)
山西省重点研发计划资助项目(201903D121141)
山西省“1331工程”资助项目。
关键词
综采工作面
增强现实
虚拟现实
数字孪生
端云协同
智能监控
fully mechanized coal-mining face
Augmented Reality
Virtual Reality
Digital Twin
client-cloud collaboration
intelligent monitoring and control
