The metaverse is a visual world that blends the physical world and digital world.At present,the development of the metaverse is still in the early stage,and there lacks a framework for the visual construction and expl...The metaverse is a visual world that blends the physical world and digital world.At present,the development of the metaverse is still in the early stage,and there lacks a framework for the visual construction and exploration of the metaverse.In this paper,we propose a framework that summarizes how graphics,interaction,and visualization techniques support the visual construction of the metaverse and user-centric exploration.We introduce three kinds of visual elements that compose the metaverse and the two graphical construction methods in a pipeline.We propose a taxonomy of interaction technologies based on interaction tasks,user actions,feedback and various sensory channels,and a taxonomy of visualization techniques that assist user awareness.Current potential applications and future opportunities are discussed in the context of visual construction and exploration of the metaverse.We hope this paper can provide a stepping stone for further research in the area of graphics,interaction and visualization in the metaverse.展开更多
Virtual reality(VR) training technology in the mining industry is a new field of research and utilization.The successful application of VR training system is critical to mine safety and production. Through the statist...Virtual reality(VR) training technology in the mining industry is a new field of research and utilization.The successful application of VR training system is critical to mine safety and production. Through the statistics of the current research and applications of VR training systems in mining industry, all the input/output devices are classified. Based on the classifications of the input/output devices that are used in the VR system, the current VR training systems for the mining industry could be divided into three types: screen-based general type, projector-based customized type, and head-mounted display(HMD)-based intuitive type. By employing a VR headset, a smartphone and a leap motion device, an HMDbased intuitive type VR training system prototype for drilling in underground mines has been developed.Ten trainees tried both the HMD-based intuitive system and the screen-based general control system to compare the experiences and training effects. The results show that the HMD-based system can give a much better user experience and is easy to use. Three of the five components of a VR training system,namely, the user, the tasks, and software and database should be given more attention in future research.With more available technologies of input and output devices, VR engines, and system software, the VR training system will eventually yield much better training results, and will play a more important role in as a training tool for mine safety.展开更多
基金Shanghai Municipal Science and Technology Major Project(No.2018SHZDZX01,2021SHZDZX0103)and ZJLab.This work is also supported by Shanghai Sailing Program No.21YF1402900,Science and Technology Commission of Shanghai Municipality(Grant No.21ZR1403300)+1 种基金by Open Research Fund of Beijing Key Laboratory of Big Data Technology for Food Safety(Project No.BTBD-2021KF03)Beijing Technology and Business University and NSFC No.61972010.
文摘The metaverse is a visual world that blends the physical world and digital world.At present,the development of the metaverse is still in the early stage,and there lacks a framework for the visual construction and exploration of the metaverse.In this paper,we propose a framework that summarizes how graphics,interaction,and visualization techniques support the visual construction of the metaverse and user-centric exploration.We introduce three kinds of visual elements that compose the metaverse and the two graphical construction methods in a pipeline.We propose a taxonomy of interaction technologies based on interaction tasks,user actions,feedback and various sensory channels,and a taxonomy of visualization techniques that assist user awareness.Current potential applications and future opportunities are discussed in the context of visual construction and exploration of the metaverse.We hope this paper can provide a stepping stone for further research in the area of graphics,interaction and visualization in the metaverse.
基金funded by the ‘‘twelfth five” National Key Technology Research and Development Program of the Ministry of Science and Technology of China (Grant No. 2015BAK10B00)
文摘Virtual reality(VR) training technology in the mining industry is a new field of research and utilization.The successful application of VR training system is critical to mine safety and production. Through the statistics of the current research and applications of VR training systems in mining industry, all the input/output devices are classified. Based on the classifications of the input/output devices that are used in the VR system, the current VR training systems for the mining industry could be divided into three types: screen-based general type, projector-based customized type, and head-mounted display(HMD)-based intuitive type. By employing a VR headset, a smartphone and a leap motion device, an HMDbased intuitive type VR training system prototype for drilling in underground mines has been developed.Ten trainees tried both the HMD-based intuitive system and the screen-based general control system to compare the experiences and training effects. The results show that the HMD-based system can give a much better user experience and is easy to use. Three of the five components of a VR training system,namely, the user, the tasks, and software and database should be given more attention in future research.With more available technologies of input and output devices, VR engines, and system software, the VR training system will eventually yield much better training results, and will play a more important role in as a training tool for mine safety.
