To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of th...To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.展开更多
Holograms provide a characteristic manner to display and convey information, and have been improved to provide better user interactions Holographic interactions are important as they improve user interactions with vir...Holograms provide a characteristic manner to display and convey information, and have been improved to provide better user interactions Holographic interactions are important as they improve user interactions with virtual objects. Gesture interaction is a recent research topic, as it allows users to use their bare hands to directly interact with the hologram. However, it remains unclear whether real hand gestures are well suited for hologram applications. Therefore, we discuss the development process and implementation of three-dimensional object manipulation using natural hand gestures in a hologram. We describe the design and development process for hologram applications and its integration with real hand gesture interactions as initial findings. Experimental results from Nasa TLX form are discussed. Based on the findings, we actualize the user interactions in the hologram.展开更多
Space object recognition plays an important role in spatial exploitation and surveillance, followed by two main problems： lacking of data and drastic changes in viewpoints. In this article, firstly, we build a three-...Space object recognition plays an important role in spatial exploitation and surveillance, followed by two main problems： lacking of data and drastic changes in viewpoints. In this article, firstly, we build a three-dimensional （3D） satellites dataset named BUAA Satellite Image Dataset （BUAA-SID 1.0） to supply data for 3D space object research. Then, based on the dataset, we propose to recognize full-viewpoint 3D space objects based on kernel locality preserving projections （KLPP）. To obtain more accurate and separable description of the objects, firstly, we build feature vectors employing moment invariants, Fourier descriptors, region covariance and histogram of oriented gradients. Then, we map the features into kernel space followed by dimensionality reduction using KLPP to obtain the submanifold of the features. At last, k-nearest neighbor （kNN） is used to accomplish the classification. Experimental results show that the proposed approach is more appropriate for space object recognition mainly considering changes of viewpoints. Encouraging recognition rate could be obtained based on images in BUAA-SID 1.0, and the highest recognition result could achieve 95.87%.展开更多
基金The National Natural Science Foundation of China(No.51875332)the Capacity Building Projects of Some Local Universities of Shanghai Science and Technology Commission(No.18040501600).
文摘To improve the human-physical-virtual coordination and integration of the digital twin workshop,3D visual monitoring and human-computer interaction of the digital twin workshop was studied.First,a novel 6D model of the 3D visualization interactive system for digital twin workshops is proposed.As the traditional 5D digital twin model ignores the importance of human-computer interaction,a new dimension of the user terminal was added.A hierarchical real-time data-driven mapping model for the workshop production process is then proposed.Moreover,a real-time data acquisition method for the industrial Internet of things is proposed based on OPC UA(object linking and embedding for process control unified architecture).Based on the 6D model of the system,the process of creating a 3D visualization virtual environment based on virtual reality is introduced,in addition to a data-driven process based on the data management cloud platform.Finally,the 6D model of the system was confirmed using the blade rotor test workshop as the object,and a 3D visualization interactive system is developed.The results show that the system is more transparent,real-time,data-driven and more efficient,as well as promotes the coordination and integration of human-physical-virtual,which has practical significance for developing digital twin workshops.
文摘Holograms provide a characteristic manner to display and convey information, and have been improved to provide better user interactions Holographic interactions are important as they improve user interactions with virtual objects. Gesture interaction is a recent research topic, as it allows users to use their bare hands to directly interact with the hologram. However, it remains unclear whether real hand gestures are well suited for hologram applications. Therefore, we discuss the development process and implementation of three-dimensional object manipulation using natural hand gestures in a hologram. We describe the design and development process for hologram applications and its integration with real hand gesture interactions as initial findings. Experimental results from Nasa TLX form are discussed. Based on the findings, we actualize the user interactions in the hologram.
基金National Natural Science Foundation of China (60776793,60802043)National Basic Research Program of China (2010CB327900)
文摘Space object recognition plays an important role in spatial exploitation and surveillance, followed by two main problems： lacking of data and drastic changes in viewpoints. In this article, firstly, we build a three-dimensional （3D） satellites dataset named BUAA Satellite Image Dataset （BUAA-SID 1.0） to supply data for 3D space object research. Then, based on the dataset, we propose to recognize full-viewpoint 3D space objects based on kernel locality preserving projections （KLPP）. To obtain more accurate and separable description of the objects, firstly, we build feature vectors employing moment invariants, Fourier descriptors, region covariance and histogram of oriented gradients. Then, we map the features into kernel space followed by dimensionality reduction using KLPP to obtain the submanifold of the features. At last, k-nearest neighbor （kNN） is used to accomplish the classification. Experimental results show that the proposed approach is more appropriate for space object recognition mainly considering changes of viewpoints. Encouraging recognition rate could be obtained based on images in BUAA-SID 1.0, and the highest recognition result could achieve 95.87%.
