Reconstruction of man-made scenes from multi-view images is an important problem in computer vision and computer graphics.Observing that manmade scenes are usually composed of planar surfaces,we encode plane shape pri...Reconstruction of man-made scenes from multi-view images is an important problem in computer vision and computer graphics.Observing that manmade scenes are usually composed of planar surfaces,we encode plane shape prior in reconstructing man-made scenes.Recent approaches for single-view reconstruction employ multi-branch neural networks to simultaneously segment planes and recover 3D plane parameters.However,the scale of available annotated data heavily limits the generalizability and accuracy of these supervised methods.In this paper,we propose multiview regularization to enhance the capability of piecewise planar reconstruction during the training phase,without demanding extra annotated data.Our multi-view regularization enables the consistency among multiple views by making the feature embedding more robust against view change and lighting variations.Thus,the neural network trained by multi-view regularization performs better on a wide range of views and lightings in the test phase.Based on more consistent prediction results,we merge the recovered models from multiple views to reconstruct scenes.Our approach achieves state-of-the-art reconstruction performance compared to previous approaches on the public Scan Net dataset.展开更多
The consistency of the CIMS multi-view model is a complicated problem which plays an important role inthe CIMS life cycle. Based on the function-oriented multi-view modeling approach, an object-oriented integratedmult...The consistency of the CIMS multi-view model is a complicated problem which plays an important role inthe CIMS life cycle. Based on the function-oriented multi-view modeling approach, an object-oriented integratedmulti-view modeling approach was further provided.CIM system is composed of several objects where each objecthas a multi-view description.The four most important view-points: function, information, resource and dynamic viewpoint were chosen to provide conceptual model of the object-oriented integrated multi-view modeling in CIMS using a system integration approach展开更多
基金supported by the National Key R&D Program of China under Grant 2017YFB1002202the National Natural Science Foundation of China(NSFC)under Grant 61632006the Fundamental Research Funds for the Central Universities under Grants WK3490000003 and WK2100100030.
文摘Reconstruction of man-made scenes from multi-view images is an important problem in computer vision and computer graphics.Observing that manmade scenes are usually composed of planar surfaces,we encode plane shape prior in reconstructing man-made scenes.Recent approaches for single-view reconstruction employ multi-branch neural networks to simultaneously segment planes and recover 3D plane parameters.However,the scale of available annotated data heavily limits the generalizability and accuracy of these supervised methods.In this paper,we propose multiview regularization to enhance the capability of piecewise planar reconstruction during the training phase,without demanding extra annotated data.Our multi-view regularization enables the consistency among multiple views by making the feature embedding more robust against view change and lighting variations.Thus,the neural network trained by multi-view regularization performs better on a wide range of views and lightings in the test phase.Based on more consistent prediction results,we merge the recovered models from multiple views to reconstruct scenes.Our approach achieves state-of-the-art reconstruction performance compared to previous approaches on the public Scan Net dataset.
文摘The consistency of the CIMS multi-view model is a complicated problem which plays an important role inthe CIMS life cycle. Based on the function-oriented multi-view modeling approach, an object-oriented integratedmulti-view modeling approach was further provided.CIM system is composed of several objects where each objecthas a multi-view description.The four most important view-points: function, information, resource and dynamic viewpoint were chosen to provide conceptual model of the object-oriented integrated multi-view modeling in CIMS using a system integration approach
