Depth measurement and three-dimensional(3D)imaging under complex reflection and transmission conditions are challenging and even impossible for traditional structured light techniques,owing to the precondition of poin...Depth measurement and three-dimensional(3D)imaging under complex reflection and transmission conditions are challenging and even impossible for traditional structured light techniques,owing to the precondition of point-to-point triangulation.Despite recent progress in addressing this problem,there is still no efficient and general solution.Herein,a Fourier dual-slice projection with depth-constrained localization is presented to separate and utilize different illumination and reflection components efficiently,which can significantly decrease the number of projection patterns in each sequence from thousands to fifteen.Subsequently,multi-scale parallel single-pixel imaging(MS-PSI)is proposed based on the established and proven position-invariant theorem,which breaks the local regional assumption and enables dynamic 3D reconstruction.Our methodology successfully unveils unseen-before capabilities such as(1)accurate depth measurement under interreflection and subsurface scattering conditions,(2)dynamic measurement of the time-varying high-dynamic-range scene and through thin volumetric scattering media at a rate of 333 frames per second;(3)two-layer 3D imaging of the semitransparent surface and the object hidden behind it.The experimental results confirm that the proposed method paves the way for dynamic 3D reconstruction under complex optical field reflection and transmission conditions,benefiting imaging and sensing applications in advanced manufacturing,autonomous driving,and biomedical imaging.展开更多
光学遥感影像不可避免会受到云的遮挡,导致影像应用性降低,遥感影像去云是近些年来的热门研究方向。插值算法利用一张或多张影像计算相似像素来重建缺失像素,但是最佳相似像素的确定和地物突变的高精度重建仍存在挑战。文章利用多时相...光学遥感影像不可避免会受到云的遮挡,导致影像应用性降低,遥感影像去云是近些年来的热门研究方向。插值算法利用一张或多张影像计算相似像素来重建缺失像素,但是最佳相似像素的确定和地物突变的高精度重建仍存在挑战。文章利用多时相影像时间相关性关系、空间关系和光谱关系,提出了基于时空谱约束的相似像素插值(SPISTS)的去云方法。该方法利用时域和谱域特征选择相似像素,并通过空间、时间相关性和光谱关系约束求得影像缺失值,最后通过正则化项对预测进行偏差改正。在3个不同地区进行实验并与加权线性回归(weighted linear regression,WLR)、时空加权回归(spatio-temporal weighted regression,STWR)、改进邻域相似像素插值(modified neighborhood similar pixel interpolation,MNSPI)结果进行比较。实验结果表明,该方法精度较高,能够减弱辐射差异带来的影响。展开更多
By studying the traditional spectral reflectance reconstruction method, spectral reflectance and the relative spectral power distribution of a lighting source are sparsely decomposed, and the orthogonal property of th...By studying the traditional spectral reflectance reconstruction method, spectral reflectance and the relative spectral power distribution of a lighting source are sparsely decomposed, and the orthogonal property of the principal component orthogonal basis is used to eliminate basis; then spectral reflectance data are obtained by solving a sparse coefficient. After theoretical analysis, the spectral reflectance reconstruction based on sparse prior knowledge of the principal component orthogonal basis by a single-pixel detector is carried out by software simulation and experiment. It can reduce the complexity and cost of the system, and has certain significance for the improvement of multispectral image acquisition technology.展开更多
基金supported by the National Natural Science Foundation of China(62205226,62075143)the National Postdoctoral Program for Innovative Talents of China(BX2021199)+2 种基金the General Financial Grant from the China Postdoctoral Science Foundation(2022M722290)the Key Science and Technology Research and Development Program of Jiangxi Province(20224AAC01011)the Fundamental Research Funds for Central Universities(2022SCU12010).
文摘Depth measurement and three-dimensional(3D)imaging under complex reflection and transmission conditions are challenging and even impossible for traditional structured light techniques,owing to the precondition of point-to-point triangulation.Despite recent progress in addressing this problem,there is still no efficient and general solution.Herein,a Fourier dual-slice projection with depth-constrained localization is presented to separate and utilize different illumination and reflection components efficiently,which can significantly decrease the number of projection patterns in each sequence from thousands to fifteen.Subsequently,multi-scale parallel single-pixel imaging(MS-PSI)is proposed based on the established and proven position-invariant theorem,which breaks the local regional assumption and enables dynamic 3D reconstruction.Our methodology successfully unveils unseen-before capabilities such as(1)accurate depth measurement under interreflection and subsurface scattering conditions,(2)dynamic measurement of the time-varying high-dynamic-range scene and through thin volumetric scattering media at a rate of 333 frames per second;(3)two-layer 3D imaging of the semitransparent surface and the object hidden behind it.The experimental results confirm that the proposed method paves the way for dynamic 3D reconstruction under complex optical field reflection and transmission conditions,benefiting imaging and sensing applications in advanced manufacturing,autonomous driving,and biomedical imaging.
文摘光学遥感影像不可避免会受到云的遮挡,导致影像应用性降低,遥感影像去云是近些年来的热门研究方向。插值算法利用一张或多张影像计算相似像素来重建缺失像素,但是最佳相似像素的确定和地物突变的高精度重建仍存在挑战。文章利用多时相影像时间相关性关系、空间关系和光谱关系,提出了基于时空谱约束的相似像素插值(SPISTS)的去云方法。该方法利用时域和谱域特征选择相似像素,并通过空间、时间相关性和光谱关系约束求得影像缺失值,最后通过正则化项对预测进行偏差改正。在3个不同地区进行实验并与加权线性回归(weighted linear regression,WLR)、时空加权回归(spatio-temporal weighted regression,STWR)、改进邻域相似像素插值(modified neighborhood similar pixel interpolation,MNSPI)结果进行比较。实验结果表明,该方法精度较高,能够减弱辐射差异带来的影响。
基金supported by the National Natural Science Foundation of China (Grant No.61405115)the Natural Science Foundation of Shanghai (Grant No.14ZR1428400)+1 种基金the Innovation Project of Shanghai Municipal Education Commission (Grant No.14YZ099)National Basic Research Program of China (973 Program) (Grant No.2015CB352004)
文摘By studying the traditional spectral reflectance reconstruction method, spectral reflectance and the relative spectral power distribution of a lighting source are sparsely decomposed, and the orthogonal property of the principal component orthogonal basis is used to eliminate basis; then spectral reflectance data are obtained by solving a sparse coefficient. After theoretical analysis, the spectral reflectance reconstruction based on sparse prior knowledge of the principal component orthogonal basis by a single-pixel detector is carried out by software simulation and experiment. It can reduce the complexity and cost of the system, and has certain significance for the improvement of multispectral image acquisition technology.
