Transformers,the dominant architecture for natural language processing,have also recently attracted much attention from computational visual media researchers due to their capacity for long-range representation and hi...Transformers,the dominant architecture for natural language processing,have also recently attracted much attention from computational visual media researchers due to their capacity for long-range representation and high performance.Transformers are sequence-to-sequence models,which use a selfattention mechanism rather than the RNN sequential structure.Thus,such models can be trained in parallel and can represent global information.This study comprehensively surveys recent visual transformer works.We categorize them according to task scenario:backbone design,high-level vision,low-level vision and generation,and multimodal learning.Their key ideas are also analyzed.Differing from previous surveys,we mainly focus on visual transformer methods in low-level vision and generation.The latest works on backbone design are also reviewed in detail.For ease of understanding,we precisely describe the main contributions of the latest works in the form of tables.As well as giving quantitative comparisons,we also present image results for low-level vision and generation tasks.Computational costs and source code links for various important works are also given in this survey to assist further development.展开更多
针对手指静脉图像中存在的弱边缘、灰度不均匀以及低对比度等现象,提出一种结合偶对称Gabor滤波与水平集思想的分割算法,并应用于手指静脉图像的分割。首先,使用偶对称Gabor滤波算法,对手指静脉图像从8个不同的方向分别进行滤波运算;然...针对手指静脉图像中存在的弱边缘、灰度不均匀以及低对比度等现象,提出一种结合偶对称Gabor滤波与水平集思想的分割算法,并应用于手指静脉图像的分割。首先,使用偶对称Gabor滤波算法,对手指静脉图像从8个不同的方向分别进行滤波运算;然后,根据8个方向上的滤波结果进行图像重建,得到目标与背景灰度对比度显著提高的图像;最后,应用结合局部与全局信息的水平集方法对手指静脉图像进行分割。将所提算法与Li等水平集算法(LI C,HUANG R,DING Z,et al.A variational level set approach to segmentation and bias correction of images with intensity inhomogeneity.MICCAI'08:Proceedings of the 11th International Conference on Medical Image Computing and Computer-Assisted Intervention,Part II.Berlin:Springer,2008:1083-1091)、Legendre水平集(L2S)算法相比,所提算法在分割精度评价标准面积差异(AD)百分比上分别降低了1.116%、0.370%,相对差异度(RDD)分别降低了1.661%、1.379%。实验结果表明,与传统只考虑局部信息或全局信息的水平集图像分割算法相比,所提算法能取得更高的分割精度。展开更多
基金supported by National Key R&D Program of China under Grant No.2020AAA0106200National Natural Science Foundation of China under Grant Nos.61832016 and U20B2070.
文摘Transformers,the dominant architecture for natural language processing,have also recently attracted much attention from computational visual media researchers due to their capacity for long-range representation and high performance.Transformers are sequence-to-sequence models,which use a selfattention mechanism rather than the RNN sequential structure.Thus,such models can be trained in parallel and can represent global information.This study comprehensively surveys recent visual transformer works.We categorize them according to task scenario:backbone design,high-level vision,low-level vision and generation,and multimodal learning.Their key ideas are also analyzed.Differing from previous surveys,we mainly focus on visual transformer methods in low-level vision and generation.The latest works on backbone design are also reviewed in detail.For ease of understanding,we precisely describe the main contributions of the latest works in the form of tables.As well as giving quantitative comparisons,we also present image results for low-level vision and generation tasks.Computational costs and source code links for various important works are also given in this survey to assist further development.
文摘针对手指静脉图像中存在的弱边缘、灰度不均匀以及低对比度等现象,提出一种结合偶对称Gabor滤波与水平集思想的分割算法,并应用于手指静脉图像的分割。首先,使用偶对称Gabor滤波算法,对手指静脉图像从8个不同的方向分别进行滤波运算;然后,根据8个方向上的滤波结果进行图像重建,得到目标与背景灰度对比度显著提高的图像;最后,应用结合局部与全局信息的水平集方法对手指静脉图像进行分割。将所提算法与Li等水平集算法(LI C,HUANG R,DING Z,et al.A variational level set approach to segmentation and bias correction of images with intensity inhomogeneity.MICCAI'08:Proceedings of the 11th International Conference on Medical Image Computing and Computer-Assisted Intervention,Part II.Berlin:Springer,2008:1083-1091)、Legendre水平集(L2S)算法相比,所提算法在分割精度评价标准面积差异(AD)百分比上分别降低了1.116%、0.370%,相对差异度(RDD)分别降低了1.661%、1.379%。实验结果表明,与传统只考虑局部信息或全局信息的水平集图像分割算法相比,所提算法能取得更高的分割精度。
