摘要
行人的空间尺度差异是影响行人检测性能的主要瓶颈之一。针对这一问题,提出了跨尺度特征聚合网络(TS-FAN)有效检测多尺度行人。首先,鉴于不同尺度空间呈现出的特征差异性,引入一种基于多路径区域建议网络(RPN)的尺度补偿策略,其在多尺度卷积特征层上自适应地生成一系列与其感受野大小相对应的候选目标尺度集。其次,考虑到不同层次卷积特征在视觉语义上的互补性,提出了跨尺度特征聚合网络模块,其通过横向连接、自上而下路径和由底向上路径,有效地聚合具有语义鲁棒性的高层特征和具有精确定位信息的低层特征,实现对卷积层特征的增强表示。最后,联合多路径RPN尺度补偿策略和跨尺度特征聚合网络模块,构建了一种尺度自适应感知的多尺度行人检测网络。实验结果表明,所提方法与当前一流的行人检测方法TLL-TFA相比,在整个Caltech公开测试数据集上(All:行人高度大于20像素)的行人漏检率降低到26.21%(提高了11.94%),尤其对于Caltech小尺寸行人子数据集上(Far:行人高度在20~30像素之间)的行人漏检率降低到47.30%(提高了12.79%),同时在尺度变化剧烈的ETH数据集上的效果也取得显著提升。
Space scale variation of pedestrian instance is one of the main bottlenecks affecting pedestrian detection performance.For this issue,a Trans-Scale Feature Aggregation Network(TS-FAN)is proposed to effectively deal with multi-scale pedestrian detection.First,in view of the feature differences among different scale spaces,we introduce a scale compensation strategy based on multi-path Region Proposal Network(RPN).According to the effectiveness of the convolutional feature layers of different scales,a series of candidate regional scale sets are generated adaptively from the feature maps corresponding to the size of the receptive field.Second,considering the semantic complementarity of convolutional features at different levels,a trans-scale feature aggregation module is proposed to effectively aggregate with semantic robustness highllevel features and with accurate location information of low-level features and achieve enhanced representation ability of convolutional features,by aggregating horizontal connection,top-down path and bottom-up path.Finally,combining the multi-path RPN scale compensation strategy and trans-scale feature aggregation module,we construct a multi-scale pedestrian detection network by adaptive scale perception.The experimental results show that,compared with the state-of-the-art method TLL-TFA,the log-average miss rate of pedestrian detection on widely-used Caltech dataset is reduced to 26.21%(increased by 11.94%)for whole-scale pedestrians(above 20 pixel in height),and 47.30%(increased by 12.79%)for small-scale pedestrian(between 20-30 pixels in height).And the similar improvement is also achieved on ETH dataset with drastic scale variation.
作者
曹帅
张晓伟
马健伟
CAO Shuai;ZHANG Xiaowei;MA Jianwei(College of Computer Science and Technology,Qingdao University,Qingdao 266071,China)
出处
《北京航空航天大学学报》
EI
CAS
CSCD
北大核心
2020年第9期1786-1796,共11页
Journal of Beijing University of Aeronautics and Astronautics
基金
国家自然科学基金(61902204)
山东省自然科学基金(ZR2019BF028)。
关键词
行人检测
尺度感知
特征金字塔
特征聚合
非极大值抑制
pedestrian detection
scale perception
feature pyramid
feature aggregation
non-maximum suppression
