中文版 | English
CSpace
Temporal Weighting Appearance-Aligned Network for Nighttime Video Retrieval
Ruan, Weijian1,2,3; Tao, Yiran4; Ruan, Linjun5; Shu, Xiujun6; Qiao, Yu1
2022
摘要Video-based person re-identification (ReID) aims at re-identifying video sequences of a specified person from videos captured by disjoint cameras. Existing datasets and works on this task all focus on daytime scenarios and cannot adapt well to the nighttime scenarios, which is also of significant importance for practical applications. In this letter, we contribute a new dataset for nighttime video-based ReID, termed NIVIR, which contains 800 identities with over 228,000 images. NIVIR contains video shots under various lighting conditions, different weathers, and complex scenarios, which is consistent with the real nighttime outdoor surveillance. Furthermore, we propose a temporal weighting appearance-aligned network (TWAN) for nighttime video-based ReID, which is composed of a correlation-based appearance-aligned module (CAM) and a temporal weighting module (TWM). Specifically, CAM is proposed to reconstruct the adjacent feature maps to guarantee the appearance alignment between the central frame and its adjacent frames. TWM is designed to evaluate the frame quality of a tracklet and generate temporal weights to enhance the video representation. Extensive experiments conducted on our new NIVIR dataset demonstrate that the proposed TWAN outperforms the state-of-the-art methods. We believe that our NIVIR dataset and the comprehensive attempts for solving the nighttime ReID problem will push forward the development of the ReID research community.
关键词Task analysis Cameras Feature extraction Convolution Surveillance Three-dimensional displays Meteorology Nighttime video retrieval new benchmark appearance alignment temporal weighting
DOI10.1109/LSP.2022.3207620
发表期刊IEEE SIGNAL PROCESSING LETTERS
ISSN1070-9908
卷号29页码:2008-2012
通讯作者Ruan, Linjun(linjun-ruan@foxmail.com)
收录类别SCI
WOS记录号WOS:000862369300002
语种英语