Infrared pedestrian tracking network based on convolution model and transformer model fusion

Guiqiang Zhang; Xinyi Wang; Xingxing She

doi:10.1117/12.2686716

28 July 2023 Infrared pedestrian tracking network based on convolution model and transformer model fusion

Guiqiang Zhang, Xinyi Wang, Xingxing She

Proceedings Volume 12756, 3rd International Conference on Applied Mathematics, Modelling, and Intelligent Computing (CAMMIC 2023); 1275650 (2023) https://doi.org/10.1117/12.2686716
Event: 2023 3rd International Conference on Applied Mathematics, Modelling and Intelligent Computing (CAMMIC 2023), 2023, Tangshan, China

Abstract

Camera surveillance plays an important role in maintaining the stability and safety of the social and public environment, and there are further requirements for the role of camera surveillance in building a smart city. This paper proposes a convolutional neural network based on the combination of the convolution module and the Transformer module. The network is applied to the tracking of pedestrian targets in infrared surveillance cameras to fill the shortcomings of surveillance cameras in the night environment. In this paper, the local features of the convolution module and the global features of the Transformer are combined into a comprehensive feature map. The feature information is used to solve the problem of less target feature information in infrared images, and the advantages of codec network structure design are used to ensure effective target features. At the same time, considering the embedding and portability of the network model, this paper adopts the method of grouping shared convolution kernels and Transformer nested segmentation in the design of the convolution module and the Transformer module, so as to achieve the purpose of light weight. After several sets of control experiments, the network designed in this paper has a certain improvement in tracking speed and tracking performance, and effectively solves the problem that infrared weak and small targets are not easy to track.

Citation Download Citation

Guiqiang Zhang, Xinyi Wang, and Xingxing She "Infrared pedestrian tracking network based on convolution model and transformer model fusion", Proc. SPIE 12756, 3rd International Conference on Applied Mathematics, Modelling, and Intelligent Computing (CAMMIC 2023), 1275650 (28 July 2023); https://doi.org/10.1117/12.2686716

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Convolution

Transformers

Infrared radiation

Infrared imaging

Feature extraction

Target detection

Network architectures

Show All Keywords

Keywords/Phrases

Search In:

Publication Years