Image fusion for multimodality image via domain transfer and nonrigid transformation

Yicheng Yang; Huabing Zhou

doi:10.1117/12.2541803

14 February 2020 Image fusion for multimodality image via domain transfer and nonrigid transformation

Yicheng Yang, Huabing Zhou

Proceedings Volume 11430, MIPPR 2019: Pattern Recognition and Computer Vision; 114301T (2020) https://doi.org/10.1117/12.2541803
Event: Eleventh International Symposium on Multispectral Image Processing and Pattern Recognition (MIPPR2019), 2019, Wuhan, China

Abstract

Infrared images can distinguish targets from their backgrounds on the basis of difference in thermal radiation, which works well at all day/night time and under all weather conditions. By contrast, visible images can provide texture details with high spatial resolution and definition in a manner consistent with the human visual system. We addressed the multimodality image fusion problem through three steps. Firstly, Domain transfer technique is introduced to transfer an image from one domain to another. For example, from visible image to infrared image. It can capture content characteristics of one image collection and figure out how these characteristics could be translated into the other image collection, all in the absence of any paired training examples. Secondly, we employ the nonrigid transformation method to match the domain transferred image and the target image, let the images pairs align in pixel level. Then we focus on fusion the domain transferred and spatial transformed image with the target image. Through translation and transformation, we simplify the fusion problem into a simple combination.

Citation Download Citation

Yicheng Yang and Huabing Zhou "Image fusion for multimodality image via domain transfer and nonrigid transformation", Proc. SPIE 11430, MIPPR 2019: Pattern Recognition and Computer Vision, 114301T (14 February 2020); https://doi.org/10.1117/12.2541803

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available