Novel image fusion quality metrics based on sensor models and image statistics

Forrest A. Smith; Srikant Chari; Carl E. Halford; Jonathan Fanning; Joseph P. Reynolds

doi:10.1117/12.833367

1 May 2009 Novel image fusion quality metrics based on sensor models and image statistics

Forrest A. Smith, Srikant Chari, Carl E. Halford, Jonathan Fanning, Joseph P. Reynolds

Proceedings Volume 7300, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XX; 730013 (2009) https://doi.org/10.1117/12.833367
Event: SPIE Defense, Security, and Sensing, 2009, Orlando, Florida, United States

Abstract

This paper presents progress in image fusion modeling. One fusion quality metric based on the Targeting Task performance (TTP) metric and another based on entropy are presented. A human perception test was performed with fused imagery to determine effectiveness of the metrics in predicting image fusion quality. Both fusion metrics first establish which of two source images is ideal in a particular spatial frequency pass band. The fused output of a given algorithm is then measured against this ideal in each pass band. The entropy based fusion quality metric (E-FQM) uses statistical information (entropy) from the images while the Targeting Task Performance fusion quality metric (TTPFQM) utilizes the TTP metric value in each spatial frequency band. This TTP metric value is the measure of available excess contrast determined by the Contrast Threshold Function (CTF) of the source system and the target contrast. The paper also proposes an image fusion algorithm that chooses source image contributions using a quality measure similar to the TTP-FQM. To test the effectiveness of TTP-FQM and E-FQM in predicting human image quality preferences, SWIR and LWIR imagery of tanks were fused using four different algorithms. A paired comparison test was performed with both source and fused imagery as stimuli. Eleven observers were asked to select which image enabled them to better identify the target. Over the ensemble of test images, the experiment showed that both TTP-FQM and E-FQM were capable of identifying the fusion algorithms most and least preferred by human observers. Analysis also showed that the performance of the TTP-FQM and E-FQM in identifying human image preferences are better than existing fusion quality metrics such as the Weighted Fusion Quality Index and Mutual Information.

Citation Download Citation

Forrest A. Smith, Srikant Chari, Carl E. Halford, Jonathan Fanning, and Joseph P. Reynolds "Novel image fusion quality metrics based on sensor models and image statistics", Proc. SPIE 7300, Infrared Imaging Systems: Design, Analysis, Modeling, and Testing XX, 730013 (1 May 2009); https://doi.org/10.1117/12.833367

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image fusion

Image quality

Targeting Task Performance metric

Short wave infrared radiation

Long wavelength infrared

Spatial frequencies

Image sensors

Show All Keywords

Keywords/Phrases

Search In:

Publication Years