Dual-band IR detector can obtain infrared radiation information of two bands at the same time, which has many advantages compared with single-band detector in application. At present, there are two types of dual-band detectors: one is that pixels of the two bands align perfectly, and the other is that pixels of the two bands do not align perfectly, resulting in spatial inconsistency. The spatial inconsistency dual-band detector has the advantages of perfect temporal consistency and no need for deep mesa etching, but needs more complex image fusion processing to utilize its advantages. On one hand, the difference between images of two bands contains both spatial and band differences, which makes it more difficult to accurately use band information. On the other hand, pixels of the two bands do not align perfectly, which means that higher frequency spatial information can be collected, taking advantage of these information is conducive to improving the resolution of the image. In this paper, an image fusion framework is proposed. Firstly, band differences and spatial differences are separated and reconstructed, and then the band differences are enhanced by pseudo-color fusion algorithm. Through moving a spatial consistency detector with sub-pixel displacement, we get images to verify ours fusion scheme. Experimental results show that the proposed fusion algorithm can extract and enhance the band difference information, and improve the resolution of high frequency spatial information.
Image registration is a typical problem and technical difficulty in the research field of image processing, which can be used in infrared image fusion, image Mosaic, image segmentation, super-resolution reconstruction and other directions. On the basis of infrared image registration, considering the difference of infrared image, the effective accuracy of registration is set. The algorithm in this paper was initially used in super-resolution reconstruction, but it was redesigned in the registration process due to the need to reduce the computing cost in hardware implementation. The algorithm is improved on the basis of the original flownetS, and the cost of the calculate is reduced by 89% when the number of convolutions layers and the receptive field of the improved network are the same. There is no need for pooling layer, because pooling provides greater receptive field while reducing resolution, which will lead to spatial information loss and data loss. Dilate convolution convolution can avoid down-sampling and provide a larger sense field under the premise of the same amount of computation. Set different Dilation rates, receptive fields will be different, and there will be multi-scale information. This method based on deep learning uses the processing method of dilated convolution to greatly reduce the cost of network computing and provide a convenient channel for the hardware implementation of the algorithm. Moreover, the algorithm also achieves excellent results on the development board RK3399Pro. Combined with infrared image, this paper also demonstrates the difference between infrared image in the registration of effective accuracy and visible light, and also analyzes the target at different speed, the minimum network structure required. Finally, an appropriate ratio was selected through experimental attempts to ensure stable accuracy in the conventional moving target.
Infrared imaging system compared with visible light imaging system, infrared imaging system can operate in all-weather conditions with high anti-interference ability and the ability to penetrate smoke and haze. The current infrared technology still has the disadvantage of low signal-to-noise ratio and lack high frequency detail information. The most direct way to improve the infrared imaging system is to improve the hardware design by increasing the size of the photoreceptor and the size of the image source, but the manufacturing process is complicated, the cost is high, and the improvement effect is limited. With the development of the field of computer vision, deep learning has become the most effective solution for super-resolution reconstruction[6]. Therefore, in this paper, a Video frame Infrared image super-resolution reconstruction method IVSR (Infrared Video super-resolution) is designed based on the deep learning method and the dual-path operation mode combining the single-frame and multi-frame super-resolution reconstruction algorithms. The innovation of IVSR net lies in that after the optical flow module extracts the inter-frame information of each frame and the current frame, the sub-pixel convolution layer of the multi-frame image fusion module can effectively utilize the sub-pixel information. IVSR can be regarded as two reconstruction processes, the first stage is the output of high-resolution information from the optical flow motion estimation module to the projection module, and the second stage integrates the high-resolution information of each projection module for fusion reconstruction. This method can effectively improve the visual effect of IVSR reconstruction, effectively solve the problem of poor reconstruction quality due to the lack of high frequency detail information. Compared with traditional reconstruction algorithms and other typical deep learning algorithms, reconstructed images of IVSR are more exquisite, with more prominent high-frequency details, no image distortion and significant advantages in objective evaluation indicators.
Infrared images typically contain obvious dark-corner noise. It is a challenging task to eliminate such noise with the acceptable computation overhead and time overhead. In this paper, we introduce an effective dark-corner noise removal algorithm consists of two consecutive processing procedures. Firstly, in order to effectively filter dark-corner noise with as few as frames of infrared images, the proposed algorithm accumulates the low-frequency pixels during the several different frames of infrared images and eliminates the dark-corner noise by subtracting this parameter from the original infrared image. Then, this algorithm sets several detection windows for dark-corner noise to obtain another additive correction parameter and subtract this parameter from the original infrared image. We demonstrate the effectiveness of our algorithm from experimental perspective.
The typical infrared medium and long wave color fusion algorithm exposes the problem that the radiation characteristics are not prominent or it is difficult to ensure that the color is suitable for human eyes in all kinds of scenes. Based on the above problems, this paper proposes an image fusion method without reference image based on color transfer and infrared radiation characteristics of medium and long wave. This method is suitable for most complex scenes, fully highlights the detail components of medium wave image and the differences between long wave images medium wave images. After a larger number of actual acquisition of medium and long wave infrared image simulation, the proposed algorithm can solve the above problems, and has a higher total information entropy.
Classic neural network algorithm can not correct the low frequency noise,and it is easy to appearance ghost artifact phenomenon. In this paper,we present a new improved algorithm which can eliminate the low frequency noise and ghost artifact.We add a learning layer which can preprocess to the input layer.In this layer, use the Gaussian filter folding the down sampling image and resampling to the image so that the new input image have global correlation, it could assure the accuracy of the estimate real scene image,this can help us to eliminate the low frequency noise in the input image. Then we judged the frame motion by the edge detection, setting a threshold to compare with the MSE of the edge frame difference.Considering the result of the comparison,we use the difference step size to update the gain and offset parameters. Experimental results show that the new algorithm can improve image quality effectively
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.