Due to the limited depth of field (DOF) of the camera, the background of images captured in large aperture mode is defocused and blurry, which not only results in the loss of important information in the background but also hinders the efficient reconstruction of the background regions. Usually, the super-resolution (SR) results of large aperture images are not good. Therefore, to enhance the reconstruction quality of defocused regions in large aperture images, a foreground-background separation and deblurring super-resolution (FBSDSR) method was proposed. Based on the idea of foreground-background separation processing, the large aperture image was divided into a sharp foreground region(If)and a blurry background region (Ib) according to the depth information. The end-to-end iterative filter adaptive network(IFAN) was used to deblur the background region Ib, refocus and restore an all-in-focus image. Finally, the enhanced super-resolution generative adversarial networks (Real-ESRGAN) which specializes in images SR of realistic scenes was used to process the sharp all-in-focus image. The proposed method realized high-quality reconstructions of both foreground and background of large aperture images. The experimental results demonstrated that the proposed method achieved effective reconstruction of the entire large aperture images clearly and solved the limitation of existing whole image reconstruction methods’ inability to reconstruct defocused regions of large aperture images. The quality and resolution of large aperture images were greatly improved.
The Maxwellian near-eye displays have the feature of always being in focus leading to the lack of correct depth cues, which makes human eyes cannot really perceive the actual position of the virtual image in space. In this paper, we proposed a Maxwellian near-eye display with the correct focusing and defocusing cues based on light field refocusing technology. The proposed system mainly consists of an optometric device, a laser projector, and a Lens Holographic Optical Element (LHOE). The proposed system uses optometric device to detect the human eye focused at different distances in real-time. The refocused images containing the focusing and defocusing information are generated by using the light field refocusing technology. The refocused images are matched with the focusing depth of human eyes, so as to restore the accommodation response of Maxwellian near-eye display. According to the specific position of human eyes, a lens holographic optical element is used to focus the refocusing image onto the retina to realize the perfect fusion of virtual images and the real environment. A proof-of-concept prototype based on the proposed structure is developed, and it presents Maxwellian near-eye display effects with correct focusing and defocusing cues.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.