Deep completion which predicts dense depth from sparse depth has important applications in the fields of robotics, autonomous driving and virtual reality. It compensates for the shortcomings of low accuracy in monocular depth estimation. However, the previous deep completion works evenly processed each depth pixel and ignored the statistical properties of the depth value distribution. In this paper, we propose a self-supervised framework that can generate accurate dense depth from RGB images and sparse depth without the need for dense depth labels. We propose a novel attention-based loss that takes into account the statistical properties of the depth value distribution. We evaluate our approach on the KITTI Dataset. The experimental results show that our method achieves state-of-the-art performance. At the same time, ablation study proves that our method can effectively improve the accuracy of the results.
In this paper, we propose a method for accurate 3D reconstruction based on Photometric Stereo. Instead of applying the global least square solution on the entire over-determined system, we randomly sample the images to form a set of overlapping groups and recover the surface normal for each group using the least square method. We then employ fourdimensional Tensor Robust Principal Component Analysis (TenRPCA) to obtain the accurate 3D reconstruction. Our method outperforms global least square in handling sparse noises such as shadows and specular highlights. Experiments demonstrate the reconstruction accuracy of our approach.
Laser triangulation and photometric stereo are commonly used three-dimensional (3-D) reconstruction methods, but they bear limitations in an underwater environment. One important reason is due to the refraction occurring at the interface (usually glass) of the underwater housing. The image formation process does not follow the commonly used pinhole camera model, and the image captured by the camera is a refracted projection of the object. We introduce a flat refraction model to describe the geometric relation between the refracted image and the real object. The model parameters were estimated in a calibration step with a standard chessboard. The proposed geometric relation is used for rebuilding underwater 3-D shapes in laser triangulation and photometric stereo. The experimental results indicate that our method can effectively correct the distortion in underwater 3-D reconstruction.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.