3D patch-based multi-view stereo for high-resolution imagery

Shizeng Yao; Hadi AliAkbarpour; Guna Seetharaman; Kannappan Palaniappan

doi:10.1117/12.2309806

27 April 2018 3D patch-based multi-view stereo for high-resolution imagery

Shizeng Yao, Hadi AliAkbarpour, Guna Seetharaman, Kannappan Palaniappan

Proceedings Volume 10645, Geospatial Informatics, Motion Imagery, and Network Analytics VIII; 106450K (2018) https://doi.org/10.1117/12.2309806
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

This paper proposes an improved solution to image-based three-dimensional (3D) modeling (also known as ”multi-view stereo”) that outputs surfaces visible in high-resolution wide-area format video also known as widearea motion imagery (WAMI) consisting of a dense set of small 3D points. The improved approach, named 3D patch-based multi-view stereo, is an expansion of PMVS¹ and is implemented also as a match, expand, and filter procedure. This approach takes a sequence of image frames and corresponding camera parameters together with a sparse set of matched feature points. As an initial step, it formulates a small 3D patch for each of the matched feature points. It then finds the best fitted curved surface inside the 3D patch based on the photometric consistency of each 3D point inside. Expansion and filtering procedures are then recursively applied on those initial surfaces until a certain percentage of image coverage is achieved. The proposed solution is able to precisely preserve small details and automatically detect and discard outliers. Moreover this approach does not require any initialization in the form of a visual hull, a bounding box, or valid depth ranges. We have tested our algorithm on various data sets including single object with fine surface details, and outdoor occluded extremely large WAMI dataset, where moving or static obstacles appear in front of static structures of interest and large areas of repetitive texture are present.

Citation Download Citation

Shizeng Yao, Hadi AliAkbarpour, Guna Seetharaman, and Kannappan Palaniappan "3D patch-based multi-view stereo for high-resolution imagery", Proc. SPIE 10645, Geospatial Informatics, Motion Imagery, and Network Analytics VIII, 106450K (27 April 2018); https://doi.org/10.1117/12.2309806

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available