The multiscale structure of non-differentiable image manifolds

Michael B. Wakin; David L. Donoho; Hyeokho Choi; Richard G. Baraniuk

doi:10.1117/12.617822

17 September 2005 The multiscale structure of non-differentiable image manifolds

Michael B. Wakin, David L. Donoho, Hyeokho Choi, Richard G. Baraniuk

Proceedings Volume 5914, Wavelets XI; 59141B (2005) https://doi.org/10.1117/12.617822
Event: Optics and Photonics 2005, 2005, San Diego, California, United States

Abstract

In this paper, we study families of images generated by varying a parameter that controls the appearance of the object/scene in each image. Each image is viewed as a point in high-dimensional space; the family of images forms a low-dimensional submanifold that we call an image appearance manifold (IAM). We conduct a detailed study of some representative IAMs generated by translations/rotations of simple objects in the plane and by rotations of objects in 3-D space. Our central, somewhat surprising, finding is that IAMs generated by images with sharp edges are nowhere differentiable. Moreover, IAMs have an inherent multiscale structure in that approximate tangent planes fitted to ε-neighborhoods continually twist off into new dimensions as the scale parameter ε varies. We explore and explain this phenomenon. An additional, more exotic kind of local non-differentiability happens at some exceptional parameter points where occlusions cause image edges to disappear. These non-differentiabilities help to understand some key phenomena in image processing. They imply that Newton's method will not work in general for image registration, but that a multiscale Newton's method will work. Such a multiscale Newton's method is similar to existing coarse-to-fine differential estimation algorithms for image registration; the manifold perspective offers a well-founded theoretical motivation for the multiscale approach and allows quantitative study of convergence and approximation. The manifold viewpoint is also generalizable to other image understanding problems.

Citation Download Citation

Michael B. Wakin, David L. Donoho, Hyeokho Choi, and Richard G. Baraniuk "The multiscale structure of non-differentiable image manifolds", Proc. SPIE 5914, Wavelets XI, 59141B (17 September 2005); https://doi.org/10.1117/12.617822

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available