Use of binocular vision for hazard detection and vehicle control

Joseph W. Weber; Dan Koller; Quang-Tuan Luong; Jitendra Malik

doi:10.1117/12.228909

27 December 1995 Use of binocular vision for hazard detection and vehicle control

Joseph W. Weber, Dan Koller, Quang-Tuan Luong, Jitendra Malik

Proceedings Volume 2592, Collision Avoidance and Automated Traffic Management Sensors; (1995) https://doi.org/10.1117/12.228909
Event: Photonics East '95, 1995, Philadelphia, PA, United States

Abstract

We propose a new approach for vision based longitudinal and lateral vehicle control. The novel feature of this approach is the use of binocular vision. We integrated two modules consisting of a new, domain-specific binocular stereo algorithm, and a lane marker detection algorithm, and show that the integration results in improved performance for each of the modules. Longitudinal control is supported by detecting and measuring the distances to leading vehicles using binocular stereo. The knowledge of the camera geometry with respect to the locally planar road is used to map the images of the road plane in the two camera views into alignment. This allows us to separate image features into those lying in the road plane, e.g. lane markers, and those due to other objects which are dynamically integrated into an obstacle map. Therefore, in contrast with the previous work, we can cope with the difficulties arising from occlusion of lane markers by other vehicles. Detected vehicles are then tracked in time using a vehicle centered coordinate system. Multiple cameras can be integrated to provide full surround awareness. The detection and measurement of the lane markers provides us with the positional parameters and the road curvature which are needed for lateral vehicle control. Moreover, this information is also used to update the camera geometry with respect to the road, therefore allowing us to cope with the problem of vibrations and road inclination to obtain consistent results from binocular stereo.

Citation Download Citation

Joseph W. Weber, Dan Koller, Quang-Tuan Luong, and Jitendra Malik "Use of binocular vision for hazard detection and vehicle control", Proc. SPIE 2592, Collision Avoidance and Automated Traffic Management Sensors, (27 December 1995); https://doi.org/10.1117/12.228909

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available