Polymodal information processing via temporal cortex Area 37 modeling

James K. Peterson

doi:10.1117/12.540423

12 April 2004 Polymodal information processing via temporal cortex Area 37 modeling

James K. Peterson

Proceedings Volume 5421, Intelligent Computing: Theory and Applications II; (2004) https://doi.org/10.1117/12.540423
Event: Defense and Security, 2004, Orlando, Florida, United States

Abstract

A model of biological information processing is presented that consists of auditory and visual subsystems linked to temporal cortex and limbic processing. An biologically based algorithm is presented for the fusing of information sources of fundamentally different modalities. Proof of this concept is outlined by a system which combines auditory input (musical sequences) and visual input (illustrations such as paintings) via a model of cortex processing for Area 37 of the temporal cortex. The training data can be used to construct a connectionist model whose biological relevance is suspect yet is still useful and a biologically based model which achieves the same input to output map through biologically relevant means. The constructed models are able to create from a set of auditory and visual clues a combined musical/ illustration output which shares many of the properties of the original training data. These algorithms are not dependent on these particular auditory/ visual modalities and hence are of general use in the intelligent computation of outputs that require sensor fusion.

Citation Download Citation

James K. Peterson "Polymodal information processing via temporal cortex Area 37 modeling", Proc. SPIE 5421, Intelligent Computing: Theory and Applications II, (12 April 2004); https://doi.org/10.1117/12.540423

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available