High-resolution optimal quantization for stochastic pooling networks

Mark D. McDonnell; Pierre-Olivier Amblard; Nigel G. Stocks; Steeve Zozor; Derek Abbott

doi:10.1117/12.695984

3 January 2007 High-resolution optimal quantization for stochastic pooling networks

Mark D. McDonnell, Pierre-Olivier Amblard, Nigel G. Stocks, Steeve Zozor, Derek Abbott

Proceedings Volume 6417, Complexity and Nonlinear Dynamics; 641706 (2007) https://doi.org/10.1117/12.695984
Event: SPIE Smart Materials, Nano- and Micro-Smart Systems, 2006, Adelaide, Australia

Abstract

Pooling networks of noisy threshold devices are good models for natural networks (e.g. neural networks in some parts of sensory pathways in vertebrates, networks of mossy fibers in the hippothalamus, . . . ) as well as for artificial networks (e.g. digital beamformers for sonar arrays, flash analog-to-digital converters, rate-constrained distributed sensor networks, . . . ). Such pooling networks exhibit the curious effect of suprathreshold stochastic resonance, which means that an optimal stochastic control of the network exists. Recently, some progress has been made in understanding pooling networks of identical, but independently noisy, threshold devices. One aspect concerns the behavior of information processing in the asymptotic limit of large networks, which is a limit of high relevance for neuroscience applications. The mutual information between the input and the output of the network has been evaluated, and its extremization has been performed. The aim of the present work is to extend these asymptotic results to study the more general case when the threshold values are no longer identical. In this situation, the values of thresholds can be described by a density, rather than by exact locations. We present a derivation of Shannon's mutual information between the input and output of these networks. The result is an approximation that relies a weak version of the law of large numbers, and a version of the central limit theorem. Optimization of the mutual information is then discussed.

Citation Download Citation

Mark D. McDonnell, Pierre-Olivier Amblard, Nigel G. Stocks, Steeve Zozor, and Derek Abbott "High-resolution optimal quantization for stochastic pooling networks", Proc. SPIE 6417, Complexity and Nonlinear Dynamics, 641706 (3 January 2007); https://doi.org/10.1117/12.695984

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available