An optical computing chip executing complex-valued neural network and its on-chip training

Hui Zhang; Ai Qun Liu

doi:10.1117/12.2597553

7 September 2021 An optical computing chip executing complex-valued neural network and its on-chip training

Hui Zhang, Ai Qun Liu

Proceedings Volume 11828, ODS 2021: Industrial Optical Devices and Systems; 1182808 (2021) https://doi.org/10.1117/12.2597553
Event: SPIE Optical Engineering + Applications, 2021, San Diego, California, United States

Abstract

The optical implementation of neural networks is proposed to have advantages over electronic implementations with lower power consumption and higher computation speed. However, most optical neural networks (ONNs) utilize conventional real-valued frameworks that are designed for digital computers, forfeiting many advantages of optical computing such as efficient complex-valued operations. Complex-valued neural networks are advantageous to their real-valued counterparts by offering rich representation space, fast convergence, and strong generalizations. We propose and demonstrate an ONN that implements truly complex-valued neural networks, achieving high accuracy and strong learning capability in many benchmark tasks.¹ On the other hand, efficiently training ONNs remains a formidable challenge, due to the difficulty in obtaining gradient information from a physical device. We propose an efficient on-chip training protocol for ONNs and demonstrate it by several practical tasks.² The protocol is gradient-free and physical agnostic, and is applicable for various types of chip structures, especially those that cannot be analytically decomposed and characterized. The protocol is robust to experimental perturbations like imperfect phase detection and photodetection noise. Our results present a promising avenue towards deep complex networks with smaller chip size, stronger performance, and flexible reconfiguration to realistic applications (e.g., facial recognition, natural language processing, and autonomous vehicles).

Conference Presentation

Citation Download Citation

Hui Zhang and Ai Qun Liu "An optical computing chip executing complex-valued neural network and its on-chip training", Proc. SPIE 11828, ODS 2021: Industrial Optical Devices and Systems, 1182808 (7 September 2021); https://doi.org/10.1117/12.2597553

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available