Complex-valued backprogation (CVBP) is an essential algorithm parsing a large amount of complex data for statistical inferences to deep optics neural networks. However, the operating optical transformations are almost unitary, which require the unitary backpropagation algorithms to meet the hetero-equivalence from their mathematical to optical mechanisms. This paper mainly compares two compact formulations for a common CVBP and its unitary-variants under holomorphic and compatible conditions, for which composite mechanisms are invented. For unitary weights-update, essentially, the Riemannian gradient of a CVBP is expanded from Euclidean gradient by executing an exponential mapping onto its unitary manifold. The convergent speed and accuracy, as well as the evolutions of their energies and averaging-phases at each layer are progressively investigated and compared, which reflect the dynamic behaviors on the network convergences. We find that not all the nonlinear activations under the respective conditions are always ensured to convergences, and the averaging-phases still remain several jumps although the energies at current layer situate at the convergent districts.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.