Source author record

Mushegh Rafayelyan

Mushegh Rafayelyan appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

physics.optics Machine Learning cond-mat.dis-nn eess.SP Emerging Technologies Neural and Evolutionary Computing physics.app-ph

Catalog footprint

What is connected

5works

7topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2022arXiv

Asymptotic Stability in Reservoir Computing

Reservoir Computing is a class of Recurrent Neural Networks with internal weights fixed at random. Stability relates to the sensitivity of the network state to perturbations. It is an important property in Reservoir Computing as it directly impacts performance. In practice, it is desirable to stay in a stable regime, where the effect of perturbations does not explode exponentially, but also close to the chaotic frontier where reservoir dynamics are rich. Open questions remain today regarding input regularization and discontinuous activation functions. In this work, we use the recurrent kernel limit to draw new insights on stability in reservoir computing. This limit corresponds to large reservoir sizes, and it already becomes relevant for reservoirs with a few hundred neurons. We obtain a quantitative characterization of the frontier between stability and chaos, which can greatly benefit hyperparameter tuning. In a broader sense, our results contribute to understanding the complex dynamics of Recurrent Neural Networks.

preprint2022arXiv

Tuneable spin-glass optical simulator based on multiple light scattering

The race to heuristically solve non-deterministic polynomial-time (NP) problems through efficient methods is ongoing. Recently, optics was demonstrated as a promising tool to find the ground state of a spin-glass Ising Hamiltonian, which represents an archetypal NP problem. However, achieving completely programmable spin couplings in these large-scale optical Ising simulators remains an open challenge. Here, by exploiting the knowledge of the transmission matrix of a random medium, we experimentally demonstrate the possibility of controlling the couplings of a fully connected Ising spin system. By further tailoring the input wavefront we showcase the possibility of modifying the Ising Hamiltonian both by accounting for an external magnetic field and by controlling the number of degenerate ground states and their properties and probabilities. Our results represent a relevant step toward the realisation of fully-programmable Ising machines on thin optical platforms, capable of solving complex spin-glass Hamiltonians on a large scale.

preprint2020arXiv

Large-Scale Optical Reservoir Computing for Spatiotemporal Chaotic Systems Prediction

Reservoir computing is a relatively recent computational paradigm that originates from a recurrent neural network and is known for its wide range of implementations using different physical technologies. Large reservoirs are very hard to obtain in conventional computers, as both the computation complexity and memory usage grow quadratically. We propose an optical scheme performing reservoir computing over very large networks potentially being able to host several millions of fully connected photonic nodes thanks to its intrinsic properties of parallelism and scalability. Our experimental studies confirm that, in contrast to conventional computers, the computation time of our optical scheme is only linearly dependent on the number of photonic nodes of the network, which is due to electronic overheads, while the optical part of computation remains fully parallel and independent of the reservoir size. To demonstrate the scalability of our optical scheme, we perform for the first time predictions on large spatiotemporal chaotic datasets obtained from the Kuramoto-Sivashinsky equation using optical reservoirs with up to 50 000 optical nodes. Our results are extremely challenging for conventional von Neumann machines, and they significantly advance the state of the art of unconventional reservoir computing approaches, in general.

preprint2020arXiv

Reservoir Computing meets Recurrent Kernels and Structured Transforms

Reservoir Computing is a class of simple yet efficient Recurrent Neural Networks where internal weights are fixed at random and only a linear output layer is trained. In the large size limit, such random neural networks have a deep connection with kernel methods. Our contributions are threefold: a) We rigorously establish the recurrent kernel limit of Reservoir Computing and prove its convergence. b) We test our models on chaotic time series prediction, a classic but challenging benchmark in Reservoir Computing, and show how the Recurrent Kernel is competitive and computationally efficient when the number of data points remains moderate. c) When the number of samples is too large, we leverage the success of structured Random Features for kernel approximation by introducing Structured Reservoir Computing. The two proposed methods, Recurrent Kernel and Structured Reservoir Computing, turn out to be much faster and more memory-efficient than conventional Reservoir Computing.

preprint2016arXiv

Bragg-Berry mirrors: reflective broadband q-plates

We report on the experimental realization of flat mirrors enabling the broadband generation of optical vortices upon reflection. The effect is based on the geometric Berry phase associated with the circular Bragg reflection phenomenon from chiral uniaxial media. We show the reflective optical vortex generation from both diffractive and nondiffractive paraxial light beams using spatially patterned chiral liquid crystal films. The intrinsic spectrally broadband character of spin-orbit generation of optical phase singularities is demonstrated over the full visible domain. Our results do not rely on any birefringent retardation requirement and consequently foster the development of a novel generation of robust optical elements for spin-orbit photonic technologies.