Graph explorer

Stable Neural Flows

We introduce a provably stable variant of neural ordinary differential equations (neural ODEs) whose trajectories evolve on an energy functional parametrised by a neural network. Stable neural flows provide an implicit guarantee on asymptotic stability of the depth-flows, leading to robustness against input perturbations and low computational burden for the numerical solver. The learning procedure is cast as an optimal control problem, and an approximate solution is proposed based on adjoint sensivity analysis. We further introduce novel regularizers designed to ease the optimization process and speed up convergence. The proposed model class is evaluated on non-linear classification and function approximation tasks.

9 nodes9 linksoverview previewStable Neural Flows
9 nodes9 links
Stable Neural Flows9 visible / 9 total nodes / 24 links
Related contextCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipCo-authorshipAuthorshipAuthorshipAuthorshipAuthorshipTopic signalTopic signalAuthorshipAuthorshipWStable Neural Flowspreprint / 2020AStefano MassaroliResearcherAMichael PoliResearcherAMichelangelo BinResearcherAJinkyoo ParkResearcherTMachine Learning49008 worksTmath.OC9232 worksAAtsushi YamashitaResearcherAHajime AsamaResearcher
PaperSignal 108 links

Stable Neural Flows

preprint / 2020

Open