Source author record

Nima Dehmamy

Nima Dehmamy appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Machine Learning physics.soc-ph Computer Vision cond-mat.stat-mech eess.IV math.OC physics.comp-ph physics.data-an q-fin.RM Social and Information Networks

Catalog footprint

What is connected

6works

10topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2023arXiv

Symmetry Teleportation for Accelerated Optimization

Existing gradient-based optimization methods update parameters locally, in a direction that minimizes the loss function. We study a different approach, symmetry teleportation, that allows parameters to travel a large distance on the loss level set, in order to improve the convergence speed in subsequent steps. Teleportation exploits symmetries in the loss landscape of optimization problems. We derive loss-invariant group actions for test functions in optimization and multi-layer neural networks, and prove a necessary condition for teleportation to improve convergence rate. We also show that our algorithm is closely related to second order methods. Experimentally, we show that teleportation improves the convergence speed of gradient descent and AdaGrad for several optimization problems including test functions, multi-layer regressions, and MNIST classification.

preprint2022arXiv

Faster Optimization on Sparse Graphs via Neural Reparametrization

In mathematical optimization, second-order Newton's methods generally converge faster than first-order methods, but they require the inverse of the Hessian, hence are computationally expensive. However, we discover that on sparse graphs, graph neural networks (GNN) can implement an efficient Quasi-Newton method that can speed up optimization by a factor of 10-100x. Our method, neural reparametrization, modifies the optimization parameters as the output of a GNN to reshape the optimization landscape. Using a precomputed Hessian as the propagation rule, the GNN can effectively utilize the second-order information, reaching a similar effect as adaptive gradient methods. As our method solves optimization through architecture design, it can be used in conjunction with any optimizers such as Adam and RMSProp. We show the application of our method on scientifically relevant problems including heat diffusion, synchronization and persistent homology.

preprint2020arXiv

3D Topology Transformation with Generative Adversarial Networks

Generation and transformation of images and videos using artificial intelligence have flourished over the past few years. Yet, there are only a few works aiming to produce creative 3D shapes, such as sculptures. Here we show a novel 3D-to-3D topology transformation method using Generative Adversarial Networks (GAN). We use a modified pix2pix GAN, which we call Vox2Vox, to transform the volumetric style of a 3D object while retaining the original object shape. In particular, we show how to transform 3D models into two new volumetric topologies - the 3D Network and the Ghirigoro. We describe how to use our approach to construct customized 3D representations. We believe that the generated 3D shapes are novel and inspirational. Finally, we compare the results between our approach and a baseline algorithm that directly convert the 3D shapes, without using our GAN.

preprint2020arXiv

Finding Patient Zero: Learning Contagion Source with Graph Neural Networks

Locating the source of an epidemic, or patient zero (P0), can provide critical insights into the infection's transmission course and allow efficient resource allocation. Existing methods use graph-theoretic centrality measures and expensive message-passing algorithms, requiring knowledge of the underlying dynamics and its parameters. In this paper, we revisit this problem using graph neural networks (GNNs) to learn P0. We establish a theoretical limit for the identification of P0 in a class of epidemic models. We evaluate our method against different epidemic models on both synthetic and a real-world contact network considering a disease with history and characteristics of COVID-19. % We observe that GNNs can identify P0 close to the theoretical bound on accuracy, without explicit input of dynamics or its parameters. In addition, GNN is over 100 times faster than classic methods for inference on arbitrary graph topologies. Our theoretical bound also shows that the epidemic is like a ticking clock, emphasizing the importance of early contact-tracing. We find a maximum time after which accurate recovery of the source becomes impossible, regardless of the algorithm used.

preprint2015arXiv

Arbitrary degree distribution and high clustering in networks of locally interacting agents

Many real world networks, such as social networks, are primarily formed through local interactions between agents. Additionally, in contrast with common network models, social and biological networks exhibit a high degree of clustering. Here we construct a class of network growth models based on local interactions on a metric space, capable of producing arbitrary degree distributions as well as a naturally high degree of clustering akin to biological networks. As a specific example, we study the case of random- walking agents, though most results hold for any linear stochastic dynamics. Agents form bonds when they meet at designated locations we refer to as "rendezvous points." The spatial distribution of the rendezvous points determines key characteristics of the network such as the degree distribution. For any arbitrary (monotonic) degree distribution, we are able to analytically solve for the required rendezvous point distribution.

preprint2014arXiv

Classical mechanics of economic networks

Financial networks are dynamic. To assess their systemic importance to the world-wide economic network and avert losses we need models that take the time variations of the links and nodes into account. Using the methodology of classical mechanics and Laplacian determinism we develop a model that can predict the response of the financial network to a shock. We also propose a way of measuring the systemic importance of the banks, which we call BankRank. Using European Bank Authority 2011 stress test exposure data, we apply our model to the bipartite network connecting the largest institutional debt holders of the troubled European countries (Greece, Italy, Portugal, Spain, and Ireland). From simulating our model we can determine whether a network is in a "stable" state in which shocks do not cause major losses, or a "unstable" state in which devastating damages occur. Fitting the parameters of the model, which play the role of physical coupling constants, to Eurozone crisis data shows that before the Eurozone crisis the system was mostly in a "stable" regime, and that during the crisis it transitioned into an "unstable" regime. The numerical solutions produced by our model match closely the actual time-line of events of the crisis. We also find that, while the largest holders are usually more important, in the unstable regime smaller holders also exhibit systemic importance. Our model also proves useful for determining the vulnerability of banks and assets to shocks. This suggests that our model may be a useful tool for simulating the response dynamics of shared portfolio networks.