Source author record

Mehmet Süzen

Mehmet Süzen appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

cond-mat.dis-nn cond-mat.stat-mech Machine Learning Methodology physics.gen-ph

Catalog footprint

What is connected

5works

5topics

3close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2020arXiv

Equivalence in Deep Neural Networks via Conjugate Matrix Ensembles

A numerical approach is developed for detecting the equivalence of deep learning architectures. The method is based on generating Mixed Matrix Ensembles (MMEs) out of deep neural network weight matrices and {\it conjugate circular ensemble} matching the neural architecture topology. Following this, the empirical evidence supports the {\it phenomenon} that difference between spectral densities of neural architectures and corresponding {\it conjugate circular ensemble} are vanishing with different decay rates at the long positive tail part of the spectrum i.e., cumulative Circular Spectral Difference (CSD). This finding can be used in establishing equivalences among different neural architectures via analysis of fluctuations in CSD. We investigated this phenomenon for a wide range of deep learning vision architectures and with circular ensembles originating from statistical quantum mechanics. Practical implications of the proposed method for artificial and natural neural architectures discussed such as the possibility of using the approach in Neural Architecture Search (NAS) and classification of biological neural networks.

preprint2020arXiv

Periodic Spectral Ergodicity: A Complexity Measure for Deep Neural Networks and Neural Architecture Search

Establishing associations between the structure and the generalisation ability of deep neural networks (DNNs) is a challenging task in modern machine learning. Producing solutions to this challenge will bring progress both in the theoretical understanding of DNNs and in building new architectures efficiently. In this work, we address this challenge by developing a new complexity measure based on the concept of {Periodic Spectral Ergodicity} (PSE) originating from quantum statistical mechanics. Based on this measure a technique is devised to quantify the complexity of deep neural networks from the learned weights and traversing the network connectivity in a sequential manner, hence the term cascading PSE (cPSE), as an empirical complexity measure. This measure will capture both topological and internal neural processing complexity simultaneously. Because of this cascading approach, i.e., a symmetric divergence of PSE on the consecutive layers, it is possible to use this measure for Neural Architecture Search (NAS). We demonstrate the usefulness of this measure in practice on two sets of vision models, ResNet and VGG, and sketch the computation of cPSE for more complex network structures.

preprint2016arXiv

A testable prediction from entropic gravity

I have shown conceptually that quantum state has a direct relationship to gravitational constant due to entropic force posed by Verlinde's argument and part of the Newton-Schrödinger equation (N-S) in the context of gravity induced collapse of the wavefunction via Diósi-Penrose proposal. This direct relationship can be used to measure gravitational constant using state-of-the-art mater-wave interferometry to test the entropic gravity argument.

preprint2016arXiv

Evaluating Gaussian processes for sparse irregular spatio-temporal data

A practical approach to evaluate performance of a Gaussian process regression models (GPR) for irregularly sampled sparse time-series is introduced. The approach entails construction of a secondary autoregressive model using the fine scale predictions to forecast a future observation used in GPR. We build different GPR models for Ornstein-Uhlenbeck and Fractional processes for simulated toy data with different sparsity levels to assess the utility of the approach.

preprint2014arXiv

Effective ergodicity in single-spin-flip dynamics

A quantitative measure of convergence to effective ergodicity, the Thirumalai-Mountain (TM) metric, is applied to Metropolis and Glauber single-spin-flip dynamics. In computing this measure, finite lattice ensemble averages are obtained using the exact solution for a one dimensional Ising model, whereas the time averages are computed with Monte Carlo simulations. The time evolution of the effective ergodic convergence of Ising magnetization is monitored. By this approach, diffusion regimes of the effective ergodic convergence of magnetization are identified for different lattice sizes, nonzero temperature, and nonzero external field values. Results show that caution should be taken when using the TM metric at system parameters that give rise to strong correlations.