Source author record

Junghyo Jo

Junghyo Jo appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

10works
16topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2022arXiv

Scale-invariant representation of machine learning

The success of machine learning has resulted from its structured representation of data. Similar data have close internal representations as compressed codes for classification or emerged labels for clustering. We observe that the frequency of internal codes or labels follows power laws in both supervised and unsupervised learning models. This scale-invariant distribution implies that machine learning largely compresses frequent typical data, and simultaneously, differentiates many atypical data as outliers. In this study, we derive the process by which these power laws can naturally arise in machine learning. In terms of information theory, the scale-invariant representation corresponds to a maximally uncertain data grouping among possible representations that guarantee a given learning accuracy.

preprint2020arXiv

Machine learning for the diagnosis of early stage diabetes using temporal glucose profiles

Machine learning shows remarkable success for recognizing patterns in data. Here we apply the machine learning (ML) for the diagnosis of early stage diabetes, which is known as a challenging task in medicine. Blood glucose levels are tightly regulated by two counter-regulatory hormones, insulin and glucagon, and the failure of the glucose homeostasis leads to the common metabolic disease, diabetes mellitus. It is a chronic disease that has a long latent period the complicates detection of the disease at an early stage. The vast majority of diabetics result from that diminished effectiveness of insulin action. The insulin resistance must modify the temporal profile of blood glucose. Thus we propose to use ML to detect the subtle change in the temporal pattern of glucose concentration. Time series data of blood glucose with sufficient resolution is currently unavailable, so we confirm the proposal using synthetic data of glucose profiles produced by a biophysical model that considers the glucose regulation and hormone action. Multi-layered perceptrons, convolutional neural networks, and recurrent neural networks all identified the degree of insulin resistance with high accuracy above $85\%$.

preprint2020arXiv

Synchronization of active rotators interacting with environment

Multiple organs in a living system respond to environmental changes, and the signals from the organs regulate the physiological environment. Inspired by this biological feedback, we propose a simple autonomous system of active rotators to explain how multiple units are synchronized under a fluctuating environment. We find that the feedback via an environment can entrain rotators to have synchronous phases for specific conditions. This mechanism is markedly different from the simple entrainment by a common oscillatory external stimulus that is not interacting with systems. We theoretically examine how the phase synchronization depends on the interaction strength between rotators and environment. Furthermore, we successfully demonstrate the proposed model by realizing an analog electric circuit with microelectronic devices. This bio-inspired platform can be used as a sensor for monitoring varying environments, and as a controller for amplifying signals by their feedback-induced synchronization.

preprint2019arXiv

Inverse Ising inference from high-temperature re-weighting of observations

Maximum Likelihood Estimation (MLE) is the bread and butter of system inference for stochastic systems. In some generality, MLE will converge to the correct model in the infinite data limit. In the context of physical approaches to system inference, such as Boltzmann machines, MLE requires the arduous computation of partition functions summing over all configurations, both observed and unobserved. We present here a conceptually and computationally transparent data-driven approach to system inference that is based on the simple question: How should the Boltzmann weights of observed configurations be modified to make the probability distribution of observed configurations close to a flat distribution? This algorithm gives accurate inference by using only observed configurations for systems with a large number of degrees of freedom where other approaches are intractable.

preprint2015arXiv

Design Principles of Pancreatic Islets: Glucose-dependent Coordination of Hormone Pulses

Pancreatic islets are functional units involved in glucose homeostasis. The multicellular system comprises three main cell types; $β$ and $α$ cells reciprocally decrease and increase blood glucose by producing insulin and glucagon pulses, while the role of $δ$ cells is less clear. Although their spatial organization and the paracrine/autocrine interactions between them have been extensively studied, the functional implications of the design principles are still lacking. In this study, we formulated a mathematical model that integrates the pulsatility of hormone secretion and the interactions and organization of islet cells and examined the effects of different cellular compositions and organizations in mouse and human islets. A common feature of both species was that islet cells produced synchronous hormone pulses under low- and high- glucose conditions, while they produced asynchronous hormone pulses under normal glucose conditions. However, the synchronous coordination of insulin and glucagon pulses at low glucose was more pronounced in human islets that had more $α$ cells. When $β$ cells were selectively removed to mimic diabetic conditions, the anti-synchronicity of insulin and glucagon pulses was deteriorated at high glucose, but it could be partially recovered when the re-aggregation of remaining cells was considered. Finally, the third cell type, $δ$ cells, which introduced additional complexity in the multicellular system, prevented the excessive synchronization of hormone pulses. Our computational study suggests that controllable synchronization is a design principle of pancreatic islets.

preprint2015arXiv

Emergent Universality in Nonequilibrium Processes of Critical Systems

We examine the Jarzynski equality for a quenching process across the critical point of second-order phase transitions, where absolute irreversibility and the effect of finite-sampling of the initial equilibrium distribution arise on an equal footing. We consider the Ising model as a prototypical example for spontaneous symmetry breaking and take into account the finite sampling issue by introducing a tolerance parameter. For a given tolerance parameter, the deviation from the Jarzynski equality depends onthe reduced coupling constant and the system size. In this work, we show that the deviation from the Jarzynski equality exhibits a universal scaling behavior inherited from the critical scaling laws of second-order phase transitions.

preprint2015arXiv

Minimal Perceptrons for Memorizing Complex Patterns

Feedforward neural networks have been investigated to understand learning and memory, as well as applied to numerous practical problems in pattern classification. It is a rule of thumb that more complex tasks require larger networks. However, the design of optimal network architectures for specific tasks is still an unsolved fundamental problem. In this study, we consider three-layered neural networks for memorizing binary patterns. We developed a new complexity measure of binary patterns, and estimated the minimal network size for memorizing them as a function of their complexity. We formulated the minimal network size for regular, random, and complex patterns. In particular, the minimal size for complex patterns, which are neither ordered nor disordered, was predicted by measuring their Hamming distances from known ordered patterns. Our predictions agreed with simulations based on the back-propagation algorithm.

preprint2013arXiv

An Exactly Solvable Discrete Stochastic Process with Correlated Properties

We propose a correlated stochastic process of which the novel non-Gaussian probability mass function is constructed by exactly solving moment generating function. The calculation of cumulants and auto-correlation shows that the process is convergent and scale invariant in the large but finite number limit. We demonstrate that the model consistently explains both the distribution and the correlation of discrete financial time-series data, and predicts the data distribution with high precision in the small number regime.

preprint2013arXiv

Stable and flexible system for glucose homeostasis

Pancreatic islets, controlling glucose homeostasis, consist of α, β, and δ cells. It has been observed that α and β cells generate out-of-phase synchronization in the release of glucagon and insulin, counter-regulatory hormones for increasing and decreasing glucose levels, while β and δ cells produce in-phase synchronization in the release of the insulin and somatostatin. Pieces of interactions between the islet cells have been observed for a long time, although their physiological role as a whole has not been explored yet. We model the synchronized hormone pulses of islets with coupled phase oscillators that incorporate the observed cellular interactions. The integrated model shows that the interaction from β to δ cells, of which sign has controversial reports, should be positive to reproduce the in-phase synchronization between β and δ cells. The model also suggests that δ cells help the islet system flexibly respond to changes of glucose environment.

preprint2011arXiv

Weibull-type limiting distribution for replicative systems

The Weibull function is widely used to describe skew distributions observed in nature. However, the origin of this ubiquity is not always obvious to explain. In the present paper, we consider the well-known Galton-Watson branching process describing simple replicative systems. The shape of the resulting distribution, about which little has been known, is found essentially indistinguishable from the Weibull form in a wide range of the branching parameter; this can be seen from the exact series expansion for the cumulative distribution, which takes a universal form. We also find that the branching process can be mapped into a process of aggregation of clusters. In the branching and aggregation process, the number of events considered for branching and aggregation grows cumulatively in time, whereas, for the binomial distribution, an independent event occurs at each time with a given success probability.