Source author record

Mark K. Transtrum

Mark K. Transtrum appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

20works
17topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

20 published item(s)

preprint2022arXiv

Bayesian, frequentist, and information geometric approaches to parametric uncertainty quantification of classical empirical interatomic potentials

In this paper, we consider the problem of quantifying parametric uncertainty in classical empirical interatomic potentials (IPs) using both Bayesian (Markov Chain Monte Carlo) and frequentist (profile likelihood) methods. We interface these tools with the Open Knowledgebase of Interatomic Models and study three models based on the Lennard-Jones, Morse, and Stillinger--Weber potentials. We confirm that IPs are typically sloppy, i.e., insensitive to coordinated changes in some parameter combinations. Because the inverse problem in such models is ill-conditioned, parameters are unidentifiable. This presents challenges for traditional statistical methods, as we demonstrate and interpret within both Bayesian and frequentist frameworks. We use information geometry to illuminate the underlying cause of this phenomenon and show that IPs have global properties similar to those of sloppy models from fields such as systems biology, power systems, and critical phenomena. IPs correspond to bounded manifolds with a hierarchy of widths, leading to low effective dimensionality in the model. We show how information geometry can motivate new, natural parameterizations that improve the stability and interpretation of uncertainty quantification analysis and further suggest simplified, less-sloppy models.

preprint2022arXiv

The supremum principle selects simple, transferable models

We consider how mathematical models enable predictions for conditions that are qualitatively different from the training data. We propose techniques based on information topology to find models that can apply their learning in regimes for which there is no data. The first step is to use the Manifold Boundary Approximation Method to construct simple, reduced models of target phenomena in a data-driven way. We consider the set of all such reduced models and use the topological relationships among them to reason about model selection for new, unobserved phenomena. Given minimal models for several target behaviors, we introduce the supremum principle as a criterion for selecting a new, transferable model. The supremal model, i.e., the least upper bound, is the simplest model that reduces to each of the target behaviors. We illustrate how to discover supremal models with several examples; in each case, the supremal model unifies causal mechanisms to transfer successfully to new target domains. We use these examples to motivate a general algorithm that has formal connections to theories of analogical reasoning in cognitive psychology.

preprint2022arXiv

Theory of Nb-Zr Alloy Superconductivity and First Experimental Demonstration for Superconducting Radio-Frequency Cavity Applications

Niobium-zirconium (Nb-Zr) alloy is an old superconductor that is a promising new candidate for superconducting radio-frequency (SRF) cavity applications. Using density-functional and Eliashberg theories, we show that addition of Zr to a Nb surface in small concentrations increases the critical temperature $T_c$ and improves other superconducting properties. Furthermore, we calculate $T_c$ for Nb-Zr alloys across a broad range of Zr concentrations, showing good agreement with the literature for disordered alloys as well as the potential for significantly higher $T_c$ in ordered alloys near 75%Nb/25%Zr composition. We provide experimental verification on Nb-Zr alloy samples and SRF sample test cavities prepared with either physical vapor or our novel electrochemical deposition recipes. These samples have the highest measured $T_c$ of any Nb-Zr superconductor to date and indicate a reduction in BCS resistance compared to the conventional Nb reference sample; they represent the first steps along a new pathway to greatly enhanced SRF performance. Finally, we use Ginzburg-Landau theory to show that the addition of Zr to a Nb surface increases the superheating field $B_{sh}$, a key figure of merit for SRF which determines the maximum accelerating gradient at which cavities can operate.

preprint2020arXiv

Analysis of Magnetic Vortex Dissipation in Sn-Segregated Boundaries in Nb$_3$Sn Superconducting RF Cavities

We study mechanisms of vortex nucleation in Nb$_3$Sn Superconducting RF (SRF) cavities using a combination of experimental, theoretical, and computational methods. Scanning transmission electron microscopy (STEM) image and energy dispersive spectroscopy (EDS) of some Nb$_3$Sn cavities show Sn segregation at grain boundaries in Nb$_3$Sn with Sn concentration as high as $\sim$35 at.\% and widths $\sim$3 nm in chemical composition. Using ab initio calculations, we estimate the effect excess tin has on the local superconducting properties of the material. We model Sn segregation as a lowering of the local critical temperature. We then use time-dependent Ginzburg-Landau theory to understand the role of segregation on magnetic vortex nucleation. Our simulations indicate that the grain boundaries act as both nucleation sites for vortex penetration and pinning sites for vortices after nucleation. Depending on the magnitude of the applied field, vortices may remain pinned in the grain boundary or penetrate the grain itself. We estimate the superconducting losses due to vortices filling grain boundaries and compare with observed performance degradation with higher magnetic fields. We estimate that the quality factor may decrease by an order of magnitude ($10^{10}$ to $10^9$) at typical operating fields if 0.03\% of the grain boundaries actively nucleate vortices. We additionally estimate the volume that would need to be filled with vortices to match experimental observations of cavity heating.

preprint2020arXiv

Role of surface defects and material inhomogeneities for vortex nucleation in superconductors within time-dependent Ginzburg-Landau theory in 2 and 3 dimensions

We use Time-Dependent Ginzburg-Landau theory to study the nucleation of vortices in type II superconductors in the presence of both geometric and material inhomogeneities. The superconducting Meissner state is meta-stable up to a critical magnetic field, known as the superheating field. For a uniform surface and homogenous material, the superheating transition is driven by a non-local critical mode in which an array of vortices simultaneously penetrate the surface. In contrast, we show that even a small amount of disorder localizes the critical mode and can have a significant reduction in the effective superheating field for a particular sample. Vortices can be nucleated by either surface roughness or local variations in material parameters, such as Tc. Our approach uses a finite element method to simulate a cylindrical geometry in 2 dimensions and a film geometry in 2 and 3 dimensions. We combine saddle node bifurcation analysis along with a novel fitting procedure to evaluate the superheating field and identify the unstable mode. We demonstrate agreement with previous results for homogenous geometries and surface roughness and extend the analysis to include variations in material properties. Finally, we show that in three dimensions, suface divots not aligned with the applied field can increase the super heating field. We discuss implications for fabrication and performance of superconducting resonant frequency cavities in particle accelerators.

preprint2019arXiv

$\textit{Ab Initio}$ Study of Antisite Defects in Nb$_3$Sn: Phase Diagram and Impact on Superconductivity

Antisite defects play a critical role in Nb$_3$Sn superconducting radio frequency (SRF) cavity physics. Such defects are the primary form of disorder in Nb$_3$Sn, and are responsible for stoichiometry variations, including experimentally observed tin-depleted regions within grains and tin-rich regions around grain boundaries. But why they cluster to form regions of different stoichiometries and how they affect the SRF properties of Nb$_3$Sn cavities are not fully understood. Using $\textit{ab initio}$ techniques, we calculate the A15 region of the Nb-Sn phase diagram, discuss a possible modification to the phase diagram near grain boundaries, and calculate $T_c$ as a function of stoichiometry, including experimentally inaccessible tin-rich stoichiometry. We find that the impact of antisite defects on the density of states near the Fermi-level of Nb$_3$Sn plays a key role in determining many of their properties. These results improve our understanding of the obstacles facing Nb$_3$Sn SRF systems, and how modified growth processes might overcome them.

preprint2016arXiv

Bridging Mechanistic and Phenomenological Models of Complex Biological Systems

The inherent complexity of biological systems gives rise to complicated mechanistic models with a large number of parameters. On the other hand, the collective behavior of these systems can often be characterized by a relatively small number of phenomenological parameters. We use the Manifold Boundary Approximation Method (MBAM) as a tool for deriving simple phenomenological models from complicated mechanistic models. The resulting models are not black boxes, but remain expressed in terms of the microscopic parameters. In this way, we explicitly connect the macroscopic and microscopic descriptions, characterize the equivalence class of distinct systems exhibiting the same range of collective behavior, and identify the combinations of components that function as tunable control knobs for the behavior. We demonstrate the procedure for adaptation behavior exhibited by the EGFR pathway. From a 48 parameter mechanistic model, the system can be effectively described by a single adaptation parameter $τ$ characterizing the ratio of time scales for the initial response and recovery time of the system which can in turn be expressed as a combination of microscopic reaction rates, Michaelis-Menten constants, and biochemical concentrations. The situation is not unlike modeling in physics in which microscopically complex processes can often be renormalized into simple phenomenological models with only a few effective parameters. The proposed method additionally provides a mechanistic explanation for non-universal features of the behavior.

preprint2016arXiv

Ginzburg-Landau theory of the superheating field anisotropy of layered superconductors

We investigate the effects of material anisotropy on the superheating field of layered superconductors. We provide an intuitive argument both for the existence of a superheating field, and its dependence on anisotropy, for $κ= λ/ ξ$ (the ratio of magnetic to superconducting healing lengths) both large and small. On the one hand, the combination of our estimates with published results using a two-gap model for MgB${}_2$ suggests high anisotropy of the superheating field near zero temperature. On the other hand, within Ginzburg-Landau theory for a single gap, we see that the superheating field shows significant anisotropy only when the crystal anisotropy is large and the Ginzburg-Landau parameter $κ$ is small. We then conclude that only small anisotropies in the superheating field are expected for typical unconventional superconductors near the critical temperature. Using a generalized form of Ginzburg Landau theory, we do a quantitative calculation for the anisotropic superheating field by mapping the problem to the isotropic case, and present a phase diagram in terms of anisotropy and $κ$, showing type I, type II, or mixed behavior (within Ginzburg-Landau theory), and regions where each asymptotic solution is expected. We estimate anisotropies for a number of different materials, and discuss the importance of these results for radio-frequency cavities for particle accelerators.

preprint2016arXiv

Information topology identifies emergent model classes

We develop a language for describing the relationship among observations, mathematical models, and the underlying principles from which they are derived. Using Information Geometry, we consider geometric properties of statistical models for different observations. As observations are varied, the model manifold may be stretched, compressed, or even collapsed. Observations that preserve the structural identifiability of the parameters also preserve certain topological features (such as edges and corners) that characterize the model's underlying physical principles. We introduce Information Topology in analogy with information geometry as characterizing the "abstract model" of which statistical models are realizations. Observations that change the topology, i.e., "manifold collapse," require a modification of the abstract model in order to construct identifiable statistical models. Often, the essential topological feature is a hierarchical structure of boundaries (faces, edges, corners, etc.) which we represent as a hierarchical graph known as a Hasse diagram. Low-dimensional elements of this diagram are simple models that describe the dominant behavioral modes, what we call emergent model classes. Observations that preserve the Hasse diagram are diffeomorphically related and form a group, the collection of which form a partially ordered set. All possible observations have a semi-group structure. For hierarchical models, we consider how the topology of simple models is embedded in that of larger models. When emergent model classes are unstable to the introduction of new parameters, we classify the new parameters as relevant. Conversely, the emergent model classes are stable to the introduction of irrelevant parameters. In this way, information topology provides a general language for exploring representations of physical systems and their relationships to observations.

preprint2016arXiv

Manifold boundaries give "gray-box" approximations of complex models

We discuss a method of parameter reduction in complex models known as the Manifold Boundary Approximation Method (MBAM). This approach, based on a geometric interpretation of statistics, maps the model reduction problem to a geometric approximation problem. It operates iteratively, removing one parameter at a time, by approximating a high-dimension, but thin manifold by its boundary. Although the method makes no explicit assumption about the functional form of the model, it does require that the model manifold exhibit a hierarchy of boundaries, i.e., faces, edges, corners, hyper-corners, etc. We empirically show that a variety of model classes have this curious feature, making them amenable to MBAM. These model classes include models composed of elementary functions (e.g., rational functions, exponentials, and partition functions), a variety of dynamical system (e.g., chemical and biochemical kinetics, Linear Time Invariant (LTI) systems, and compartment models), network models (e.g., Bayesian networks, Markov chains, artificial neural networks, and Markov random fields), log-linear probability distributions, and models with symmetries. We discuss how MBAM recovers many common approximation methods for each model class and discuss potential pitfalls and limitations.

preprint2015arXiv

Shielding superconductors with thin films

Determining the optimal arrangement of superconducting layers to withstand large amplitude AC magnetic fields is important for certain applications such as superconducting radiofrequency cavities. In this paper, we evaluate the shielding potential of the superconducting film/insulating film/superconductor (SIS') structure, a configuration that could provide benefits in screening large AC magnetic fields. After establishing that for high frequency magnetic fields, flux penetration must be avoided, the superheating field of the structure is calculated in the London limit both numerically and, for thin films, analytically. For intermediate film thicknesses and realistic material parameters we also solve numerically the Ginzburg-Landau equations. It is shown that a small enhancement of the superheating field is possible, on the order of a few percent, for the SIS' structure relative to a bulk superconductor of the film material, if the materials and thicknesses are chosen appropriately.

preprint2015arXiv

Sloppiness and Emergent Theories in Physics, Biology, and Beyond

Large scale models of physical phenomena demand the development of new statistical and computational tools in order to be effective. Many such models are `sloppy', i.e., exhibit behavior controlled by a relatively small number of parameter combinations. We review an information theoretic framework for analyzing sloppy models. This formalism is based on the Fisher Information Matrix, which we interpret as a Riemannian metric on a parameterized space of models. Distance in this space is a measure of how distinguishable two models are based on their predictions. Sloppy model manifolds are bounded with a hierarchy of widths and extrinsic curvatures. We show how the manifold boundary approximation can extract the simple, hidden theory from complicated sloppy models. We attribute the success of simple effective models in physics as likewise emerging from complicated processes exhibiting a low effective dimensionality. We discuss the ramifications and consequences of sloppy models for biochemistry and science more generally. We suggest that the reason our complex world is understandable is due to the same fundamental reason: simple theories of macroscopic behavior are hidden inside complicated microscopic processes.

preprint2013arXiv

Parameter Space Compression Underlies Emergent Theories and Predictive Models

We report a similarity between the microscopic parameter dependance of emergent theories in physics and that of multiparameter models common in other areas of science. In both cases, predictions are possible despite large uncertainties in the microscopic parameters because these details are compressed into just a few governing parameters that are sufficient to describe relevant observables. We make this commonality explicit by examining parameter sensitivity in a hopping model of diffusion and a generalized Ising model of ferromagnetism. We trace the emergence of a smaller effective model to the development of a hierarchy of parameter importance quantified by the eigenvalues of the Fisher Information Matrix. Strikingly, the same hierarchy appears ubiquitously in models taken from diverse areas of science. We conclude that the emergence of effective continuum and universal theories in physics is due to the same parameter space hierarchy that underlies predictive modeling in other areas of science.

preprint2013arXiv

Theoretical Field Limits for Multi-Layer Superconductors

The SIS structure---a thin superconducting film on a bulk superconductor separated by a thin insulating film---was propsed as a method to protect alternative SRF materials from flux penetration by enhancing the first critical field $B_{c1}$. In this work, we show that in fact $B_{c1}$ = 0 for a SIS structure. We calculate the superheating field $B_{sh}$, and we show that it can be enhanced slightly using the SIS structure, but only for a small range of film thicknesses and only if the film and the bulk are different materials. We also show that using a multilayer instead of a single thick layer is detrimental, as this decreases $B_{sh}$ of the film. We calculate the dissipation due to vortex penetration above the $B_{sh}$ of the film, and find that it is unmanageable for SRF applications. However, we find that if a gradient in the phase of the order parameter is introduced, SIS structures may be able to shield large DC and low frequency fields. We argue that the SIS structure is not beneficial for SRF cavities, but due to recent experiments showing low-surface-resistance performance above $B_{c1}$ in cavities made of superconductors with small coherence lengths, we argue that enhancement of $B_{c1}$ is not necessary, and that bulk films of alternative materials show great promise.

preprint2012arXiv

Geodesic acceleration and the small-curvature approximation for nonlinear least squares

It has been shown numerically that the performance of the Levenberg-Marquardt algorithm can be improved by including a second order correction known as the geodesic acceleration. In this paper we give the method a more sound theoretical foundation by deriving the geodesic acceleration correction without using differential geometry and showing that the traditional convergence proofs can be adapted to incorporate geodesic acceleration. Unlike other methods which include second derivative information, the geodesic acceleration does not attempt to improve the Gauss-Newton approximate Hessian, but rather is an extension of the small-residual approximation to cubic order. In deriving geodesic acceleration, we note that the small-residual approximation is complemented by a small-curvature approximation. This latter approximation provides a much broader justification for the Gauss-Newton approximate Hessian and Levenberg-Marquardt algorithm. In particular, it is justifiable even if the best fit residuals are large, is dependent only on the model and not on the data being fit, and is applicable for the entire course of the algorithm and not just the region near the minimum.

preprint2012arXiv

Improvements to the Levenberg-Marquardt algorithm for nonlinear least-squares minimization

When minimizing a nonlinear least-squares function, the Levenberg-Marquardt algorithm can suffer from a slow convergence, particularly when it must navigate a narrow canyon en route to a best fit. On the other hand, when the least-squares function is very flat, the algorithm may easily become lost in parameter space. We introduce several improvements to the Levenberg-Marquardt algorithm in order to improve both its convergence speed and robustness to initial parameter guesses. We update the usual step to include a geodesic acceleration correction term, explore a systematic way of accepting uphill steps that may increase the residual sum of squares due to Umrigar and Nightingale, and employ the Broyden method to update the Jacobian matrix. We test these changes by comparing their performance on a number of test problems with standard implementations of the algorithm. We suggest that these two particular challenges, slow convergence and robustness to initial guesses, are complimentary problems. Schemes that improve convergence speed often make the algorithm less robust to the initial guess, and vice versa. We provide an open source implementation of our improvements that allow the user to adjust the algorithm parameters to suit particular needs.

preprint2012arXiv

Structural Susceptibility and Separation of Time Scales in the van der Pol Oscillator

We use an extension of the van der Pol oscillator as an example of a system with multiple time scales to study the susceptibility of its trajectory to polynomial perturbations in the dynamics. A striking feature of many nonlinear, multi-parameter models is an apparently inherent insensitivity to large magnitude variations in certain linear combinations of parameters. This phenomenon of "sloppiness" is quantified by calculating the eigenvalues of the Hessian matrix of the least-squares cost function which typically span many orders of magnitude. The van der Pol system is no exception: Perturbations in its dynamics show that most directions in parameter space weakly affect the limit cycle, whereas only a few directions are stiff. With this study we show that separating the time scales in the van der Pol system leads to a further separation of eigenvalues. Parameter combinations which perturb the slow manifold are stiffer and those which solely affect the transients in the dynamics are sloppier.

preprint2010arXiv

Superheating field of superconductors within Ginzburg-Landau theory

We study the superheating field of a bulk superconductor within Ginzburg-Landau theory, which is valid near the critical temperature. We calculate, as functions of the Ginzburg-Landau parameter $κ$, the superheating field $\Hsh$ and the critical momentum $k_c$ characterizing the wavelength of the instability of the Meissner state to flux penetration. By mapping the two-dimensional linear stability theory into a one-dimensional eigenfunction problem for an ordinary differential equation, we solve the problem numerically. We demonstrate agreement between the numerics and analytics, and show convergence to the known results at both small and large $κ$. We discuss the implications of the results for superconducting RF cavities used in particle accelerators.

preprint2010arXiv

The geometry of nonlinear least squares with applications to sloppy models and optimization

Parameter estimation by nonlinear least squares minimization is a common problem with an elegant geometric interpretation: the possible parameter values of a model induce a manifold in the space of data predictions. The minimization problem is then to find the point on the manifold closest to the data. We show that the model manifolds of a large class of models, known as sloppy models, have many universal features; they are characterized by a geometric series of widths, extrinsic curvatures, and parameter-effects curvatures. A number of common difficulties in optimizing least squares problems are due to this common structure. First, algorithms tend to run into the boundaries of the model manifold, causing parameters to diverge or become unphysical. We introduce the model graph as an extension of the model manifold to remedy this problem. We argue that appropriate priors can remove the boundaries and improve convergence rates. We show that typical fits will have many evaporated parameters. Second, bare model parameters are usually ill-suited to describing model behavior; cost contours in parameter space tend to form hierarchies of plateaus and canyons. Geometrically, we understand this inconvenient parametrization as an extremely skewed coordinate basis and show that it induces a large parameter-effects curvature on the manifold. Using coordinates based on geodesic motion, these narrow canyons are transformed in many cases into a single quadratic, isotropic basin. We interpret the modified Gauss-Newton and Levenberg-Marquardt fitting algorithms as an Euler approximation to geodesic motion in these natural coordinates on the model manifold and the model graph respectively. By adding a geodesic acceleration adjustment to these algorithms, we alleviate the difficulties from parameter-effects curvature, improving both efficiency and success rates at finding good fits.