BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Timothy Nguyen

Timothy Nguyen appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
hep-thmath.DGMachine Learningmath.APmath-phmath.MPArtificial Intelligencegr-qcmath.CAmath.GTmath.QAmath.SG

Catalog footprint

What is connected

10works
12topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

10 published item(s)

preprint2022arXiv

Architecture Matters in Continual Learning

A large body of research in continual learning is devoted to overcoming the catastrophic forgetting of neural networks by designing new algorithms that are robust to the distribution shifts. However, the majority of these works are strictly focused on the "algorithmic" part of continual learning for a "fixed neural network architecture", and the implications of using different architectures are mostly neglected. Even the few existing continual learning methods that modify the model assume a fixed architecture and aim to develop an algorithm that efficiently uses the model throughout the learning experience. However, in this work, we show that the choice of architecture can significantly impact the continual learning performance, and different architectures lead to different trade-offs between the ability to remember previous tasks and learning new ones. Moreover, we study the impact of various architectural decisions, and our findings entail best practices and recommendations that can improve the continual learning performance.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Dataset Distillation with Infinitely Wide Convolutional Networks

The effectiveness of machine learning algorithms arises from being able to extract useful features from large amounts of data. As model and dataset sizes increase, dataset distillation methods that compress large datasets into significantly smaller yet highly performant ones will become valuable in terms of training efficiency and useful feature extraction. To that end, we apply a novel distributed kernel based meta-learning framework to achieve state-of-the-art results for dataset distillation using infinitely wide convolutional neural networks. For instance, using only 10 datapoints (0.02% of original dataset), we obtain over 65% test accuracy on CIFAR-10 image classification task, a dramatic improvement over the previous best test accuracy of 40%. Our state-of-the-art results extend across many other settings for MNIST, Fashion-MNIST, CIFAR-10, CIFAR-100, and SVHN. Furthermore, we perform some preliminary analyses of our distilled datasets to shed light on how they differ from naturally occurring data.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Measuring Calibration in Deep Learning

Overconfidence and underconfidence in machine learning classifiers is measured by calibration: the degree to which the probabilities predicted for each class match the accuracy of the classifier on that prediction. How one measures calibration remains a challenge: expected calibration error, the most popular metric, has numerous flaws which we outline, and there is no clear empirical understanding of how its choices affect conclusions in practice, and what recommendations there are to counteract its flaws. In this paper, we perform a comprehensive empirical study of choices in calibration measures including measuring all probabilities rather than just the maximum prediction, thresholding probability values, class conditionality, number of bins, bins that are adaptive to the datapoint density, and the norm used to compare accuracies to confidences. To analyze the sensitivity of calibration measures, we study the impact of optimizing directly for each variant with recalibration techniques. Across MNIST, Fashion MNIST, CIFAR-10/100, and ImageNet, we find that conclusions on the rank ordering of recalibration methods is drastically impacted by the choice of calibration measure. We find that conditioning on the class leads to more effective calibration evaluations, and that using the L2 norm rather than the L1 norm improves both optimization for calibration metrics and the rank correlation measuring metric consistency. Adaptive binning schemes lead to more stablity of metric rank ordering when the number of bins vary, and is also recommended. We open source a library for the use of our calibration measures.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Quantization of the Nonlinear Sigma Model Revisited

We revisit the subject of perturbatively quantizing the nonlinear sigma model in two dimensions from a rigorous, mathematical point of view. Our main contribution is to make precise the cohomological problem of eliminating potential anomalies that may arise when trying to preserve symmetries under quantization. The symmetries we consider are twofold: (i) diffeomorphism covariance for a general target manifold; (ii) a transitive group of isometries when the target manifold is a homogeneous space. We show that there are no anomalies in case (i) and that (ii) is also anomaly-free under additional assumptions on the target homogeneous space, in agreement with the work of Friedan. We carry out some explicit computations for the $O(N)$-model. Finally, we show how a suitable notion of the renormalization group establishes the Ricci flow as the one loop renormalization group flow of the nonlinear sigma model.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

The Perturbative Approach to Path Integrals: A Succinct Mathematical Treatment

We study finite-dimensional integrals in a way that elucidates the mathematical meaning behind the formal manipulations of path integrals occurring in quantum field theory. This involves a proper understanding of how Wick's theorem allows one to evaluate integrals perturbatively, i.e., as a series expansion in a formal parameter irrespective of convergence properties. We establish invariance properties of such a Wick expansion under coordinate changes and the action of a Lie group of symmetries, and we use this to study essential features of path integral manipulations, including coordinate changes, Ward identities, Schwinger-Dyson equations, Faddeev-Popov gauge-fixing, and eliminating fields by their equation of motion. We also discuss the asymptotic nature of the Wick expansion and the implications this has for defining path integrals perturbatively and nonperturbatively.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

The Seiberg-Witten Equations on Manifolds with Boundary II: Lagrangian Boundary Conditions for a Floer Theory

In this paper, we study the Seiberg-Witten equations on the product R x Y, where Y is a compact 3-manifold with boundary. Following the approach of Salamon and Wehrheim in the instanton case, we impose Lagrangian boundary conditions for the Seiberg- Witten equations. The resulting equations we obtain constitute a nonlinear, nonlocal boundary value problem. We establish regularity, compactness, and Fredholm properties for the Seiberg- Witten equations supplied with Lagrangian boundary conditions arising from the monopole spaces studied in [20]. This work therefore serves as an analytic foundation for the construction of a monopole Floer theory for 3-manifolds with boundary.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Lagrangian correspondences and Donaldson's TQFT construction of the Seiberg-Witten invariants of 3-manifolds

Using Morse-Bott techniques adapted to the gauge-theoretic setting, we show that the limiting boundary values of the space of finite energy monopoles on a connected 3-manifold with at least two cylindrical ends provides an immersed Lagrangian submanifold of the vortex moduli space at infinity. By studying the signed intersections of such Lagrangians, we supply the analytic details of Donaldson's TQFT construction of the Seiberg-Witten invariants of a closed 3-manifold.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

The Seiberg-Witten Equations on Manifolds with Boundary I: The Space of Monopoles and Their Boundary Values

In this paper, we study the Seiberg-Witten equations on a compact 3-manifold with boundary. Solutions to these equations are called monopoles. Under some simple topological assumptions, we show that the solution space of all monopoles is a Banach manifold in suitable function space topologies. We then prove that the restriction of the space of monopoles to the boundary is a submersion onto a Lagrangian submanifold of the space of connections and spinors on the boundary. Both these spaces are infinite dimensional, even modulo gauge, since no boundary conditions are specified for the Seiberg-Witten equations on the 3-manifold. We study the analytic properties of these monopole spaces with an eye towards developing a monopole Floer theory for 3-manifolds with boundary, which we pursue in Part II.

0 citations0 reviewsNo code linkedOpen access
preprint2008arXiv

On discrete features of the wave equation in singular pp-wave backgrounds

We analyze the wave equation in families of pp-wave geometries developing strong localized scale-invariant singularities in certain limits. For both cases of well-localized pp-waves and the so-called null-cosmologies, we observe an intriguing discrete dependence of the existence of a singular limit on the normalization of the pp-wave profile. We also find restrictive matching conditions relating the geometries before and after the singularity (if a singular limit for the solutions of the wave equation with initial conditions specified away from the near-singular region is assumed to exist).

0 citations0 reviewsNo code linkedOpen access