Source author record

Michael Lam

Michael Lam appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

3works
6topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2022arXiv

Heliosphere Meets Interstellar Medium, in a Galactic Context

The physical conditions within our heliosphere are driven by the Sun's motion through an evolving interstellar environment that remains largely unexplored. The next generation of outer heliosphere and interstellar explorers will answer fundamental questions about the heliosphere's relationship with the very local interstellar medium (VLISM) by diving deeper into the Sun's interstellar surroundings. The impact of these future missions will be vastly enhanced by concurrent, interdisciplinary studies that examine the direct connections between conditions within the heliosphere, the heliosphere's immediate interstellar environment, and the larger-scale Galactic ISM. Comparisons of the heliosphere and VLISM to their analogs across the Galaxy will constrain the global processes shaping both stellar astrospheres and their sustained impact on the ISM.

preprint2020arXiv

Rethinking the Hyperparameters for Fine-tuning

Fine-tuning from pre-trained ImageNet models has become the de-facto standard for various computer vision tasks. Current practices for fine-tuning typically involve selecting an ad-hoc choice of hyperparameters and keeping them fixed to values normally used for training from scratch. This paper re-examines several common practices of setting hyperparameters for fine-tuning. Our findings are based on extensive empirical evaluation for fine-tuning on various transfer learning benchmarks. (1) While prior works have thoroughly investigated learning rate and batch size, momentum for fine-tuning is a relatively unexplored parameter. We find that the value of momentum also affects fine-tuning performance and connect it with previous theoretical findings. (2) Optimal hyperparameters for fine-tuning, in particular, the effective learning rate, are not only dataset dependent but also sensitive to the similarity between the source domain and target domain. This is in contrast to hyperparameters for training from scratch. (3) Reference-based regularization that keeps models close to the initial model does not necessarily apply for "dissimilar" datasets. Our findings challenge common practices of fine-tuning and encourages deep learning practitioners to rethink the hyperparameters for fine-tuning.

preprint2015arXiv

The NANOGrav Nine-year Data Set: Limits on the Isotropic Stochastic Gravitational Wave Background

We compute upper limits on the nanohertz-frequency isotropic stochastic gravitational wave background (GWB) using the 9-year data release from the North American Nanohertz Observatory for Gravitational Waves (NANOGrav) collaboration. We set upper limits for a GWB from supermassive black hole binaries under power law, broken power law, and free spectral coefficient GW spectrum models. We place a 95\% upper limit on the strain amplitude (at a frequency of yr$^{-1}$) in the power law model of $A_{\rm gw} < 1.5\times 10^{-15}$. For a broken power law model, we place priors on the strain amplitude derived from simulations of Sesana (2013) and McWilliams et al. (2014). We find that the data favor a broken power law to a pure power law with odds ratios of 22 and 2.2 to one for the McWilliams and Sesana prior models, respectively. The McWilliams model is essentially ruled out by the data, and the Sesana model is in tension with the data under the assumption of a pure power law. Using the broken power-law analysis we construct posterior distributions on environmental factors that drive the binary to the GW-driven regime including the stellar mass density for stellar-scattering, mass accretion rate for circumbinary disk interaction, and orbital eccentricity for eccentric binaries, marking the first time that the shape of the GWB spectrum has been used to make astrophysical inferences. We then place the most stringent limits so far on the energy density of relic GWs, $Ω_\mathrm{gw}(f)\,h^2 < 4.2 \times 10^{-10}$, yielding a limit on the Hubble parameter during inflation of $H_*=1.6\times10^{-2}~m_{Pl}$, where $m_{Pl}$ is the Planck mass. Our limit on the cosmic string GWB, $Ω_\mathrm{gw}(f)\, h^2 < 2.2 \times 10^{-10}$, translates to a conservative limit of $Gμ<3.3\times 10^{-8}$ - a factor of 4 better than the joint Planck and high-$l$ CMB data from other experiments.