Researcher profile

Michael Lam

Michael Lam contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 13 - UnverifiedVerification L1Unclaimed author
2works
0followers
5topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

2 published item(s)

preprint2022arXiv

Heliosphere Meets Interstellar Medium, in a Galactic Context

The physical conditions within our heliosphere are driven by the Sun's motion through an evolving interstellar environment that remains largely unexplored. The next generation of outer heliosphere and interstellar explorers will answer fundamental questions about the heliosphere's relationship with the very local interstellar medium (VLISM) by diving deeper into the Sun's interstellar surroundings. The impact of these future missions will be vastly enhanced by concurrent, interdisciplinary studies that examine the direct connections between conditions within the heliosphere, the heliosphere's immediate interstellar environment, and the larger-scale Galactic ISM. Comparisons of the heliosphere and VLISM to their analogs across the Galaxy will constrain the global processes shaping both stellar astrospheres and their sustained impact on the ISM.

preprint2020arXiv

Rethinking the Hyperparameters for Fine-tuning

Fine-tuning from pre-trained ImageNet models has become the de-facto standard for various computer vision tasks. Current practices for fine-tuning typically involve selecting an ad-hoc choice of hyperparameters and keeping them fixed to values normally used for training from scratch. This paper re-examines several common practices of setting hyperparameters for fine-tuning. Our findings are based on extensive empirical evaluation for fine-tuning on various transfer learning benchmarks. (1) While prior works have thoroughly investigated learning rate and batch size, momentum for fine-tuning is a relatively unexplored parameter. We find that the value of momentum also affects fine-tuning performance and connect it with previous theoretical findings. (2) Optimal hyperparameters for fine-tuning, in particular, the effective learning rate, are not only dataset dependent but also sensitive to the similarity between the source domain and target domain. This is in contrast to hyperparameters for training from scratch. (3) Reference-based regularization that keeps models close to the initial model does not necessarily apply for "dissimilar" datasets. Our findings challenge common practices of fine-tuning and encourages deep learning practitioners to rethink the hyperparameters for fine-tuning.