BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Yiheng Lin

Yiheng Lin contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
Machine Learningeess.SYmath.OCquant-phSystems and Controlphysics.atom-phArtificial Intelligenceastro-ph.IMgr-qcMultiagent Systems

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
8works
0followers
10topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

8 published item(s)

preprint2022arXiv

Decentralized Online Convex Optimization in Networked Systems

We study the problem of networked online convex optimization, where each agent individually decides on an action at every time step and agents cooperatively seek to minimize the total global cost over a finite horizon. The global cost is made up of three types of local costs: convex node costs, temporal interaction costs, and spatial interaction costs. In deciding their individual action at each time, an agent has access to predictions of local cost functions for the next $k$ time steps in an $r$-hop neighborhood. Our work proposes a novel online algorithm, Localized Predictive Control (LPC), which generalizes predictive control to multi-agent systems. We show that LPC achieves a competitive ratio of $1 + \tilde{O}(ρ_T^k) + \tilde{O}(ρ_S^r)$ in an adversarial setting, where $ρ_T$ and $ρ_S$ are constants in $(0, 1)$ that increase with the relative strength of temporal and spatial interaction costs, respectively. This is the first competitive ratio bound on decentralized predictive control for networked online convex optimization. Further, we show that the dependence on $k$ and $r$ in our results is near optimal by lower bounding the competitive ratio of any decentralized online algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Equipping Black-Box Policies with Model-Based Advice for Stable Nonlinear Control

Machine-learned black-box policies are ubiquitous for nonlinear control problems. Meanwhile, crude model information is often available for these problems from, e.g., linear approximations of nonlinear dynamics. We study the problem of equipping a black-box control policy with model-based advice for nonlinear control on a single trajectory. We first show a general negative result that a naive convex combination of a black-box policy and a linear model-based policy can lead to instability, even if the two policies are both stabilizing. We then propose an adaptive $λ$-confident policy, with a coefficient $λ$ indicating the confidence in a black-box policy, and prove its stability. With bounded nonlinearity, in addition, we show that the adaptive $λ$-confident policy achieves a bounded competitive ratio when a black-box policy is near-optimal. Finally, we propose an online learning approach to implement the adaptive $λ$-confident policy and verify its efficacy in case studies about the CartPole problem and a real-world electric vehicle (EV) charging problem with data bias due to COVID-19.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Online Optimization with Memory and Competitive Control

This paper presents competitive algorithms for a novel class of online optimization problems with memory. We consider a setting where the learner seeks to minimize the sum of a hitting cost and a switching cost that depends on the previous $p$ decisions. This setting generalizes Smoothed Online Convex Optimization. The proposed approach, Optimistic Regularized Online Balanced Descent, achieves a constant, dimension-free competitive ratio. Further, we show a connection between online optimization with memory and online control with adversarial disturbances. This connection, in turn, leads to a new constant-competitive policy for a rich class of online control problems.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Online Optimization with Predictions and Non-convex Losses

We study online optimization in a setting where an online learner seeks to optimize a per-round hitting cost, which may be non-convex, while incurring a movement cost when changing actions between rounds. We ask: \textit{under what general conditions is it possible for an online learner to leverage predictions of future cost functions in order to achieve near-optimal costs?} Prior work has provided near-optimal online algorithms for specific combinations of assumptions about hitting and switching costs, but no general results are known. In this work, we give two general sufficient conditions that specify a relationship between the hitting and movement costs which guarantees that a new algorithm, Synchronized Fixed Horizon Control (SFHC), provides a $1+O(1/w)$ competitive ratio, where $w$ is the number of predictions available to the learner. Our conditions do not require the cost functions to be convex, and we also derive competitive ratio results for non-convex hitting and movement costs. Our results provide the first constant, dimension-free competitive ratio for online non-convex optimization with movement costs. Further, we give an example of a natural instance, Convex Body Chasing (CBC), where the sufficient conditions are not satisfied and we can prove that no online algorithm can have a competitive ratio that converges to 1.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Quantum entanglement between an atom and a molecule

Conventional information processors freely convert information between different physical carriers to process, store, or transmit information. It seems plausible that quantum information will also be held by different physical carriers in applications such as tests of fundamental physics, quantum-enhanced sensors, and quantum information processing. Quantum-controlled molecules in particular could transduce quantum information across a wide range of quantum-bit (qubit) frequencies, from a few kHz for transitions within the same rotational manifold, a few GHz for hyperfine transitions, up to a few THz for rotational transitions, to hundreds of THz for fundamental and overtone vibrational and electronic transitions, possibly all within the same molecule. Here, we report the first demonstration of entanglement between states of the rotation of a $\rm^{40}CaH^+$ molecular ion and internal states of a $\rm^{40}Ca^+$ atomic ion. The qubit addressed in the molecule has a frequency of either 13.4 kHz or 855 GHz, highlighting the versatility of molecular qubits. This work demonstrates how molecules can transduce quantum information between qubits with different frequencies to enable hybrid quantum systems. We anticipate that quantum control and measurement of molecules as demonstrated here will create opportunities for quantum information science, quantum sensors, fundamental and applied physics, and controlled quantum chemistry.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Scalable Multi-Agent Reinforcement Learning for Networked Systems with Average Reward

It has long been recognized that multi-agent reinforcement learning (MARL) faces significant scalability issues due to the fact that the size of the state and action spaces are exponentially large in the number of agents. In this paper, we identify a rich class of networked MARL problems where the model exhibits a local dependence structure that allows it to be solved in a scalable manner. Specifically, we propose a Scalable Actor-Critic (SAC) method that can learn a near optimal localized policy for optimizing the average reward with complexity scaling with the state-action space size of local neighborhoods, as opposed to the entire network. Our result centers around identifying and exploiting an exponential decay property that ensures the effect of agents on each other decays exponentially fast in their graph distance.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Verifying the upper bound on the speed of scrambling with the analogue Hawking radiation of trapped ions

A general bound on the Lyapunov exponent of a quantum system is given by $λ_L\leq2π\,T/\hbar$, where $T$ is the system temperature, as established by Maldacena, Shenker, and Stanford (MSS). This upper bound is saturated when the system under consideration is the exact holographic dual of a black hole. It has also been shown that an inverted harmonic oscillator (IHO) may exhibit the behavior of thermal energy emission, in close analogy to the Hawking radiation emitted by black holes. We demonstrate that the Lyapunov exponent of the IHO indeed saturates the MSS bound, with an effective temperature equal to the analogue black hole radiation temperature, and propose using a trapped ion as a physical implementation of the IHO. We derive the corresponding out-of-time-ordered correlation function (OTOC) diagnosing quantum chaos, and theoretically show, for an experimentally realizable setup, that the effective temperature of the trapped-ion-IHO matches the upper MSS bound for the speed of scrambling.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Precision frequency-comb terahertz spectroscopy on pure quantum states of a single molecular ion

Spectroscopy is a powerful tool for studying molecules and is commonly performed on large thermal molecular ensembles that are perturbed by motional shifts and interactions with the environment and one another, resulting in convoluted spectra and limited resolution. Here, we use generally applicable quantum-logic techniques to prepare a trapped molecular ion in a single quantum state, drive terahertz rotational transitions with an optical frequency comb, and read out the final state non-destructively, leaving the molecule ready for further manipulation. We resolve rotational transitions to 11 significant digits and derive the rotational constant of CaH+ to be B_R = 142501777.9(1.7) kHz. Our approach suits a wide range of molecular ions, including polyatomics and species relevant for tests of fundamental physics, chemistry, and astrophysics.

0 citations0 reviewsNo code linkedOpen access