BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

ShiNung Ching

ShiNung Ching appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCeess.SYMachine LearningSystems and Control

Catalog footprint

What is connected

6works
4topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

6 published item(s)

preprint2022arXiv

Non-Stationary Representation Learning in Sequential Linear Bandits

In this paper, we study representation learning for multi-task decision-making in non-stationary environments. We consider the framework of sequential linear bandits, where the agent performs a series of tasks drawn from distinct sets associated with different environments. The embeddings of tasks in each set share a low-dimensional feature extractor called representation, and representations are different across sets. We propose an online algorithm that facilitates efficient decision-making by learning and transferring non-stationary representations in an adaptive fashion. We prove that our algorithm significantly outperforms the existing ones that treat tasks independently. We also conduct experiments using both synthetic and real data to validate our theoretical insights and demonstrate the efficacy of our algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Representation Learning for Context-Dependent Decision-Making

Humans are capable of adjusting to changing environments flexibly and quickly. Empirical evidence has revealed that representation learning plays a crucial role in endowing humans with such a capability. Inspired by this observation, we study representation learning in the sequential decision-making scenario with contextual changes. We propose an online algorithm that is able to learn and transfer context-dependent representations and show that it significantly outperforms the existing ones that do not learn representations adaptively. As a case study, we apply our algorithm to the Wisconsin Card Sorting Task, a well-established test for the mental flexibility of humans in sequential decision-making. By comparing our algorithm with the standard Q-learning and Deep-Q learning algorithms, we demonstrate the benefits of adaptive representation learning.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Analysis of Recurrent Linear Networks for Enabling Compressed Sensing of Time-Varying Signals

Recent interest has developed around the problem of dynamic compressed sensing, or the recovery of time-varying, sparse signals from limited observations. In this paper, we study how the dynamics of recurrent networks, formulated as general dynamical systems, mediate the recoverability of such signals. We specifically consider the problem of recovering a high-dimensional network input, over time, from observation of only a subset of the network states (i.e., the network output). Our goal is to ascertain how the network dynamics lead to performance advantages, particularly in scenarios where both the input and output are corrupted by disturbance and noise, respectively. For this scenario, we develop bounds on the recovery performance in terms of the dynamics. Conditions for exact recovery in the absence of noise are also formulated. Through several examples, we use the results to highlight how different network characteristics may trade off toward enabling dynamic compressed sensing and how such tradeoffs may manifest naturally in certain classes of neuronal networks.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Controlling Linear Networks with Minimally Novel Inputs

In this paper, we propose a novelty-based metric for quantitative characterization of the controllability of complex networks. This inherently bounded metric describes the average angular separation of an input with respect to the past input history. We use this metric to find the minimally novel input that drives a linear network to a desired state using unit average energy. Specifically, the minimally novel input is defined as the solution of a continuous time, non-convex optimal control problem based on the introduced metric. We provide conditions for existence and uniqueness, and an explicit, closed-form expression for the solution. We support our theoretical results by characterizing the minimally novel inputs for an example of a recurrent neuronal network.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Input Novelty as a Control Metric for Time Varying Linear Systems

This paper introduces a framework for quantitative characterization of the controllability of time-varying linear systems (or networks) in terms of input novelty. The motivation for such an approach comes from the study of biophysical sensory networks in the brain, wherein responsiveness to both energy and salience (or novelty) are presumably critical for mediating behavior and function. Here, we use an inner product to define the angular separation of the current input with respect to the past input history. Then, by constraining input energy, we define a non-convex optimal control problem to obtain the minimally novel input that effects a given state transfer. We provide analytical conditions for existence and uniqueness in continuous-time, as well as an explicit closed-form expression for the solution. In discrete time, we show that a relaxed convex optimization formulation provides the global optimal solution of the original non-convex problem. Finally, we show how the minimum novelty control can be used as a metric to study control properties of large scale recurrent neuronal networks and other complex linear systems. In particular, we highlight unique aspects of a system's controllability that are captured through the novelty-based metric. The result suggests that a multifaceted approach, combining energy-based analysis with other specific metrics, may be useful for obtaining more complete controllability characterizations.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

On the output of nonlinear systems excited by discrete prolate spheroidal sequences

The discrete prolate spheroidal sequences (DPSSs) - a set of optimally bandlimited sequences with unique properties - are important to applications in both science and engineering. In this work, properties of nonlinear system response due to DPSS excitation are reported. In particular, this output is shown to be approximately orthogonal after passing through a nonlinear, multiple-input multiple-output system with memory under quite general conditions. This work quantifies these conditions in terms of constraints upon the higher-order generalized transfer functions characterizing the Volterra expansion of a MIMO system, the Volterra order of the system, and the DPSS bandwidth parameter W and time-bandwidth parameter NW. The approximate system output orthogonality allows multiple input, multiple-output parameter identification of edge structure in interconnected nonlinear systems using simultaneous, DPSS excitation. This narrowband method of system identification is particularly appealing when compared to classical broadband system excitation in sensitive, neural engineering applications involving electrical stimulation of multiple brain regions. Through the comparison of inner-product and kernel-based narrowband detectors, the utility of this work is demonstrated when identifying narrowband system response of a third-order Volterra system from noisy observations.

0 citations0 reviewsNo code linkedOpen access