Researcher profile

He

He contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
6works
0followers
6topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

6 published item(s)

preprint2022arXiv

Design of EMG-driven Musculoskeletal Model for Volitional Control of a Robotic Ankle Prosthesis

Existing robotic lower-limb prostheses use autonomous control to address cyclic, locomotive tasks, but they are inadequate to operate the prosthesis for daily activities that are non-cyclic and unpredictable. To address this challenge, this study aims to design a novel electromyography (EMG)-driven musculoskeletal model for volitional control of a robotic ankle-foot prosthesis. This controller places the user in continuous control of the device, allowing them to freely manipulate the prosthesis behavior at will. The Hill-type muscle model was used to model a dorsiflexor and a plantarflexor, which functioned around a virtual ankle joint. The model parameters were determined by fitting the model prediction to the experimental data collected from an able-bodied subject. EMG signals recorded from ankle agonist and antagonist muscle pair were used to activate the virtual muscle models. This model was validated via offline simulations and real-time prosthesis control. Additionally, the feasibility of the proposed prosthesis control on assisting the user's functional tasks was demonstrated. The present control may further improve the function of robotic prosthesis for supporting versatile activities in individuals with lower-limb amputations.

preprint2021arXiv

Reinforcement Learning Control of Robotic Knee with Human in the Loop by Flexible Policy Iteration

We are motivated by the real challenges presented in a human-robot system to develop new designs that are efficient at data level and with performance guarantees such as stability and optimality at systems level. Existing approximate/adaptive dynamic programming (ADP) results that consider system performance theoretically are not readily providing practically useful learning control algorithms for this problem; and reinforcement learning (RL) algorithms that address the issue of data efficiency usually do not have performance guarantees for the controlled system. This study fills these important voids by introducing innovative features to the policy iteration algorithm. We introduce flexible policy iteration (FPI), which can flexibly and organically integrate experience replay and supplemental values from prior experience into the RL controller. We show system level performances including convergence of the approximate value function, (sub)optimality of the solution, and stability of the system. We demonstrate the effectiveness of the FPI via realistic simulations of the human-robot system. It is noted that the problem we face in this study may be difficult to address by design methods based on classical control theory as it is nearly impossible to obtain a customized mathematical model of a human-robot system either online or offline. The results we have obtained also indicate the great potential of RL control to solving realistic and challenging problems with high dimensional control inputs.

preprint2021arXiv

Reinforcement Learning Enabled Automatic Impedance Control of a Robotic Knee Prosthesis to Mimic the Intact Knee Motion in a Co-Adapting Environment

Automatically configuring a robotic prosthesis to fit its user's needs and physical conditions is a great technical challenge and a roadblock to the adoption of the technology. Previously, we have successfully developed reinforcement learning (RL) solutions toward addressing this issue. Yet, our designs were based on using a subjectively prescribed target motion profile for the robotic knee during level ground walking. This is not realistic for different users and for different locomotion tasks. In this study for the first time, we investigated the feasibility of RL enabled automatic configuration of impedance parameter settings for a robotic knee to mimic the intact knee motion in a co-adapting environment. We successfully achieved such tracking control by an online policy iteration. We demonstrated our results in both OpenSim simulations and two able-bodied (AB) subjects.

preprint2020arXiv

Model-Driven Deep Learning for Massive Multiuser MIMO Constant Envelope Precoding

Constant envelope (CE) precoding design is of great interest for massive multiuser multi-input multi-output systems because it can significantly reduce hardware cost and power consumption. However, existing CE precoding algorithms are hindered by excessive computational overhead. In this letter, a novel model-driven deep learning (DL)-based network that combines DL with conjugate gradient algorithm is proposed for CE precoding. Specifically, the original iterative algorithm is unfolded and parameterized by trainable variables. With the proposed architecture, the variables can be learned efficiently from training data through unsupervised learning approach. Thus, the proposed network learns to obtain the search step size and adjust the search direction. Simulation results demonstrate the superiority of the proposed network in terms of multiuser interference suppression capability and computational overhead.

preprint1995arXiv

The Nonresonant Cabibbo Suppressed Decay $B^\pm\to π^+π^-π^\pm$ and Signal for CP Violation

We consider various contributions to the nonresonant decay $B^\pm\rightarrow π^+π^-π^\pm$, both of the long-distance and short-distance types with the former providing for most of the branching ratio, predicted to be $BR(B^\pm\rightarrow π^+π^-π^\pm) = (1.5 - 8.4 )\times 10^{-5}$. We also discuss an application to CP violation resulting from the interference of that nonresonant background (with $m(π^+π^-)\approx 3.4$ GeV) and $B^\pm\rightarrow χ_{c0} π^\pm$ followed by $χ_{c0}\rightarrow π^+π^-$. The resulting value of the partial rate asymmetry is $(0.40\sim 0.48)\mbox{sin}γ$, where $γ= \mbox{arg}(V_{ub}^*)$.

preprint1994arXiv

Amplitude Zeros in Radiative Decays of Scalar Particles

We study amplitude zeros in radiative decay processes with a photon or a gluon emission of all possible scalar particles(e.g. scalar leptoquarks) which may interact with the usual fermions in models beyond the standard model. For the decays with a photon emission, the amplitudes clearly exhibit the factorization property and the differential decay rates vanish at specific values of a certain variable which are determined only by the electric charges of the particles involved and independent of the particle masses and the various couplings. For the decays with a gluon emission, even though the zeros are washed away, the differential decay rates still have distinct minima. The branching ratios as a function of leptoquark masses are presented for the scalar leptoquark decays. We also comment on the decays of vector particles into two fermions and a photon.