Source author record

Wenqi Cai

Wenqi Cai appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

eess.SY Systems and Control quant-ph Machine Learning physics.ins-det

Catalog footprint

What is connected

5works

5topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2024arXiv

Effect of light injection on the security of practical quantum key distribution

Quantum key distribution (QKD) based on the fundamental laws of quantum physics can allow the distribution of secure keys between distant users. However, the imperfections in realistic devices may lead to potential security risks, which must be accurately characterized and considered in practical security analysis. High-speed optical modulators, being as one of the core components of practical QKD systems, can be used to prepare the required quantum states. Here, we find that optical modulators based on LiNbO3, including phase modulators and intensity modulators, are vulnerable to photorefractive effect caused by external light injection. By changing the power of external light, eavesdroppers can control the intensities of the prepared states, posing a potential threat to the security of QKD. We have experimentally demonstrated the influence of light injection on LiNbO3-based optical modulators and analyzed the security risks caused by the potential green light injection attack, along with the corresponding countermeasures.

preprint2022arXiv

Kalman Filter Design for Intermittent Optical Wireless Communication Systems on Time Scales

Time-scale theory, due to its ability to unify the continuous and discrete cases, allows handling intractable non-uniform measurements, such as intermittent received signals. In this work, we address the state estimation problem of a vibration-induced intermittent optical wireless communication (OWC) system by designing a Kalman filter on time scales. First, the algorithm of the time-scale Kalman filter is introduced and a numerical example is given for illustration. Then the studied intermittent OWC system is presented, and experimental data are collected to determine the time scale's form, which has bounded graininess (a.k.a, bounded time jumps). Finally, we design a Kalman filter on the previously defined time scale for the intermittent OWC system and critically analyzed its estimation performance. Moreover, the obtained conclusions are further validated on a reference system. The simulation results corroborate that the time-scale Kalman filtering technique is considerably promising to solve the state estimation problem with non-uniform measurements. This study reveals for the first time the feasibility of applying the time-scale Kalman filter theory to practical applications.

preprint2022arXiv

Quasi-Newton Iteration in Deterministic Policy Gradient

This paper presents a model-free approximation for the Hessian of the performance of deterministic policies to use in the context of Reinforcement Learning based on Quasi-Newton steps in the policy parameters. We show that the approximate Hessian converges to the exact Hessian at the optimal policy, and allows for a superlinear convergence in the learning, provided that the policy parametrization is rich. The natural policy gradient method can be interpreted as a particular case of the proposed method. We analytically verify the formulation in a simple linear case and compare the convergence of the proposed method with the natural policy gradient in a nonlinear example.

preprint2021arXiv

Optimal Management of the Peak Power Penalty for Smart Grids Using MPC-based Reinforcement Learning

The cost of the power distribution infrastructures is driven by the peak power encountered in the system. Therefore, the distribution network operators consider billing consumers behind a common transformer in the function of their peak demand and leave it to the consumers to manage their collective costs. This management problem is, however, not trivial. In this paper, we consider a multi-agent residential smart grid system, where each agent has local renewable energy production and energy storage, and all agents are connected to a local transformer. The objective is to develop an optimal policy that minimizes the economic cost consisting of both the spot-market cost for each consumer and their collective peak-power cost. We propose to use a parametric Model Predictive Control (MPC)-scheme to approximate the optimal policy. The optimality of this policy is limited by its finite horizon and inaccurate forecasts of the local power production-consumption. A Deterministic Policy Gradient (DPG) method is deployed to adjust the MPC parameters and improve the policy. Our simulations show that the proposed MPC-based Reinforcement Learning (RL) method can effectively decrease the long-term economic cost for this smart grid problem.

preprint2014arXiv

A Compact PCI-based Measurement and Control System for Satellite-Ground Quantum Communication

Since the 1990s, there has been a dramatic interest in quantum communication. Free-space quantum communication is being developed to ultra-long distance quantum experiment, which requires higher electronics performance, such as time measurement precision, data-transfer rate, and system integration density. As part of the ground station of quantum experiment satellite that will be launched in 2016, we specifically designed a compact PCI-based multi-channel electronics system with high time-resolution, high data-transfer-rate. The electronics performance of this system was tested. The time bin size is 23.9ps and the time precision root-mean-square (RMS) is less than 24ps for 16 channels. The dead time is 30ns. The data transfer rate to local computer is up to 35 MBps, and the count rate is up to 30M/s. The system has been proven to perform well and operate stably through a test of free space quantum key distribution (QKD) experiment.