Source author record

Qing Zhao

Qing Zhao appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

62works

31topics

4close collaborators

Actions

Connect this record

Open graph Browse works

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

preprint2026arXiv

Modeling and Control for UAV with Off-center Slung Load

Unmanned aerial vehicle (UAV) with slung load system is a classic air transportation system. In practical applications, the suspension point of the slung load does not always align with the center of mass (CoM) of the UAV due to mission requirements or mechanical interference. This offset creates coupling in the system's nonlinear dynamics which leads to a complicated motion control problem. In existing research, modeling of the system are performed about the UAV's CoM. In this work we use the point of suspension instead. Based on the new model, a cascade control strategy is developed. In the middle-loop controller, the acceleration of the suspension point is used to regulate the swing angle of the slung load without the need for considering the coupling between the slung load and the UAV. An inner-loop controller is designed to track the UAV's attitude without the need of simplification on the coupling effects. We prove local exponential stability of the closed-loop using Lyapunov approach. Finally, simulations and experiments are conducted to validate the proposed control system.

preprint2026arXiv

Quadrupole transitions of $^{10}$C and their isospin symmetry with $^{10}$Be

We investigate the structures of $^{10}$C focusing on the quadrupole properties in comparison with the mirror nucleus $^{10}$Be. We describe $^{10}$C and $^{10}$Be in the variation of the multiple bases of the antisymmetrized molecular dynamics (AMD), in which the multiple AMD bases are optimized simultaneously in the total-energy variation. In the monopole transitions, we confirm the isospin symmetry between $^{10}$C and $^{10}$Be by exchanging protons and neutrons. In the quadrupole transitions, most cases show larger values in $^{10}$C than those of $^{10}$Be, except for the transition of $2^+_1\to 0^+_1$. The transition of $2^+_1\to 0^+_1$ shows similar values in the two nuclei in spite of the different proton numbers, which agrees with the experimental situation as an anomaly. This relation comes from the small proton deformation in $^{10}$C due to its subclosed nature and the large proton deformation in $^{10}$Be due to two-$α$ clustering. This property can also be seen in the quadrupole moments of the two nuclei. In the neutron deformations of $^{10}$C and $^{10}$Be, the opposite tendency of protons is confirmed and these results ensure the isospin symmetry between the two nuclei. We also confirm the large quadrupole transitions between the elongated linear-chain states. It would be desirable for future experiments to investigate the present characteristics of the transitions in the two nuclei.

preprint2026arXiv

Shell and cluster structures in $^{20}$Ne in the variation of multiple bases of the antisymmetrized molecular dynamics

We investigate the structures of $^{20}$Ne in the variation of the multiple bases of the antisymmetrized molecular dynamics (AMD). In this method, the multiple AMD bases are superposed and optimized simultaneously in the total-energy variation. This scheme is beneficial for describing the various configurations in $^{20}$Ne. In the results, we confirm the shell and cluster structures in the $K^π=0^+_{1-4}$ bands, such as the deformed states in the $K^π=0^+_{1,4}$ bands with the $α$ cluster development, and the spherical shell-like states in the $K^π=0^+_2$ band, the latter of which is difficult to describe in the previous AMD calculations imposing the quadrupole deformation. We evaluate the monopole and quadrupole transitions in these states. The negative parity states of $^{20}$Ne with $K^π=0^-$ and $2^-$ are discussed in relation to the shell and cluster structures. As a result, six kinds of the $K^π$ bands in $^{20}$Ne are described comprehensively in the microscopic framework of nuclei.

preprint2023arXiv

Towards simultaneous coherent radiation in the visible and microwave bands with doped molecular crystals

Coherent sources exploiting the stimulated emission of non-equilibrium quantum systems, i.e. gain media, have proven indispensable for advancing fundamental research and engineering. The operating electromagnetic bands of such coherent sources have been continuously enriched for increasing demands.Nevertheless, for a single bench top coherent source, simultaneous generation of radiation in multiple bands, especially when the bands are widely separated, present formidable challenges with a single gain medium. Here, we propose a mechanism of simultaneously realizing the stimulated emission of radiation in the visible and microwave bands, i.e. lasing and masing actions, at ambient conditions by utilizing photoexcited singlet and triplet states of the pentacene molecules that are doped in p-terphenyl. The possibility is validated by the observed amplified spontaneous emission (ASE) at 645 nm with a narrow linewidth around 1 nm from the pentacene-doped p-terphenyl crystal used for masing at 1.45 GHz and consolidated by a 20 fold lower threshold of ASE compared to the reported masing threshold. The overall threshold of the pentacene-based multiband coherent source can be optimized by appropriate alignment of the pump-light polarization with the pentacene's transition dipole moment. Our work not only shows a great promise on immediate realization of multiband coherent sources but also establishes an intriguing solid-state platform for fundamental research of quantum optics in multiple frequency domains.

preprint2022arXiv

Efficient measurement of the time-dependent cavity field through compressed sensing

We propose a method based on compressed sensing (CS) to measure the evolution processes of the states of a driven cavity quantum electrodynamics system. In precisely reconstructing the coherent cavity field amplitudes, we have to prepare the same states repetitively and each time perform one measurement with short sampling intervals considering the quantum nature of measurement and the Nyquist-Shannon sampling theorem. However, with the help of CS, the number of measurements can be exponentially reduced without loss of the recovery accuracy. We use largely detuned atoms and control their interactions with the cavity field to modulate coherent state amplitudes according to the scheme encoded in the sensing matrix. The simulation results show that the CS method efficiently recovers the amplitudes of the coherent cavity field even in the presence of noise.

preprint2022arXiv

Enhanced quantum sensing with room-temperature solid-state masers

Quantum sensing with solid-state systems finds broad applications in diverse areas ranging from material and biomedical sciences to fundamental physics. Several solid-state spin sensors have been developed, facilitating the ultra-sensitive detection of physical quantities such as magnetic and electric fields and temperature. Exploiting collective behaviour of non-interacting spins holds the promise of pushing the detection limit to even lower levels, while to date, those levels are scarcely reached due to the broadened linewidth and inefficient readout of solid-state spin ensembles. Here, we experimentally demonstrate that such drawbacks can be overcome by newly reborn maser technology at room temperature in the solid state. Owing to maser action, we observe a 4-fold reduction in the inhomogeneously broadened linewidth of a molecular spin ensemble, which is narrower than the same measured from single spins at cryogenic temperatures. The maser-based readout applied to magnetometry showcases a signal-to-noise ratio (SNR) of 30 dB for single shots. This technique would be a significant addition to the toolbox for boosting the sensitivity of solid-state ensemble spin sensors.

preprint2022arXiv

Far-field diffraction computational imaging based on parameter-robust illumination and direct phase optimization

Coherent diffraction imaging (CDI) is a promising imaging technique revealing most of the information from diffraction measurements. An ideal CDI should reconstruct complex-valued object from a single-shot far-field diffraction without any priori information about the target. To realize the ideal CDI, we propose a class of parameter-robust illumination pattern. A direct phase optimizing algorithm is also raised here to improve the performance of phase retrieval in strong noise. Experimental result demonstrates the efficiency of our scheme in practical noisy measurement for complex-valued target.

preprint2022arXiv

New many-body method using cluster expansion diagrams with tensor-optimized antisymmetrized molecular dynamics

We propose a new many-body method based on the correlation functions, in which the multiple products of the correlation functions are expanded into the many-body diagrams using the cluster expansion method and every diagram is independently optimized in the total-energy variation. We apply this idea to the tensor-optimized antisymmetrized molecular dynamics (TOAMD) using the bare nucleon-nucleon interaction and show the results of the $s$-shell nuclei within the triple products of the correlation functions of tensor and central-types. We evaluate the effect of the independent optimization of the many-body diagrams on the solutions. It is found that the triple products provides the sizable effect in the present scheme, which results in the good reproduction of the total energy and the Hamiltonian components of nuclei with respect to the few-body calculations.

preprint2022arXiv

Provably and Practically Efficient Neural Contextual Bandits

We consider the neural contextual bandit problem. In contrast to the existing work which primarily focuses on ReLU neural nets, we consider a general set of smooth activation functions. Under this more general setting, (i) we derive non-asymptotic error bounds on the difference between an overparameterized neural net and its corresponding neural tangent kernel, (ii) we propose an algorithm with a provably sublinear regret bound that is also efficient in the finite regime as demonstrated by empirical studies. The non-asymptotic error bounds may be of broader interest as a tool to establish the relation between the smoothness of the activation functions in neural contextual bandits and the smoothness of the kernels in kernel bandits.

preprint2022arXiv

Quantitative exploration of the absorber behavior of metal-insulator-metal metamaterials within terahertz via an asymmetric peak model

Terahertz (THz) metamaterials have been developed for THz sensing, detection, imaging, and many other functions due to their unusual absorbers. However, the unusual absorption spectra change with different incident angles. Thus, we designed and fabricated a focal plane array with metal-insulator-metal (MIM) structure metamaterial absorbers for further research. The absorption spectrum with incident angles from 20 to 60 was measured using THz time-domain spectroscopy (THz-TDS), and the experimental results reveal that the absorption spectrum changes with incident angle variations. A basic analytical asymmetric peak model for extracting absorption-frequency characteristics was developed in this study to quantitatively explore this variation in the absorber behavior with incident angles. The best result was that the frequency corresponding to the highest absorption can be easily found using this peak model. The experimental data was coherent with the validation of the asymmetric peak model. Moreover, a second model to quantitatively relate parameters to the incident angle was discovered, allowing for the prediction of absorption spectrum shifts and changes. The absorption spectrum was predicted to have a valley-like absorption curve at particular incident angles based on the secondary models deduction. The proposed extraction method's essential feature is that it can be applied to any physics-based MIM metamaterial system. Such a model will guide the design and optimization of THz metamaterial absorbers, sensors, imagers, and many others.

preprint2022arXiv

Robust quantum control for the manipulation of solid-state spins

Robust and high-fidelity control of electron spins in solids is the cornerstone for facilitating applications of solid-state spins in quantum information processing and quantum sensing. However, precise control of spin systems is always challenging due to the presence of a variety of noises originating from the environment and control fields. Herein, noise-resilient quantum gates, designed with robust optimal control (ROC) algorithms, are demonstrated experimentally with nitrogen-vacancy (NV) centers in diamond to realize tailored robustness against detunings and Rabi errors simultaneously. In the presence of both 10% off-resonant detuning and deviation of a Rabi frequency, we achieve an average single-qubit gate fidelity of up to 99.97%. Our experiments also show that, ROCbased multipulse quantum sensing sequences can suppress spurious responses resulting from finite widths and imperfections of microwave pulses, which provides an efficient strategy for enhancing the performance of existing multipulse quantum sensing sequences.

preprint2022arXiv

Spectroscopy Approaches for Food Safety Applications: Improving Data Efficiency Using Active Learning and Semi-Supervised Learning

The past decade witnesses a rapid development in the measurement and monitoring technologies for food science. Among these technologies, spectroscopy has been widely used for the analysis of food quality, safety, and nutritional properties. Due to the complexity of food systems and the lack of comprehensive predictive models, rapid and simple measurements to predict complex properties in food systems are largely missing. Machine Learning (ML) has shown great potential to improve classification and prediction of these properties. However, the barriers to collect large datasets for ML applications still persists. In this paper, we explore different approaches of data annotation and model training to improve data efficiency for ML applications. Specifically, we leverage Active Learning (AL) and Semi-Supervised Learning (SSL) and investigate four approaches: baseline passive learning, AL, SSL, and a hybrid of AL and SSL. To evaluate these approaches, we collect two spectroscopy datasets: predicting plasma dosage and detecting foodborne pathogen. Our experimental results show that, compared to the de facto passive learning approach, AL and SSL methods reduce the number of labeled samples by 50% and 25% for each ML application, respectively.

preprint2022arXiv

The Charging Performance of Su-Schrieffer-Heeger Quantum Battery

The Su-Schrieffer-Heeger (SSH) model has recently received considerable attention in condensed matter because it describes a typical one-dimensional system with topological edge states. Here, we investigate SSH-based charging protocols of quantum batteries (QB) with N quantum cells. This SSH QB hopping interaction induced ground state splitting makes the different effects of the dimerize parameter to the QB in the different quantum phase region. In the non-splitting region, the dimerize parameter has little influence on the QB. Whereas the fully-splitting region, the dimerize parameter has a significantly quantum advantage to the energy and ergotropy in the ground state fully splitting region, which leads the dimerize spin couples will have larger occupations than other spins. Although we have enhanced energy and ergotropy by the dimerize parameter, QB's capacity will decrease.

preprint2022arXiv

Ultralow-threshold green fluorescent protein laser based on high Q microbubble resonators

Biological lasers have attracted vast attention because of their potential medical application prospects, especially the low threshold biological laser, which can be used for ultrasensitive biological detection while ensuring that its luminous gain medium is not damaged by the high-energy pump light. By coupling the low concentration green fluorescent protein (GFP) solution with a high Q whispering gallery mode microbubble resonator, we managed to fabricate a miniature GFP laser with ultralow lasing threshold of 500 nJ/mm^2. The energy used to excite the GFP can be reduced to 380 fJ, two orders of magnitude lower than that of the lowest excitation energy GFP laser known. The Q value of the optical cavity in this biological laser is 5.3 x 10^7, the highest among GFP lasers at present. We further confirmed the long-term stability of the working characteristics of GFP laser for the first time and found that its optical characteristics can be maintained for at least 23 days. Finally, we measured the effects of different concentrations of fluorescent protein on the laser threshold. The data show that this biological laser can be used for a highly sensitive detection of GFP concentration.

preprint2021arXiv

Active Anomaly Detection with Switching Cost

The problem of detecting a single anomalous process among multiple independent processes is considered. Under a constraint on the number of processes that can be probed simultaneously, the decision maker should decide which processes to probe at each time and when to terminate the probing. Compared with previous work considering only the observation costs, the switching costs of switchings across processes also need to be taken into account in many practical scenarios. The objective is an active inference strategy that minimizes the Bayesian risk taking into account of the sample complexity, switching cost, as well as detection errors. Based on the framework of sequential design of experiments, we propose a low-complexity, low-switching deterministic policy for two scenarios where the total switching cost is negligible and the total switching cost is comparable to the total observation cost. We show that the proposed algorithm is asymptotically optimal in the former scenario and is order optimal in the latter scenario. Simulation results demonstrate strong performance in the finite regime for both scenarios.

preprint2021arXiv

Role of unitary correlation operator on high-momentum antisymmetrized molecular dynamics using bare NN interaction for 3H and 4He

We extend the high-momentum antisymmetrized molecular dynamics (HMAMD) by incorporating the short-range part of the unitary correlation operator method (UCOM) as the variational method of finite nuclei. In this HMAMD+UCOM calculation of light nuclei, the HMAMD is mainly in charge of the tensor correlation with up to the four-body correlation, while the short-range correlation is further improved by using the UCOM. The binding energies of the 3H and 4He nuclei are calculated with this HMAMD+UCOM using the AV8' bare nucleon-nucleon (NN) interaction. The different roles of the short-range and tensor correlations from the HMAMD and UCOM are analyzed in the numerical results. Compared with the previous calculations based on the different variational methods, this newly extended HMAMD+UCOM method can almost provide the consistent results with the ab initio results.

preprint2020arXiv

A class of two or three weights linear codes and their complete weight enumerators

In the past few years, linear codes with few weights and their weight analysis have been widely studied. In this paper, we further investigate a class of two-weight or three-weight linear codes from defining sets and determine their weight and complete weight enumerators by application of the theory of quadratic forms and some special Weil sums over finite fields. Some punctured codes of the discussed linear codes are optimal or almost optimal with respect to the Griesmer bound. This paper generalizes some results in \cite{ZhuXu2017,Jian2019}.

preprint2020arXiv

AstroCatR: a Mechanism and Tool for Efficient Time Series Reconstruction of Large-Scale Astronomical Catalogues

Time series data of celestial objects are commonly used to study valuable and unexpected objects such as extrasolar planets and supernova in time domain astronomy. Due to the rapid growth of data volume, traditional manual methods are becoming extremely hard and infeasible for continuously analyzing accumulated observation data. To meet such demands, we designed and implemented a special tool named AstroCatR that can efficiently and flexibly reconstruct time series data from large-scale astronomical catalogues. AstroCatR can load original catalogue data from Flexible Image Transport System (FITS) files or databases, match each item to determine which object it belongs to, and finally produce time series datasets. To support the high-performance parallel processing of large-scale datasets, AstroCatR uses the extract-transform-load (ETL) preprocessing module to create sky zone files and balance the workload. The matching module uses the overlapped indexing method and an in-memory reference table to improve accuracy and performance. The output of AstroCatR can be stored in CSV files or be transformed other into formats as needed. Simultaneously, the module-based software architecture ensures the flexibility and scalability of AstroCatR. We evaluated AstroCatR with actual observation data from The three Antarctic Survey Telescopes (AST3). The experiments demonstrate that AstroCatR can efficiently and flexibly reconstruct all time series data by setting relevant parameters and configuration files. Furthermore, the tool is approximately 3X faster than methods using relational database management systems at matching massive catalogues.

preprint2020arXiv

Distributed No-Regret Learning in Multi-Agent Systems

In this tutorial article, we give an overview of new challenges and representative results on distributed no-regret learning in multi-agent systems modeled as repeated unknown games. Four emerging game characteristics---dynamicity, incomplete and imperfect feedback, bounded rationality, and heterogeneity---that challenge canonical game models are explored. For each of the four characteristics, we illuminate its implications and ramifications in game modeling, notions of regret, feasible game outcomes, and the design and analysis of distributed learning algorithms.

preprint2020arXiv

DymSLAM:4D Dynamic Scene Reconstruction Based on Geometrical Motion Segmentation

Most SLAM algorithms are based on the assumption that the scene is static. However, in practice, most scenes are dynamic which usually contains moving objects, these methods are not suitable. In this paper, we introduce DymSLAM, a dynamic stereo visual SLAM system being capable of reconstructing a 4D (3D + time) dynamic scene with rigid moving objects. The only input of DymSLAM is stereo video, and its output includes a dense map of the static environment, 3D model of the moving objects and the trajectories of the camera and the moving objects. We at first detect and match the interesting points between successive frames by using traditional SLAM methods. Then the interesting points belonging to different motion models (including ego-motion and motion models of rigid moving objects) are segmented by a multi-model fitting approach. Based on the interesting points belonging to the ego-motion, we are able to estimate the trajectory of the camera and reconstruct the static background. The interesting points belonging to the motion models of rigid moving objects are then used to estimate their relative motion models to the camera and reconstruct the 3D models of the objects. We then transform the relative motion to the trajectories of the moving objects in the global reference frame. Finally, we then fuse the 3D models of the moving objects into the 3D map of the environment by considering their motion trajectories to obtain a 4D (3D+time) sequence. DymSLAM obtains information about the dynamic objects instead of ignoring them and is suitable for unknown rigid objects. Hence, the proposed system allows the robot to be employed for high-level tasks, such as obstacle avoidance for dynamic objects. We conducted experiments in a real-world environment where both the camera and the objects were moving in a wide range.

preprint2020arXiv

Evolution of clustering structure through the momentum distributions in $^{8-10}$Be isotopes

We investigate the evolution of clustering structure through the momentum distributions in the $^{8-10}$Be isotopes. The nucleon dynamics within the inter-cluster antisymmetrization are discussed via the momentum distribution of a Brink type $α$-$α$ wave function. For the state with a small $α$-$α$ distance, we observe a significant depression with a dip structure at zero-momentum and an enhanced tail at relatively higher momentum region. In addition, we find the "cluster structure" in the intrinsic frame of momentum space, which is complementary to its significant $α$-cluster dissolution in the coordinate space because of the strong antisymmetrization. For the physical $^{8-10}$Be isotopes, the Tohsaki-Horiuchi-Schuck-R{ö}pke (THSR) wave functions are adopted. The evolution from the dilute clustering state to the compact one is demonstrated by a successive depression at the zero-momentum of nucleon distribution for the two $α$-clusters within $^{8-10}$Be isotopes. For the compact $^{10}$Be nucleus, the momentum distribution of all nucleons shows significant depression at zero-momentum with a dip structure, which is found to be contributed by both the inter-cluster antisymmetrization and the $p$-orbit occupation of the valence neutrons. This study proposes a new window for the investigations of the $α$-clustering effects via the low-momentum components of nuclei, which is expected to be extended to the heavier nuclear clustering states.

preprint2020arXiv

Stochastic Coordinate Minimization with Progressive Precision for Stochastic Convex Optimization

A framework based on iterative coordinate minimization (CM) is developed for stochastic convex optimization. Given that exact coordinate minimization is impossible due to the unknown stochastic nature of the objective function, the crux of the proposed optimization algorithm is an optimal control of the minimization precision in each iteration. We establish the optimal precision control and the resulting order-optimal regret performance for strongly convex and separably nonsmooth functions. An interesting finding is that the optimal progression of precision across iterations is independent of the low-dimensional CM routine employed, suggesting a general framework for extending low-dimensional optimization routines to high-dimensional problems. The proposed algorithm is amenable to online implementation and inherits the scalability and parallelizability properties of CM for large-scale optimization. Requiring only a sublinear order of message exchanges, it also lends itself well to distributed computing as compared with the alternative approach of coordinate gradient descent.

preprint2020arXiv

Stochastic Gradient Descent on a Tree: an Adaptive and Robust Approach to Stochastic Convex Optimization

Online minimization of an unknown convex function over the interval $[0,1]$ is considered under first-order stochastic bandit feedback, which returns a random realization of the gradient of the function at each query point. Without knowing the distribution of the random gradients, a learning algorithm sequentially chooses query points with the objective of minimizing regret defined as the expected cumulative loss of the function values at the query points in excess to the minimum value of the function. An approach based on devising a biased random walk on an infinite-depth binary tree constructed through successive partitioning of the domain of the function is developed. Each move of the random walk is guided by a sequential test based on confidence bounds on the empirical mean constructed using the law of the iterated logarithm. With no tuning parameters, this learning algorithm is robust to heavy-tailed noise with infinite variance and adaptive to unknown function characteristics (specifically, convex, strongly convex, and nonsmooth). It achieves the corresponding optimal regret orders (up to a $\sqrt{\log T}$ or a $\log\log T$ factor) in each class of functions and offers better or matching regret orders than the classical stochastic gradient descent approach which requires the knowledge of the function characteristics for tuning the sequence of step-sizes.

preprint2020arXiv

The photon vortex beam in rotating medium

In this paper we consider the photon vortex beam in the rotating medium, where the rotating velocity acts as an effective vector potential. Using the Riemann-Silberstein vector, we construct the photon wave function. Using the Maxwell equations and the first-order Minkowski constitutive relations we get the dynamic equations of photon in moving medium. For the stationary states, the dynamic equations can be written as a Dirac-like equation. We obtain the approximate photon vortex beam solutions by the given the medium's different velocity distribution and find the diffracting and nondiffracting Laguerre-Gaussian beam solutions in the rotating medium. For the diffracting Laguerre-Gaussian beams, we acquire new terms arising from the rotation that can change the Gouy phase, and then accordingly infer the rotation behavior of the photon interference pattern. Furthermore, in our theory we obtain the Landau levels structure of transverse photon energy in the nondiffracting Laguerre-Gaussian beam solutions.

preprint2020arXiv

Theory of exciton transport in molecular crystals strongly coupled to a cavity: A temperature-dependent variational approach

We present a semianalytical theory for exciton transport in organic molecular crystals interacting strongly with a single cavity mode. Based on the Holstein-Tavis-Cummings model and the Kubo formula, we derive an exciton mobility expression in the framework of a temperature-dependent variational canonical transformation, which can cover a wide range of exciton-vibration coupling, exciton-cavity coupling, and temperatures. A closed-form expression for the coherent part of the total mobility is obtained in the zeroth order of the exciton-vibration coupling, which demonstrates the significance of vibrationally dressed dark excitons in the determination of the transport mechanism. By performing numerical simulations on both the H- and J-aggregates, we find that the exciton-cavity coupling has significant effects on the total mobility: 1) At low temperatures, there exists an optimal exciton-cavity coupling strength for the H-aggregate at which a maximal mobility is reached, while the mobility in the J-aggregate decreases monotonically with increasing exciton-cavity coupling; 2) At high temperatures, the mobility in both types of aggregates get enhanced by the cavity. We illustrate the above-mentioned low-temperature optimal mobility observed in the H-aggregate by using realistic parameters at room temperature.

preprint2019arXiv

Searching for Anomalies over Composite Hypotheses

The problem of detecting anomalies in multiple processes is considered. We consider a composite hypothesis case, in which the measurements drawn when observing a process follow a common distribution with an unknown parameter (vector), whose value lies in normal or abnormal parameter spaces, depending on its state. The objective is a sequential search strategy that minimizes the expected detection time subject to an error probability constraint. We develop a deterministic search algorithm with the following desired properties. First, when no additional side information on the process states is known, the proposed algorithm is asymptotically optimal in terms of minimizing the detection delay as the error probability approaches zero. Second, when the parameter value under the null hypothesis is known and equal for all normal processes, the proposed algorithm is asymptotically optimal as well, with better detection time determined by the true null state. Third, when the parameter value under the null hypothesis is unknown, but is known to be equal for all normal processes, the proposed algorithm is consistent in terms of achieving error probability that decays to zero with the detection delay. Finally, an explicit upper bound on the error probability under the proposed algorithm is established for the finite sample regime. Extensive experiments on synthetic dataset and DARPA intrusion detection dataset are conducted, demonstrating strong performance of the proposed algorithm over existing methods.

preprint2019arXiv

The field-induced interaction between non-resonant magnetic dipoles

We make a general derivation for the magnetic dipole-dipole interaction based on the mediation of the quantized electro-magnetic field. Due to the interaction with the dipoles, the dynamics of the field is added by a dipole field, which finally gives rise to the dipole-dipole interaction. Different from previous studies, the rotating-wave-approximation is no longer needed throughout this derivation, and our result naturally gives the interaction for non-resonant dipoles. Moreover, our derivation also gives the counter-rotating interaction terms, and even the mixed interaction terms between the permanent and transition dipoles. We notice that this field-induced interaction is associated with the interference of the virtual/real photons emitted from the two dipoles, thus the interaction strength could be influenced by the frequency difference of the two dipoles.

preprint2016arXiv

Achieving acoustic cloak by using compressible background flow

We propose a scheme of acoustic spherical cloaking by means of background irrotational flow in compressible fluid. The background flow forms a virtual curved spacetime and guides the sound waves bypass the cloaked objects. To satisfy the laws of real fluid, we show that spatially distributed mass source and momentum source are necessary to supply. The propagation of sound waves in this system is studied via both geometric acoustics approximation and full wave approach. The analytic solution of sound fields is obtained for plane wave incidence. The results reveal the effect of phase retardation (or lead) in comparison with the ordinary transformation-acoustic cloak. In addition, the ability of cloaking is also evaluated for unideal background flows by analyzing the scattering cross section.

preprint2016arXiv

Efficient phase retrieval based on dark fringe recognition with an ability of bypassing invalid fringes

This paper discusses the noisy phase retrieval problem: recovering a complex image signal with independent noise from quadratic measurements. Inspired by the dark fringes shown in the measured images of the array detector, a novel phase retrieval approach is proposed and demonstrated both theoretically and experimentally to recognize the dark fringes and bypass the invalid fringes. A more accurate relative phase ratio between arbitrary two pixels is achieved by calculating the multiplicative ratios (or the sum of phase difference) on the path between them. Then the object phase image can be reconstructed precisely. Our approach is a good choice for retrieving high-quality phase images from noisy signals and has many potential applications in the fields such as X-ray crystallography, diffractive imaging, and so on.

preprint2016arXiv

Minimum Number of Copies in the Measurement of Multi-Photon Entanglement

Multi-photon entanglement has been successfully made by experimental groups. As the increase of photon number, several problems are encountered, say, greater number of copies, longer time, the error of fidelity and so on. In this paper, we present a new scheme based on Lagrange multiplier and feedback to save the measure copies in multi-photon experiment and five percent of measuring time, also guarantee the acceptable error of fidelity. All the results have been supported by the data of eight photon experiment. Furthermore, same approach is applied in the simulation for ten photon entanglement, and 22.45 percent of copies are saved, optimized copy distribution gives better estimation of fidelity than the average copy distribution.

preprint2016arXiv

Online Learning and Optimization of Markov Jump Affine Models

The problem of online learning and optimization of unknown Markov jump affine models is considered. An online learning policy, referred to as Markovian simultaneous perturbations stochastic approximation (MSPSA), is proposed for two different optimization objectives: (i) the quadratic cost minimization of the regulation problem and (ii) the revenue (profit) maximization problem. It is shown that the regret of MSPSA grows at the order of the square root of the learning horizon. Furthermore, by the use of van Trees inequality, it is shown that the regret of any policy grows no slower than that of MSPSA, making MSPSA an order optimal learning policy. In addition, it is also shown that the MSPSA policy converges to the optimal control input almost surely as well as in the mean square sense. Simulation results are presented to illustrate the regret growth rate of MSPSA and to show that MSPSA can offer significant gain over the greedy certainty equivalent approach.

preprint2015arXiv

Direct Observation of Early-stage Quantum Dot Growth Mechanisms with High-temperature Ab Initio Molecular Dynamics

Colloidal quantum dots (QDs) exhibit highly desirable size- and shape-dependent properties for applications from electronic devices to imaging. Indium phosphide QDs have emerged as a primary candidate to replace the more toxic CdSe QDs, but production of InP QDs with the desired properties lags behind other QD materials due to a poor understanding of how to tune the growth process. Using high-temperature ab initio molecular dynamics (AIMD) simulations, we report the first direct observation of the early stage intermediates and subsequent formation of an InP cluster from separated indium and phosphorus precursors. In our simulations, indium agglomeration precedes formation of In-P bonds. We observe a predominantly intercomplex pathway in which In-P bonds form between one set of precursor copies while the carboxylate ligand of a second indium precursor in the agglomerated indium abstracts a ligand from the phosphorus precursor. This process produces an indium-rich cluster with structural properties comparable to those in bulk zinc-blende InP crystals. Minimum energy pathway characterization of the AIMD-sampled reaction events confirms these observations and identifies that In-carboxylate dissociation energetics solely determine the barrier along the In-P bond formation pathway, which is lower for intercomplex (13 kcal/mol) than intracomplex (21 kcal/mol) mechanisms. The phosphorus precursor chemistry, on the other hand, controls the thermodynamics of the reaction. Our observations of the differing roles of precursors in controlling QD formation strongly suggests that the challenges thus far encountered in InP QD synthesis optimization may be attributed to an overlooked need for a cooperative tuning strategy that simultaneously addresses the chemistry of both indium and phosphorus precursors.

preprint2015arXiv

The Double Jones Birefringence in Magneto-electric Medium

In this paper, the Maxwell's equations for the tensorial magneto-electric (ME) medium have been solved which in fact is the extension of anisotropic nonmagnetic medium. All of the dielectric permittivity, magnetic permeability and the ME tensors are considered. The transverse polarization is shown explicitly and the propagation of electromagnetic wave in the ME medium is found to have the Double Jones Birefringence. We also find the condition of D'yakonov surface wave for magneto-isotropic but with ME anisotropic medium. Especially when the incident angle is $\fracπ{4}$, it may be measurable in principle.

preprint2015arXiv

Time Circular Birefringence in Time-Dependent Magnetoelectric Media

Light traveling in time-dependent media has many extraordinary properties which can be utilized to convert frequency, achieve temporal cloaking, and simulate cosmological phenomena. In this paper, we focus on time-dependent axion-type magnetoelectric (ME) media, and prove that light in these media always has two degenerate modes with opposite circular polarizations corresponding to one wave vector $\mathbf{k}$, and name this effect "time circular birefringence" (TCB). By interchanging the status of space and time, the pair of TCB modes can appear simultaneously via "time refraction" and "time reflection" of a linear polarized incident wave at a time interface of ME media. The superposition of the two TCB modes causes the "time Faraday effect", namely the globally unified polarization axes rotate with time. A circularly polarized Gaussian pulse traversing a time interface is also studied. If the wave-vector spectrum of a pulse mainly concentrates in the non-traveling-wave band, the pulse will be trapped with nearly fixed center while its intensity will grow rapidly. In addition, we propose an experimental scheme of using molecular fluid with external time-varying electric and magnetic fields both parallel to the direction of light to realize these phenomena in practice.

preprint2015arXiv

Uncertainty principle, Shannon-Nyquist sampling and beyond

Donoho and Stark have shown that a precise deterministic recovery of missing information contained in a time interval shorter than the time-frequency uncertainty limit is possible. We analyze this signal recovery mechanism from a physics point of view and show that the well-known Shannon-Nyquist sampling theorem, which is fundamental in signal processing, also uses essentially the same mechanism. The uncertainty relation in the context of information theory, which is based on Fourier analysis, provides a criterion to distinguish Shannon-Nyquist sampling from compressed sensing. A new signal recovery formula, which is analogous to Donoho-Stark formula, is given using the idea of Shannon-Nyquist sampling; in this formulation, the smearing of information below the uncertainty limit as well as the recovery of information with specified bandwidth take place. We also discuss the recovery of states from the domain below the uncertainty limit of coordinate and momentum in quantum mechanics and show that in principle the state recovery works by assuming ideal measurement procedures. The recovery of the lost information in the sub-uncertainty domain means that the loss of information in such a small domain is not fatal, which is in accord with our common understanding of the uncertainty principle, although its precise recovery is something we are not used to in quantum mechanics. The uncertainty principle provides a universal sampling criterion covering both the classical Shannon-Nyquist sampling theorem and the quantum mechanical measurement.

preprint2014arXiv

Active Hypothesis Testing for Quickest Anomaly Detection

The problem of quickest detection of an anomalous process among M processes is considered. At each time, a subset of the processes can be observed, and the observations from each chosen process follow two different distributions, depending on whether the process is normal or abnormal. The objective is a sequential search strategy that minimizes the expected detection time subject to an error probability constraint. This problem can be considered as a special case of active hypothesis testing first considered by Chernoff in 1959 where a randomized strategy, referred to as the Chernoff test, was proposed and shown to be asymptotically (as the error probability approaches zero) optimal. For the special case considered in this paper, we show that a simple deterministic test achieves asymptotic optimality and offers better performance in the finite regime. We further extend the problem to the case where multiple anomalous processes are present. In particular, we examine the case where only an upper bound on the number of anomalous processes is known.

preprint2014arXiv

An online learning approach to dynamic pricing for demand response

In this paper, the problem of optimal dynamic pricing for retail electricity with an unknown demand model is considered. Under the day-ahead dynamic pricing (a.k.a. real time pricing) mechanism, a retailer obtains electricity in a twosettlement wholesale market and serves its customers in real time. Without knowledge on the aggregated demand function of its customers, the retailer aims to maximize its retail surplus by sequentially adjusting its price based on the behavior of its customers in the past. An online learning algorithm, referred to as piecewise linear stochastic approximation (PWLSA), is proposed. It is shown that PWLSA achieves the optimal rate of learning defined by the growth rate of cumulative regret. In particular, the regret of PWLSA is shown to grow logarithmically with respect to the learning horizon, and no other on-line learning algorithm can have the growth rate slower than that of PWLSA. Simulation studies are presented using traces of actual day-ahead prices, and PWLSA compares favorably under both static and dynamically changing parameters.

preprint2014arXiv

Density matrix and fidelity estimation of multiphoton entanglement via phaselift

The experiments of multi-photon entanglements have been made by some groups, including Pan's group (Ref.[2],[3],[5]). Obviously, the increase number of the photon would cause a dramatically increase in the dimension of the measurement matrix, which result in a great consumption of time in the measurements. From a practical view, we wish to gain the most information through as little measurements as possible for the multi-photon entanglements. The low rank matrix recovery (LRMR) provides such a possibility to resolve all the issues of the measurement matrix based on less data. In this paper, we would like to verify that whether the LRMR works for six qubits and eight photons in comparison to the data given by Pan's group, i.e. we input a fraction of the data to calculate all of others. Through exploring their density matrix, fidelity and visibility, we find that the results remain consistent with the data provided by Pan's group, which allows us to confirm that the LRMR can simplify experimental measure- ments for more photons. In particular, we find that very limited data would also give excellent support to the experiment for fidelity when low rank, pure state, sparse or position information are utilized. Our analytical calculations confirm that LRMR would generalize to multi-photon state entanglement.

preprint2014arXiv

Minimum Information Dominating Set for Opinion Sampling

We consider the problem of inferring the opinions of a social network through strategically sampling a minimum subset of nodes by exploiting correlations in node opinions. We first introduce the concept of information dominating set (IDS). A subset of nodes in a given network is an IDS if knowing the opinions of nodes in this subset is sufficient to infer the opinion of the entire network. We focus on two fundamental algorithmic problems: (i) given a subset of the network, how to determine whether it is an IDS; (ii) how to construct a minimum IDS. Assuming binary opinions and the local majority rule for opinion correlation, we show that the first problem is co-NP-complete and the second problem is NP-hard in general networks. We then focus on networks with special structures, in particular, acyclic networks. We show that in acyclic networks, both problems admit linear-complexity solutions by establishing a connection between the IDS problems and the vertex cover problem. Our technique for establishing the hardness of the IDS problems is based on a novel graph transformation that transforms the IDS problems in a general network to that in an odd-degree network. This graph transformation technique not only gives an approximation algorithm to the IDS problems, but also provides a useful tool for general studies related to the local majority rule. Besides opinion sampling for applications such as political polling and market survey, the concept of IDS and the results obtained in this paper also find applications in data compression and identifying critical nodes in information networks.

preprint2014arXiv

Optimal Index Policies for Anomaly Localization in Resource-Constrained Cyber Systems

The problem of anomaly localization in a resource-constrained cyber system is considered. Each anomalous component of the system incurs a cost per unit time until its anomaly is identified and fixed. Different anomalous components may incur different costs depending on their criticality to the system. Due to resource constraints, only one component can be probed at each given time. The observations from a probed component are realizations drawn from two different distributions depending on whether the component is normal or anomalous. The objective is a probing strategy that minimizes the total expected cost, incurred by all the components during the detection process, under reliability constraints. We consider both independent and exclusive models. In the former, each component can be abnormal with a certain probability independent of other components. In the latter, one and only one component is abnormal. We develop optimal simple index policies under both models. The proposed index policies apply to a more general case where a subset (more than one) of the components can be probed simultaneously and have strong performance as demonstrated by simulation examples. The problem under study also finds applications in spectrum scanning in cognitive radio networks and event detection in sensor networks.

preprint2013arXiv

Deterministic Sequencing of Exploration and Exploitation for Multi-Armed Bandit Problems

In the Multi-Armed Bandit (MAB) problem, there is a given set of arms with unknown reward models. At each time, a player selects one arm to play, aiming to maximize the total expected reward over a horizon of length T. An approach based on a Deterministic Sequencing of Exploration and Exploitation (DSEE) is developed for constructing sequential arm selection policies. It is shown that for all light-tailed reward distributions, DSEE achieves the optimal logarithmic order of the regret, where regret is defined as the total expected reward loss against the ideal case with known reward models. For heavy-tailed reward distributions, DSEE achieves O(T^1/p) regret when the moments of the reward distributions exist up to the pth order for 1<p<=2 and O(T^1/(1+p/2)) for p>2. With the knowledge of an upperbound on a finite moment of the heavy-tailed reward distributions, DSEE offers the optimal logarithmic regret order. The proposed DSEE approach complements existing work on MAB by providing corresponding results for general reward distributions. Furthermore, with a clearly defined tunable parameter-the cardinality of the exploration sequence, the DSEE approach is easily extendable to variations of MAB, including MAB with various objectives, decentralized MAB with multiple players and incomplete reward observations under collisions, MAB with unknown Markov dynamics, and combinatorial MAB with dependent arms that often arise in network optimization problems such as the shortest path, the minimum spanning, and the dominating set problems under unknown random weights.

preprint2013arXiv

Factorized Three-body S-Matrix Restrained by Yang-Baxter Equation and Quantum Entanglements

This paper investigates the physical effects of Yang-Baxter equation (YBE) to quantum entanglements through the 3-body S-matrix in entangling parameter space. The explicit form of 3-body S-matrix $\breve{R}_{123}(θ,φ)$ based on the 2-body S-matrices is given due to the factorization condition of YBE. The corresponding chain Hamiltonian has been obtained and diagonalized, also the Berry phase for 3-body system is given. It turns out that by choosing different spectral parameters the $\breve{R}(θ,φ)$-matrix gives GHZ and W state respectively. The extended 1-D Kitaev toy model has been derived. Examples of the role of the model in entanglement transfer are discussed.

preprint2013arXiv

The Thinnest Path Problem

We formulate and study the thinnest path problem in wireless ad hoc networks. The objective is to find a path from a source to its destination that results in the minimum number of nodes overhearing the message by a judicious choice of relaying nodes and their corresponding transmission power. We adopt a directed hypergraph model of the problem and establish the NP-completeness of the problem in 2-D networks. We then develop two polynomial-time approximation algorithms that offer $\sqrt{\frac{n}{2}}$ and $\frac{n}{2\sqrt{n-1}}$ approximation ratios for general directed hypergraphs (which can model non-isomorphic signal propagation in space) and constant approximation ratios for ring hypergraphs (which result from isomorphic signal propagation). We also consider the thinnest path problem in 1-D networks and 1-D networks embedded in 2-D field of eavesdroppers with arbitrary unknown locations (the so-called 1.5-D networks). We propose a linear-complexity algorithm based on nested backward induction that obtains the optimal solution to both 1-D and 1.5-D networks. This algorithm does not require the knowledge of eavesdropper locations and achieves the best performance offered by any algorithm that assumes complete location information of the eavesdroppers.

preprint2012arXiv

Adaptive Shortest-Path Routing under Unknown and Stochastically Varying Link States

We consider the adaptive shortest-path routing problem in wireless networks under unknown and stochastically varying link states. In this problem, we aim to optimize the quality of communication between a source and a destination through adaptive path selection. Due to the randomness and uncertainties in the network dynamics, the quality of each link varies over time according to a stochastic process with unknown distributions. After a path is selected for communication, the aggregated quality of all links on this path (e.g., total path delay) is observed. The quality of each individual link is not observable. We formulate this problem as a multi-armed bandit with dependent arms. We show that by exploiting arm dependencies, a regret polynomial with network size can be achieved while maintaining the optimal logarithmic order with time. This is in sharp contrast with the exponential regret order with network size offered by a direct application of the classic MAB policies that ignore arm dependencies. Furthermore, our results are obtained under a general model of link-quality distributions (including heavy-tailed distributions) and find applications in cognitive radio and ad hoc networks with unknown and dynamic communication environments.

preprint2012arXiv

Distributed Flow Scheduling in an Unknown Environment

Flow scheduling tends to be one of the oldest and most stubborn problems in networking. It becomes more crucial in the next generation network, due to fast changing link states and tremendous cost to explore the global structure. In such situation, distributed algorithms often dominate. In this paper, we design a distributed virtual game to solve the flow scheduling problem and then generalize it to situations of unknown environment, where online learning schemes are utilized. In the virtual game, we use incentives to stimulate selfish users to reach a Nash Equilibrium Point which is valid based on the analysis of the `Price of Anarchy'. In the unknown-environment generalization, our ultimate goal is the minimization of cost in the long run. In order to achieve balance between exploration of routing cost and exploitation based on limited information, we model this problem based on Multi-armed Bandit Scenario and combined newly proposed DSEE with the virtual game design. Armed with these powerful tools, we find a totally distributed algorithm to ensure the logarithmic growing of regret with time, which is optimum in classic Multi-armed Bandit Problem. Theoretical proof and simulation results both affirm this claim. To our knowledge, this is the first research to combine multi-armed bandit with distributed flow scheduling.

preprint2012arXiv

Dynamic Pricing under Finite Space Demand Uncertainty: A Multi-Armed Bandit with Dependent Arms

We consider a dynamic pricing problem under unknown demand models. In this problem a seller offers prices to a stream of customers and observes either success or failure in each sale attempt. The underlying demand model is unknown to the seller and can take one of N possible forms. In this paper, we show that this problem can be formulated as a multi-armed bandit with dependent arms. We propose a dynamic pricing policy based on the likelihood ratio test. We show that the proposed policy achieves complete learning, i.e., it offers a bounded regret where regret is defined as the revenue loss with respect to the case with a known demand model. This is in sharp contrast with the logarithmic growing regret in multi-armed bandit with independent arms.

preprint2012arXiv

Dynamic Shortest Path Algorithms for Hypergraphs

A hypergraph is a set V of vertices and a set of non-empty subsets of V, called hyperedges. Unlike graphs, hypergraphs can capture higher-order interactions in social and communication networks that go beyond a simple union of pairwise relationships. In this paper, we consider the shortest path problem in hypergraphs. We develop two algorithms for finding and maintaining the shortest hyperpaths in a dynamic network with both weight and topological changes. These two algorithms are the first to address the fully dynamic shortest path problem in a general hypergraph. They complement each other by partitioning the application space based on the nature of the change dynamics and the type of the hypergraph.

preprint2012arXiv

Single photon counting imaging system via compressive sensing

An imaging system based on single photon counting and compressive sensing (ISSPCCS) is developed to reconstruct a sparse image in absolute darkness. The single photon avalanche detector and spatial light modulator (SLM) of aluminum micro-mirrors are employed in the imaging system while the convex optimization is used in the reconstruction algorithm. The image of an object in the very dark light can be reconstructed from an under-sampling data set, but with very high SNR and robustness. Compared with the traditional single-pixel camera used a photomultiplier tube (PMT) as the detector, the ISSPCCS realizes photon counting imaging, and the count of photons not only carries fluctuations of light intensity, but also is more intuitive.

preprint2012arXiv

Topological Basis Associated with BWMA, Extremes of L1-norm in Quantum Information and Applications in Physics

The topological basis associated with Birman-Wenzl-Murakami algebra (BWMA) is constructed and the three dimensional forms of braiding matrices S have been found for both $S^+=S$ and $S^+=S^{-1}$. A familiar spin-1 model related to braiding matrix associated with BWMA is discussed. The extreme points $(θ=\pmπ/2$ and $\pmπ)$ of L1-norm and von Neumann entropy are shown to be connected to each other. Through the general discussion and examples we then point out that the L1-norm describes quantum entanglement.

preprint2011arXiv

A Note on: `Algorithms for Connected Set Cover Problem and Fault-Tolerant Connected Set Cover Problem'

A flaw in the greedy approximation algorithm proposed by Zhang et al. for minimum connected set cover problem is corrected, and a stronger result on the approximation ratio of the modified greedy algorithm is established. The results are now consistent with the existing results on connected dominating set problem which is a special case of the minimum connected set cover problem.

preprint2011arXiv

Analytical form of light-ray tracing in invisibility cloaks

In this paper, we review the methodology of transformation optics, which can construct invisibility cloak through the transformation of coordinates based on the form invariance of Maxwell's equations. Three different ways to define the components of electromagnetic fields are compared for removing some ambiguities. The analytical expressions of light-ray and wave-normal ray are derived in spherical and cylindrical ideal invisibility cloaks created with any continuous radial transformation functions, and their physical interpretation is also given. Using the duality principle in anisotropic media, we prove that light-ray vector satisfies "ray-vector eikonal equation" corresponding to the usual "wave-vector eikonal equation". The results interpret why the wave vector maps to the ray vector transferring from the virtual space to the physical space, but not the wave vector. As an application, we investigate the special transformation functions which make the light-ray function satisfy harmonic equation.

preprint2011arXiv

Delay Optimal Multichannel Opportunistic Access

The problem of minimizing queueing delay of opportunistic access of multiple continuous time Markov channels is considered. A new access policy based on myopic sensing and adaptive transmission (MS-AT) is proposed. Under the framework of risk sensitive constrained Markov decision process with effective bandwidth as a measure of queueing delay, it is shown that MS-AT achieves simultaneously throughput and delay optimality. It is shown further that both the effective bandwidth and the throughput of MS-AT are two-segment piece-wise linear functions of the collision constraint (maximum allowable conditional collision probability) with the effective bandwidth and throughput coinciding in the regime of tight collision constraints. Analytical and simulations comparisons with the myopic sensing and memoryless transmission (MS-MT) policy which is throughput optimal but delay suboptimal in the regime of tight collision constraints.

preprint2011arXiv

Dynamic Intrusion Detection in Resource-Constrained Cyber Networks

We consider a large-scale cyber network with N components (e.g., paths, servers, subnets). Each component is either in a healthy state (0) or an abnormal state (1). Due to random intrusions, the state of each component transits from 0 to 1 over time according to certain stochastic process. At each time, a subset of K (K < N) components are checked and those observed in abnormal states are fixed. The objective is to design the optimal scheduling for intrusion detection such that the long-term network cost incurred by all abnormal components is minimized. We formulate the problem as a special class of Restless Multi-Armed Bandit (RMAB) process. A general RMAB suffers from the curse of dimensionality (PSPACE-hard) and numerical methods are often inapplicable. We show that, for this class of RMAB, Whittle index exists and can be obtained in closed form, leading to a low-complexity implementation of Whittle index policy with a strong performance. For homogeneous components, Whittle index policy is shown to have a simple structure that does not require any prior knowledge on the intrusion processes. Based on this structure, Whittle index policy is further shown to be optimal over a finite time horizon with an arbitrary length. Beyond intrusion detection, these results also find applications in queuing networks with finite-size buffers.

preprint2011arXiv

Learning in A Changing World: Restless Multi-Armed Bandit with Unknown Dynamics

We consider the restless multi-armed bandit (RMAB) problem with unknown dynamics in which a player chooses M out of N arms to play at each time. The reward state of each arm transits according to an unknown Markovian rule when it is played and evolves according to an arbitrary unknown random process when it is passive. The performance of an arm selection policy is measured by regret, defined as the reward loss with respect to the case where the player knows which M arms are the most rewarding and always plays the M best arms. We construct a policy with an interleaving exploration and exploitation epoch structure that achieves a regret with logarithmic order when arbitrary (but nontrivial) bounds on certain system parameters are known. When no knowledge about the system is available, we show that the proposed policy achieves a regret arbitrarily close to the logarithmic order. We further extend the problem to a decentralized setting where multiple distributed players share the arms without information exchange. Under both an exogenous restless model and an endogenous restless model, we show that a decentralized extension of the proposed policy preserves the logarithmic regret order as in the centralized setting. The results apply to adaptive learning in various dynamic systems and communication networks, as well as financial investment.

preprint2011arXiv

The effect of electrostatic shielding using invisibility cloak

The effect of electrostatic shielding for a spherical invisibility cloak with arbitrary charges inside is investigated. Our result reveals that the charge inside the cloak is a crucial factor to determine the detection. When charged bodies are placed inside the cloak with an arbitrary distribution, the electric fields outside are purely determined by the total charges just as the fields of a point charge at the center of the cloak. As the total charges reduce to zero, the bodies can not be detected. On the other hand, if the total charges are nonzero, the electrostatic potential inside an ideal cloak tends to infinity. For unideal cloaks, this embarrassment is overcome, while they still have good behaviors of shielding. In addition, the potential across the inner surface of an ideal cloak is discontinuous due to the infinite polarization of the dielectric, however it can be alternatively interpreted as the dual Meissner effect of a dual superconductive layer with a surface magnetic current.

preprint2011arXiv

The Non-Bayesian Restless Multi-Armed Bandit: A Case of Near-Logarithmic Strict Regret

In the classic Bayesian restless multi-armed bandit (RMAB) problem, there are $N$ arms, with rewards on all arms evolving at each time as Markov chains with known parameters. A player seeks to activate $K \geq 1$ arms at each time in order to maximize the expected total reward obtained over multiple plays. RMAB is a challenging problem that is known to be PSPACE-hard in general. We consider in this work the even harder non-Bayesian RMAB, in which the parameters of the Markov chain are assumed to be unknown \emph{a priori}. We develop an original approach to this problem that is applicable when the corresponding Bayesian problem has the structure that, depending on the known parameter values, the optimal solution is one of a prescribed finite set of policies. In such settings, we propose to learn the optimal policy for the non-Bayesian RMAB by employing a suitable meta-policy which treats each policy from this finite set as an arm in a different non-Bayesian multi-armed bandit problem for which a single-arm selection policy is optimal. We demonstrate this approach by developing a novel sensing policy for opportunistic spectrum access over unknown dynamic channels. We prove that our policy achieves near-logarithmic regret (the difference in expected reward compared to a model-aware genie), which leads to the same average reward that can be achieved by the optimal policy under a known model. This is the first such result in the literature for a non-Bayesian RMAB. For our proof, we also develop a novel generalization of the Chernoff-Hoeffding bound.

preprint2010arXiv

Distributed Learning in Multi-Armed Bandit with Multiple Players

We formulate and study a decentralized multi-armed bandit (MAB) problem. There are M distributed players competing for N independent arms. Each arm, when played, offers i.i.d. reward according to a distribution with an unknown parameter. At each time, each player chooses one arm to play without exchanging observations or any information with other players. Players choosing the same arm collide, and, depending on the collision model, either no one receives reward or the colliding players share the reward in an arbitrary way. We show that the minimum system regret of the decentralized MAB grows with time at the same logarithmic order as in the centralized counterpart where players act collectively as a single entity by exchanging observations and making decisions jointly. A decentralized policy is constructed to achieve this optimal order while ensuring fairness among players and without assuming any pre-agreement or information exchange among players. Based on a Time Division Fair Sharing (TDFS) of the M best arms, the proposed policy is constructed and its order optimality is proven under a general reward model. Furthermore, the basic structure of the TDFS policy can be used with any order-optimal single-player policy to achieve order optimality in the decentralized setting. We also establish a lower bound on the system regret growth rate for a general class of decentralized polices, to which the proposed policy belongs. This problem finds potential applications in cognitive radio networks, multi-channel communication systems, multi-agent systems, web search and advertising, and social networks.

preprint2010arXiv

The $\ell_{1}$-norm in quantum information via the approach of Yang-Baxter Equation

The role of $\ell_{1}$-norm in Quantum Mechanics (QM) has been studied through Wigner's D-functions where $\ell_{1}$-norm means $\sum_{i}\left|C_{i}\right|$ for $\left|Ψ\right\rangle =\sum_{i}C_{i}\left|ψ_{i}\right\rangle $ if $\left|ψ_{i}\right\rangle $ are uni-orthogonal and normalized basis. It was shown that the present two types of transformation matrix acting on the natural basis in physics consist in an unified braiding matrix, which can be viewed as a particular solution of the Yang-Baxter equation (YBE). The maximum of the $\ell_{1}$-norm is connected with the maximally entangled states and topological quantum field theory (TQFT) with two-component anyons while the minimum leads to the permutation for fermions or bosons.

preprint2010arXiv

The Non-Bayesian Restless Multi-Armed Bandit: a Case of Near-Logarithmic Regret

preprint2009arXiv

Hopf Structures on Minimal Hopf Quivers

In this paper we investigate pointed Hopf algebras via quiver methods. We classify all possible Hopf structures arising from minimal Hopf quivers, namely basic cycles and the linear chain. This provides full local structure information for general pointed Hopf algebras.

preprint2008arXiv

On Myopic Sensing for Multi-Channel Opportunistic Access: Structure, Optimality, and Performance

We consider a multi-channel opportunistic communication system where the states of these channels evolve as independent and statistically identical Markov chains (the Gilbert-Elliot channel model). A user chooses one channel to sense and access in each slot and collects a reward determined by the state of the chosen channel. The problem is to design a sensing policy for channel selection to maximize the average reward, which can be formulated as a multi-arm restless bandit process. In this paper, we study the structure, optimality, and performance of the myopic sensing policy. We show that the myopic sensing policy has a simple robust structure that reduces channel selection to a round-robin procedure and obviates the need for knowing the channel transition probabilities. The optimality of this simple policy is established for the two-channel case and conjectured for the general case based on numerical results. The performance of the myopic sensing policy is analyzed, which, based on the optimality of myopic sensing, characterizes the maximum throughput of a multi-channel opportunistic communication system and its scaling behavior with respect to the number of channels. These results apply to cognitive radio networks, opportunistic transmission in fading environments, and resource-constrained jamming and anti-jamming.

preprint2007arXiv

Joint Design and Separation Principle for Opportunistic Spectrum Access in the Presence of Sensing Errors

We address the design of opportunistic spectrum access (OSA) strategies that allow secondary users to independently search for and exploit instantaneous spectrum availability. Integrated in the joint design are three basic components: a spectrum sensor that identifies spectrum opportunities, a sensing strategy that determines which channels in the spectrum to sense, and an access strategy that decides whether to access based on imperfect sensing outcomes. We formulate the joint PHY-MAC design of OSA as a constrained partially observable Markov decision process (POMDP). Constrained POMDPs generally require randomized policies to achieve optimality, which are often intractable. By exploiting the rich structure of the underlying problem, we establish a separation principle for the joint design of OSA. This separation principle reveals the optimality of myopic policies for the design of the spectrum sensor and the access strategy, leading to closed-form optimal solutions. Furthermore, decoupling the design of the sensing strategy from that of the spectrum sensor and the access strategy, the separation principle reduces the constrained POMDP to an unconstrained one, which admits deterministic optimal policies. Numerical examples are provided to study the design tradeoffs, the interaction between the spectrum sensor and the sensing and access strategies, and the robustness of the ensuing design to model mismatch.

Qing Zhao

What is connected

Connect this record

See the researcher in context

Building this map preview

62 published item(s)

Modeling and Control for UAV with Off-center Slung Load

Quadrupole transitions of $^{10}$C and their isospin symmetry with $^{10}$Be

Shell and cluster structures in $^{20}$Ne in the variation of multiple bases of the antisymmetrized molecular dynamics

Towards simultaneous coherent radiation in the visible and microwave bands with doped molecular crystals

Efficient measurement of the time-dependent cavity field through compressed sensing

Enhanced quantum sensing with room-temperature solid-state masers

Far-field diffraction computational imaging based on parameter-robust illumination and direct phase optimization

New many-body method using cluster expansion diagrams with tensor-optimized antisymmetrized molecular dynamics

Provably and Practically Efficient Neural Contextual Bandits

Quantitative exploration of the absorber behavior of metal-insulator-metal metamaterials within terahertz via an asymmetric peak model

Robust quantum control for the manipulation of solid-state spins

Spectroscopy Approaches for Food Safety Applications: Improving Data Efficiency Using Active Learning and Semi-Supervised Learning

The Charging Performance of Su-Schrieffer-Heeger Quantum Battery

Ultralow-threshold green fluorescent protein laser based on high Q microbubble resonators

Active Anomaly Detection with Switching Cost

Role of unitary correlation operator on high-momentum antisymmetrized molecular dynamics using bare NN interaction for 3H and 4He

A class of two or three weights linear codes and their complete weight enumerators

AstroCatR: a Mechanism and Tool for Efficient Time Series Reconstruction of Large-Scale Astronomical Catalogues

Distributed No-Regret Learning in Multi-Agent Systems

DymSLAM:4D Dynamic Scene Reconstruction Based on Geometrical Motion Segmentation

Evolution of clustering structure through the momentum distributions in $^{8-10}$Be isotopes

Stochastic Coordinate Minimization with Progressive Precision for Stochastic Convex Optimization

Stochastic Gradient Descent on a Tree: an Adaptive and Robust Approach to Stochastic Convex Optimization

The photon vortex beam in rotating medium

Theory of exciton transport in molecular crystals strongly coupled to a cavity: A temperature-dependent variational approach

Searching for Anomalies over Composite Hypotheses

The field-induced interaction between non-resonant magnetic dipoles

Achieving acoustic cloak by using compressible background flow

Efficient phase retrieval based on dark fringe recognition with an ability of bypassing invalid fringes

Minimum Number of Copies in the Measurement of Multi-Photon Entanglement

Online Learning and Optimization of Markov Jump Affine Models

Direct Observation of Early-stage Quantum Dot Growth Mechanisms with High-temperature Ab Initio Molecular Dynamics

The Double Jones Birefringence in Magneto-electric Medium

Time Circular Birefringence in Time-Dependent Magnetoelectric Media

Uncertainty principle, Shannon-Nyquist sampling and beyond

Active Hypothesis Testing for Quickest Anomaly Detection

An online learning approach to dynamic pricing for demand response

Density matrix and fidelity estimation of multiphoton entanglement via phaselift

Minimum Information Dominating Set for Opinion Sampling

Optimal Index Policies for Anomaly Localization in Resource-Constrained Cyber Systems

Deterministic Sequencing of Exploration and Exploitation for Multi-Armed Bandit Problems

Factorized Three-body S-Matrix Restrained by Yang-Baxter Equation and Quantum Entanglements

The Thinnest Path Problem

Adaptive Shortest-Path Routing under Unknown and Stochastically Varying Link States

Distributed Flow Scheduling in an Unknown Environment

Dynamic Pricing under Finite Space Demand Uncertainty: A Multi-Armed Bandit with Dependent Arms

Dynamic Shortest Path Algorithms for Hypergraphs

Single photon counting imaging system via compressive sensing

Topological Basis Associated with BWMA, Extremes of L1-norm in Quantum Information and Applications in Physics

A Note on: `Algorithms for Connected Set Cover Problem and Fault-Tolerant Connected Set Cover Problem'

Analytical form of light-ray tracing in invisibility cloaks

Delay Optimal Multichannel Opportunistic Access

Dynamic Intrusion Detection in Resource-Constrained Cyber Networks

Learning in A Changing World: Restless Multi-Armed Bandit with Unknown Dynamics

The effect of electrostatic shielding using invisibility cloak

The Non-Bayesian Restless Multi-Armed Bandit: A Case of Near-Logarithmic Strict Regret

Distributed Learning in Multi-Armed Bandit with Multiple Players

The $\ell_{1}$-norm in quantum information via the approach of Yang-Baxter Equation

The Non-Bayesian Restless Multi-Armed Bandit: a Case of Near-Logarithmic Regret

Hopf Structures on Minimal Hopf Quivers

On Myopic Sensing for Multi-Channel Opportunistic Access: Structure, Optimality, and Performance

Joint Design and Separation Principle for Opportunistic Spectrum Access in the Presence of Sensing Errors