Researcher profile

Ying-Chang Liang

Ying-Chang Liang contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
16works
0followers
10topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

16 published item(s)

preprint2022arXiv

Reinforcement Learning-Empowered Mobile Edge Computing for 6G Edge Intelligence

Mobile edge computing (MEC) is considered a novel paradigm for computation-intensive and delay-sensitive tasks in fifth generation (5G) networks and beyond. However, its uncertainty, referred to as dynamic and randomness, from the mobile device, wireless channel, and edge network sides, results in high-dimensional, nonconvex, nonlinear, and NP-hard optimization problems. Thanks to the evolved reinforcement learning (RL), upon iteratively interacting with the dynamic and random environment, its trained agent can intelligently obtain the optimal policy in MEC. Furthermore, its evolved versions, such as deep RL (DRL), can achieve higher convergence speed efficiency and learning accuracy based on the parametric approximation for the large-scale state-action space. This paper provides a comprehensive research review on RL-enabled MEC and offers insight for development in this area. More importantly, associated with free mobility, dynamic channels, and distributed services, the MEC challenges that can be solved by different kinds of RL algorithms are identified, followed by how they can be solved by RL solutions in diverse mobile applications. Finally, the open challenges are discussed to provide helpful guidance for future research in RL training and learning MEC.

preprint2021arXiv

Active Reconfigurable Intelligent Surface Aided Wireless Communications

Reconfigurable Intelligent Surface (RIS) is a promising solution to reconfigure the wireless environment in a controllable way. To compensate for the double-fading attenuation in the RIS-aided link, a large number of passive reflecting elements (REs) are conventionally deployed at the RIS, resulting in large surface size and considerable circuit power consumption. In this paper, we propose a new type of RIS, called active RIS, where each RE is assisted by active loads (negative resistance), that reflect and amplify the incident signal instead of only reflecting it with the adjustable phase shift as in the case of a passive RIS. Therefore, for a given power budget at the RIS, a strengthened RIS-aided link can be achieved by increasing the number of active REs as well as amplifying the incident signal. We consider the use of an active RIS to a single input multiple output (SIMO) system. {However, it would unintentionally amplify the RIS-correlated noise, and thus the proposed system has to balance the conflict between the received signal power maximization and the RIS-correlated noise minimization at the receiver. To achieve this goal, it has to optimize the reflecting coefficient matrix at the RIS and the receive beamforming at the receiver.} An alternating optimization algorithm is proposed to solve the problem. Specifically, the receive beamforming is obtained with a closed-form solution based on linear minimum-mean-square-error (MMSE) criterion, while the reflecting coefficient matrix is obtained by solving a series of sequential convex approximation (SCA) problems. Simulation results show that the proposed active RIS-aided system could achieve better performance over the conventional passive RIS-aided system with the same power budget.

preprint2021arXiv

Semi-Blind Cascaded Channel Estimation for Reconfigurable Intelligent Surface Aided Massive MIMO

Reconfigurable intelligent surface (RIS) is envisioned to be a promising green technology to reduce the energy consumption and improve the coverage and spectral efficiency of massive multiple-input multiple-output (MIMO) wireless networks. In a RIS-aided MIMO system, the acquisition of channel state information (CSI) is important for achieving passive beamforming gains of the RIS, but is also challenging due to the cascaded property of the transmitter-RIS-receiver channel and the lack of signal processing capability of the passive RIS elements. The state-of-the-art approach for CSI acquisition in such a system is a pure training-based strategy that depends on a long sequence of pilot symbols. In this paper, we investigate semi-blind cascaded channel estimation for RIS-aided massive MIMO systems, in which the receiver simultaneously estimates the channel coefficients and the partially unknown transmit signal with a small number of pilot sequences. Specifically, we formulate the semi-blind cascaded channel estimation as a trilinear matrix factorization task. Under the Bayesian inference framework, we develop a computationally efficient iterative algorithm using the approximate message passing principle to resolve the trilinear inference problem. Meanwhile, we present an analytical framework to characterize the theoretical performance bound of the proposed approach in the large-system limit via the replica method developed in statistical physics. Extensive simulation results demonstrate the effectiveness of the proposed semi-blind cascaded channel estimation algorithm.

preprint2020arXiv

Deep Reinforcement Learning for Backscatter-Aided Data Offloading in Mobile Edge Computing

Wireless network optimization has been becoming very challenging as the problem size and complexity increase tremendously, due to close couplings among network entities with heterogeneous service and resource requirements. By continuously interacting with the environment, deep reinforcement learning (DRL) provides a mechanism for different network entities to build knowledge and make autonomous decisions to improve network performance. In this article, we first review typical DRL approaches and recent enhancements. We then discuss the applications of DRL for mobile edge computing (MEC), which can be used for the low-power IoT devices, e.g., wireless sensors in healthcare monitoring, to offload computation workload to nearby MEC servers. To balance power consumption in offloading and computation, we propose a novel hybrid offloading model that exploits the complement operations of RF communications and low-power backscatter communications. The DRL framework is then customized to optimize the transmission scheduling and workload allocation in two communications technologies, which is shown to enhance the offloading performance significantly compared with existing schemes.

preprint2020arXiv

Deep Reinforcement Learning for Multi-Agent Power Control in Heterogeneous Networks

We consider a typical heterogeneous network (HetNet), in which multiple access points (APs) are deployed to serve users by reusing the same spectrum band. Since different APs and users may cause severe interference to each other, advanced power control techniques are needed to manage the interference and enhance the sum-rate of the whole network. Conventional power control techniques first collect instantaneous global channel state information (CSI) and then calculate sub-optimal solutions. Nevertheless, it is challenging to collect instantaneous global CSI in the HetNet, in which global CSI typically changes fast. In this paper, we exploit deep reinforcement learning (DRL) to design a multi-agent power control algorithm in the HetNet. To be specific, by treating each AP as an agent with a local deep neural network (DNN), we propose a multiple-actor-shared-critic (MASC) method to train the local DNNs separately in an online trial-and-error manner. With the proposed algorithm, each AP can independently use the local DNN to control the transmit power with only local observations. Simulations results show that the proposed algorithm outperforms the conventional power control algorithms in terms of both the converged average sum-rate and the computational complexity.

preprint2020arXiv

Federated Learning in Mobile Edge Networks: A Comprehensive Survey

In recent years, mobile devices are equipped with increasingly advanced sensing and computing capabilities. Coupled with advancements in Deep Learning (DL), this opens up countless possibilities for meaningful applications. Traditional cloudbased Machine Learning (ML) approaches require the data to be centralized in a cloud server or data center. However, this results in critical issues related to unacceptable latency and communication inefficiency. To this end, Mobile Edge Computing (MEC) has been proposed to bring intelligence closer to the edge, where data is produced. However, conventional enabling technologies for ML at mobile edge networks still require personal data to be shared with external parties, e.g., edge servers. Recently, in light of increasingly stringent data privacy legislations and growing privacy concerns, the concept of Federated Learning (FL) has been introduced. In FL, end devices use their local data to train an ML model required by the server. The end devices then send the model updates rather than raw data to the server for aggregation. FL can serve as an enabling technology in mobile edge networks since it enables the collaborative training of an ML model and also enables DL for mobile edge network optimization. However, in a large-scale and complex mobile edge network, heterogeneous devices with varying constraints are involved. This raises challenges of communication costs, resource allocation, and privacy and security in the implementation of FL at scale. In this survey, we begin with an introduction to the background and fundamentals of FL. Then, we highlight the aforementioned challenges of FL implementation and review existing solutions. Furthermore, we present the applications of FL for mobile edge network optimization. Finally, we discuss the important challenges and future research directions in FL

preprint2020arXiv

Joint Uplink-and-Downlink Optimization of 3D UAV Swarm Deployment for Wireless-Powered NB-IoT Networks

This paper investigates a full-duplex orthogonal-frequency-division multiple access (OFDMA) based multiple unmanned aerial vehicles (UAVs)-enabled wireless-powered Internet-of-Things (IoT) networks. In this paper, a swarm of UAVs is first deployed in three dimensions (3D) to simultaneously charge all devices, i.e., a downlink (DL) charging period, and then flies to new locations within this area to collect information from scheduled devices in several epochs via OFDMA due to potential limited number of channels available in Narrow Band IoT, i.e., an uplink (UL) communication period. To maximize the UL throughput of IoT devices, we jointly optimizes the UL-and-DL 3D deployment of the UAV swarm, including the device-UAV association, the scheduling order, and the UL-DL time allocation. In particular, the DL energy harvesting (EH) threshold of devices and the UL signal decoding threshold of UAVs are taken into consideration when studying the problem. Besides, both line-of-sight (LoS) and non-line-of-sight (NLoS) channel models are studied depending on the position of sensors and UAVs. The influence of the potential limited channels issue in NB-IoT is also considered by studying the IoT scheduling policy. Two scheduling policies, a near-first (NF) policy and a far-first (FF) policy, are studied. It is shown that the NF scheme outperforms FF scheme in terms of sum throughput maximization; whereas FF scheme outperforms NF scheme in terms of system fairness.

preprint2020arXiv

Reconfigurable Intelligent Surface Aided Constant-Envelope Wireless Power Transfer

By reconfiguring the propagation environment of electromagnetic waves artificially, reconfigurable intelligent surfaces (RISs) have been regarded as a promising and revolutionary hardware technology to improve the energy and spectrum efficiency of wireless networks. In this paper, we study a RIS aided multiuser multiple-input single-output (MISO) wireless power transfer (WPT) system, where the transmitter is equipped with a constant-envelope analog beamformer. We formulate a novel problem to maximize the total received power of all the users by jointly optimizing the beamformer at transmitter and the phase shifts at the RISs, subject to the individual minimum received power constraints of users. We further solve the problem iteratively with a closed-form expression for each step. Numerical results show the performance gain of deploying RIS and the effectiveness of the proposed algorithm.

preprint2020arXiv

Reconfigurable Intelligent Surface Empowered Device-to-Device Communication Underlaying Cellular Networks

Reconfigurable intelligent surface (RIS) is a new and revolutionary technology to achieve spectrum-, energy- and cost-efficient wireless networks. This paper studies the resource allocation for RIS-empowered device-to-device (D2D) communication underlaying a cellular network, in which an RIS is employed to enhance desired signals and suppress interference between paired D2D and cellular links. We maximize the overall network's spectrum efficiency (SE) (i.e., sum rate of D2D users and cellular users) and energy efficiency (EE), respectively, by jointly optimizing the resource reuse indicators, the transmit power and the RIS's passive beamforming, under the signal-to-interference-plus-noise ratio constraints and other practical constraints. To solve the non-convex problems, we first propose an efficient user-pairing scheme based on relative channel strength to determine the resource reuse indicators. Then, the transmit power and the RIS's passive beamforming are jointly optimized to maximize the SE by a proposed iterative algorithm, based on the techniques of alternating optimization, successive convex approximation, Lagrangian dual transform and quadratic transform. Moreover, the EE-maximization problem is solved by an alternating algorithm integrated with Dinkelbach's method. Also, the convergence and complexity of both algorithms are analyzed. Numerical results show that the proposed design achieves significant SE and EE enhancements compared to traditional underlaying D2D network without RIS and other benchmarks.

preprint2020arXiv

Reconfigurable Intelligent Surfaces for Energy Efficiency in D2D Communication Network

In this letter, the joint power control of D2D users and the passive beamforming of reconfigurable intelligent surfaces (RIS) for a RIS-aided device-to-device (D2D) communication network is investigated to maximize energy efficiency. This non-convex optimization problem is divided into two subproblems, which are passive beamforming and power control. The two subproblems are optimized alternately. We first decouple the passive beamforming at RIS based on the Lagrangian dual transform. This problem is solved by using fractional programming. Then we optimize the power control by using the Dinkelbach method. By iteratively solving the two subproblems, we obtain a suboptimal solution for the joint optimization problem. Numerical results have verified the effectiveness of the proposed algorithm, which can significantly improve the energy efficiency of the D2D network.

preprint2020arXiv

Symbiotic Radio: Cognitive Backscattering Communications for Future Wireless Networks

The heterogenous wireless services and exponentially growing traffic call for novel spectrum- and energy-efficient wireless communication technologies. In this paper, a new technique, called symbiotic radio (SR), is proposed to exploit the benefits and address the drawbacks of cognitive radio (CR) and ambient backscattering communications(AmBC), leading to mutualism spectrum sharing and highly reliable backscattering communications. In particular, the secondary transmitter (STx) in SR transmits messages to the secondary receiver (SRx) over the RF signals originating from the primary transmitter (PTx) based on cognitive backscattering communications, thus the secondary system shares not only the radio spectrum, but also the power, and infrastructure with the primary system. In return, the secondary transmission provides beneficial multipath diversity to the primary system, therefore the two systems form mutualism spectrum sharing. More importantly, joint decoding is exploited at SRx to achieve highly reliable backscattering communications. To exploit the full potential of SR, in this paper, we address three fundamental tasks in SR: (1) enhancing the backscattering link via active load; (2) achieving highly reliable communications through joint decoding; and (3) capturing PTx's RF signals using reconfigurable intelligent surfaces. Emerging applications, design challenges and open research problems will also be discussed.

preprint2020arXiv

Toward Smart Security Enhancement of Federated Learning Networks

As traditional centralized learning networks (CLNs) are facing increasing challenges in terms of privacy preservation, communication overheads, and scalability, federated learning networks (FLNs) have been proposed as a promising alternative paradigm to support the training of machine learning (ML) models. In contrast to the centralized data storage and processing in CLNs, FLNs exploit a number of edge devices (EDs) to store data and perform training distributively. In this way, the EDs in FLNs can keep training data locally, which preserves privacy and reduces communication overheads. However, since the model training within FLNs relies on the contribution of all EDs, the training process can be disrupted if some of the EDs upload incorrect or falsified training results, i.e., poisoning attacks. In this paper, we review the vulnerabilities of FLNs, and particularly give an overview of poisoning attacks and mainstream countermeasures. Nevertheless, the existing countermeasures can only provide passive protection and fail to consider the training fees paid for the contributions of the EDs, resulting in a unnecessarily high training cost. Hence, we present a smart security enhancement framework for FLNs. In particular, a verify-before-aggregate (VBA) procedure is developed to identify and remove the non-benign training results from the EDs. Afterward, deep reinforcement learning (DRL) is applied to learn the behaving patterns of the EDs and to actively select the EDs that can provide benign training results and charge low training fees. Simulation results reveal that the proposed framework can protect FLNs effectively and efficiently.

preprint2020arXiv

Towards Smart Wireless Communications via Intelligent Reflecting Surfaces: A Contemporary Survey

This paper presents a literature review on recent applications and design aspects of the intelligent reflecting surface (IRS) in the future wireless networks. Conventionally, the network optimization has been limited to transmission control at two endpoints, i.e., end users and network controller. The fading wireless channel is uncontrollable and becomes one of the main limiting factors for performance improvement. The IRS is composed of a large array of scattering elements, which can be individually configured to generate additional phase shifts to the signal reflections. Hence, it can actively control the signal propagation properties in favor of signal reception, and thus realize the notion of a smart radio environment. As such, the IRS's phase control, combined with the conventional transmission control, can potentially bring performance gain compared to wireless networks without IRS. In this survey, we first introduce basic concepts of the IRS and the realizations of its reconfigurability. Then, we focus on applications of the IRS in wireless communications. We overview different performance metrics and analytical approaches to characterize the performance improvement of IRS-assisted wireless networks. To exploit the performance gain, we discuss the joint optimization of the IRS's phase control and the transceivers' transmission control in different network design problems, e.g.,~rate maximization and power minimization problems. Furthermore, we extend the discussion of IRS-assisted wireless networks to some emerging use cases. Finally, we highlight important practical challenges and future research directions for realizing IRS-assisted wireless networks in beyond 5G communications.

preprint2020arXiv

Two-Timescale Optimization for Intelligent Reflecting Surface Aided D2D Underlay Communication

The performance of a device-to-device (D2D) underlay communication system is limited by the co-channel interference between cellular users (CUs) and D2D devices. To address this challenge, an intelligent reflecting surface (IRS) aided D2D underlay system is studied in this paper. A two-timescale optimization scheme is proposed to reduce the required channel training and feedback overhead, where transmit beamforming at the base station (BS) and power control at the D2D transmitter are adapted to instantaneous effective channel state information (CSI); and the IRS phase shifts are adapted to slow-varying channel mean. Based on the two-timescale optimization scheme, we aim to maximize the D2D ergodic rate subject to a given outage probability constrained signal-to-interference-plus-noise ratio (SINR) target for the CU. The two-timescale problem is decoupled into two sub-problems, and the two sub-problems are solved iteratively with closed-form expressions. Numerical results verify that the two-timescale based optimization performs better than several baselines, and also demonstrate a favorable trade-off between system performance and CSI overhead.

preprint2020arXiv

Vision, Requirements, and Technology Trend of 6G: How to Tackle the Challenges of System Coverage, Capacity,User Data-Rate and Movement Speed

Since 5G new radio comes with non-standalone (NSA) and standalone (SA) versions in 3GPP, research on 6G has been on schedule by academics and industries. Though 6G is supposed to have much higher capabilities than 5G, yet there is no clear description about what 6G is. In this article, a comprehensive discussion of 6G is given based on the review of 5G developments, covering visions and requirements, technology trends and challenges, aiming at tackling the challenge of coverage, capacity, the user data rate and movement speed of mobile communication system. The vision of 6G is to fully support the development of a Ubiquitous Intelligent Mobile Society with intelligent life and industries. Finally, the roadmap of the 6G standard is suggested for the future.

preprint2019arXiv

Intelligent Reflecting Surface Assisted Non-Orthogonal Multiple Access

Intelligent reflecting surface (IRS) is a new and disruptive technology to achieve spectrum- and energy-efficient as well as cost-efficient wireless networks. This paper considers an IRS-assisted downlink non-orthogonal-multiple-access (NOMA) system. To optimize the rate performance and ensure user fairness, we maximize the minimum decoding signal-to-interference-plus-noise-ratio (i.e., equivalently the rate) of all users, by jointly optimizing the (active) transmit beamforming at the base station (BS) and the phase shifts (i.e., passive beamforming) at the IRS. A combined-channel-strength based user ordering scheme is first proposed to decouple the user-ordering design and the joint beamforming design. Efficient algorithms are further proposed to solve the formulated non-convex problem for the cases of a single-antenna BS and a multi-antenna BS, respectively, by leveraging the block coordinated decent and semidefinite relaxation (SDR) techniques. For the single-antenna BS case, the optimal solution for the power allocation at the BS and the asymptotically optimal solution for the phase shifts at the IRS are obtained in closed forms. For the multi-antenna BS case, it is shown that the rank of the SDR solution to the transmit beamforming design is upper bounded by two. Also, the convergence proof and the complexity analysis are given for the proposed algorithms. Simulation results show that the IRS-assisted downlink NOMA system can enhance the rate performance significantly, compared to traditional NOMA without IRS and traditional orthogonal multiple access with/without IRS. In addition, numerical results demonstrate that the rate degradation due to the IRS's finite phase resolution is slight, and good rate fairness among users can be always guaranteed.