Researcher profile

Wenqiang Yi

Wenqiang Yi contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
11works
0followers
4topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

11 published item(s)

preprint2022arXiv

A Power-Pool-Based Power Control in Semi-Grant-Free NOMA Transmission

In this paper, we generate a transmit power pool (PP) for Internet of things (IoT) networks with semi-grant-free non-orthogonal multiple access (SGF-NOMA) via multi-agent deep reinforcement learning (MA-DRL) to enable open loop power control (PC). The PP is mapped with each resource block (RB) to achieve distributed power control (DPC). We first formulate the resource allocation problem as stochastic Markov game, and then solve it using two MA-DRL algorithms, namely double deep Q network (DDQN) and Dueling DDQN. Each GF user as an agent tries to find out the optimal transmit power level and RB to form the desired PP. With the aid of dueling processes, the learning process can be enhanced by evaluating the valuable state without considering the effect of each action at each state. Therefore, DDQN is designed for communication scenarios with a small-size action-state space, while Dueling DDQN is for a large-size case. Moreover, to decrease the training time, we reduce the action space by eliminating invalid actions. To control the interference and guarantee the quality-of-service requirements of grant-based users, we determine the optimal number of GF users for each sub-channel. We show that the PC approach has a strong impact on data rates of both grant-based and GF users. We demonstrate that the proposed algorithm is computationally scalable to large-scale IoT networks and produce minimal signalling overhead. Our results show that the proposed MA-Dueling DDQN based SGF-NOMA with DPC outperforms the existing SGF-NOMA system and networks with pure GF protocols with 17.5\% and 22.2\% gain in terms of the system throughput, respectively. Finally, we show that our proposed algorithm outperforms the conventional open loop PC mechanism.

preprint2022arXiv

A Reliable Reinforcement Learning for Resource Allocation in Uplink NOMA-URLLC Networks

In this paper, we propose a deep state-action-reward-state-action (SARSA) $λ$ learning approach for optimising the uplink resource allocation in non-orthogonal multiple access (NOMA) aided ultra-reliable low-latency communication (URLLC). To reduce the mean decoding error probability in time-varying network environments, this work designs a reliable learning algorithm for providing a long-term resource allocation, where the reward feedback is based on the instantaneous network performance. With the aid of the proposed algorithm, this paper addresses three main challenges of the reliable resource sharing in NOMA-URLLC networks: 1) user clustering; 2) Instantaneous feedback system; and 3) Optimal resource allocation. All of these designs interact with the considered communication environment. Lastly, we compare the performance of the proposed algorithm with conventional Q-learning and SARSA Q-learning algorithms. The simulation outcomes show that: 1) Compared with the traditional Q learning algorithms, the proposed solution is able to converges within \myb{200} episodes for providing as low as $10^{-2}$ long-term mean error; 2) NOMA assisted URLLC outperforms traditional OMA systems in terms of decoding error probabilities; and 3) The proposed feedback system is efficient for the long-term learning process.

preprint2022arXiv

Coverage and Capacity Optimization in STAR-RISs Assisted Networks: A Machine Learning Approach

Coverage and capacity are the important metrics for performance evaluation in wireless networks, while the coverage and capacity have several conflicting relationships, e.g. high transmit power contributes to large coverage but high inter-cell interference reduces the capacity performance. Therefore, in order to strike a balance between the coverage and capacity, a novel model is proposed for the coverage and capacity optimization of simultaneously transmitting and reflecting reconfigurable intelligent surfaces (STAR-RISs) assisted networks. To solve the coverage and capacity optimization (CCO) problem, a machine learning-based multi-objective optimization algorithm, i.e., the multi-objective proximal policy optimization (MO-PPO) algorithm, is proposed. In this algorithm, a loss function-based update strategy is the core point, which is able to calculate weights for both loss functions of coverage and capacity by a min-norm solver at each update. The numerical results demonstrate that the investigated update strategy outperforms the fixed weight-based MO algorithms.

preprint2022arXiv

Developing NOMA to Next Generation Multiple Access (NGMA): Future Vision and Research Opportunities

As a prominent member of the next generation multiple access (NGMA) family, non-orthogonal multiple access (NOMA) has been recognized as a promising multiple access candidate for the sixth-generation (6G) networks. This article focuses on applying NOMA in 6G networks, with an emphasis on proposing the so-called "One Basic Principle plus Four New" concept. Starting with the basic NOMA principle, the importance of successive interference cancellation (SIC) becomes evident. In particular, the advantages and drawbacks of both the channel state information based SIC and quality-of-service based SIC are discussed. Then, the application of NOMA to meet the new 6G performance requirements, especially for massive connectivity, is explored. Furthermore, the integration of NOMA with new physical layer techniques is considered, followed by introducing new application scenarios for NOMA towards 6G. Finally, the application of machine learning in NOMA networks is investigated, ushering in the machine learning empowered NGMA era.

preprint2022arXiv

Dynamic Task Software Caching-assisted Computation Offloading for Multi-Access Edge Computing

In multi-access edge computing (MEC), most existing task software caching works focus on statically caching data at the network edge, which may hardly preserve high reusability due to the time-varying user requests in practice. To this end, this work considers dynamic task software caching at the MEC server to assist users' task execution. Specifically, we formulate a joint task software caching update (TSCU) and computation offloading (COMO) problem to minimize users' energy consumption while guaranteeing delay constraints, where the limited cache size and computation capability of the MEC server, as well as the time-varying task demand of users are investigated. This problem is proved to be non-deterministic polynomial-time hard, so we transform it into two sub-problems according to their temporal correlations, i.e., the real-time COMO problem and the Markov decision process-based TSCU problem. We first model the COMO problem as a multi-user game and propose a decentralized algorithm to address its Nash equilibrium solution. We then propose a double deep Q-network (DDQN)-based method to solve the TSCU policy. To reduce the computation complexity and convergence time, we provide a new design for the deep neural network (DNN) in DDQN, named state coding and action aggregation (SCAA). In SCAA-DNN, we introduce a dropout mechanism in the input layer to code users' activity states. Additionally, at the output layer, we devise a two-layer architecture to dynamically aggregate caching actions, which is able to solve the huge state-action space problem. Simulation results show that the proposed solution outperforms existing schemes, saving over 12% energy, and converges with fewer training episodes.

preprint2022arXiv

Semi-Integrated-Sensing-and-Communication (Semi-ISaC) Networks Assisted by NOMA

This paper investigates non-orthogonal multiple access (NOMA) assisted integrated sensing and communication (ISaC) networks. Compared to the conventional ISaC networks, where the total bandwidth is used for both the radar detection and wireless communications, the proposed Semi-ISaC networks allow that a portion of bandwidth is used for ISaC and the rest of the bandwidth is only utilized for wireless communications. We first derive the analytical expressions of the outage probability for the communication signals, including the signals for the radar target and the communication transmitter. Additionally, we derive the analytical expressions of the ergodic radar estimation information rate (REIR) for the radar echoes. The simulation results show that 1) NOMA ISaC has better spectrum efficiency than the conventional ISaC; and 2) The REIR is enhanced when we enlarge the density of pulses.

preprint2022arXiv

STAR-RIS Aided NOMA in Multi-Cell Networks: A General Analytical Framework with Gamma Distributed Channel Modeling

The simultaneously transmitting and reflecting reconfigurable intelligent surface (STAR-RIS) is capable of providing full-space coverage of smart radio environments. This work investigates STAR-RIS aided downlink non-orthogonal multiple access (NOMA) multi-cell networks, where the energy of incident signals at STAR-RISs is split into two portions for transmitting and reflecting. We first propose a fitting method to model the distribution of composite small-scale fading power as the tractable Gamma distribution. Then, a unified analytical framework based on stochastic geometry is provided to capture the random locations of RIS-RISs, base stations (BSs), and user equipments (UEs). Based on this framework, we derive the coverage probability and ergodic rate of both the typical UE and the connected UE. In particular, we obtain closed-form expressions of the coverage probability in interference-limited scenarios. We also deduce theoretical expressions in conventional RIS aided networks for comparison. The analytical results show that optimal energy splitting coefficients of STAR-RISs exist to simultaneously maximize the system coverage and ergodic rate. The numerical results demonstrate that: 1) STAR-RISs are able to meet different demands of UEs located on different sides; 2) STAR-RISs with appropriate energy splitting coefficients outperform conventional RISs in the coverage and the rate performance.

preprint2021arXiv

Multi-cell NOMA: Coherent Reconfigurable Intelligent Surfaces Model With Stochastic Geometry

Reconfigurable intelligent surfaces (RISs) become promising for enhancing non-orthogonal multiple access (NOMA) systems, i.e., enhancing the channel quality and altering the SIC orders. Invoked by stochastic geometry methods, we investigate the downlink coverage performance of RIS-aided multi-cell NOMA networks. We first derive the RIS-aided channel model, concluding the direct and reflecting links. The analytical results demonstrate that the RIS-aided channel model can be closely modeled as a Gamma distribution. Additionally, interference from other cells is analyzed. Lastly, we derive closed-form coverage probability expressions for the paired NOMA users. Numerical results indicate that 1) although the interference from other cells is enhanced via the RISs, the performance of the RIS-aided user still enhances since the channel quality is strengthened more obviously; and 2) the SIC order can be altered by employing the RISs since the RISs improve the channel quality of the aided user.

preprint2021arXiv

Resource Allocation in Uplink NOMA-IoT Networks: A Reinforcement-Learning Approach

Non-orthogonal multiple access (NOMA) exploits the potential of the power domain to enhance the connectivity for the Internet of Things (IoT). Due to time-varying communication channels, dynamic user clustering is a promising method to increase the throughput of NOMA-IoT networks. This paper develops an intelligent resource allocation scheme for uplink NOMA-IoT communications. To maximise the average performance of sum rates, this work designs an efficient optimization approach based on two reinforcement learning algorithms, namely deep reinforcement learning (DRL) and SARSA-learning. For light traffic, SARSA-learning is used to explore the safest resource allocation policy with low cost. For heavy traffic, DRL is used to handle traffic-introduced huge variables. With the aid of the considered approach, this work addresses two main problems of fair resource allocation in NOMA techniques: 1) allocating users dynamically and 2) balancing resource blocks and network traffic. We analytically demonstrate that the rate of convergence is inversely proportional to network sizes. Numerical results show that: 1) Compared with the optimal benchmark scheme, the proposed DRL and SARSA-learning algorithms have lower complexity with acceptable accuracy and 2) NOMA-enabled IoT networks outperform the conventional orthogonal multiple access based IoT networks in terms of system throughput.

preprint2020arXiv

Downlink Analysis for Reconfigurable Intelligent Surfaces Aided NOMA Networks

By activating blocked users and altering successive interference cancellation (SIC) sequences, reconfigurable intelligent surfaces (RISs) become promising for enhancing non-orthogonal multiple access (NOMA) systems. This work investigates the downlink performance of RIS-aided NOMA networks via stochastic geometry. We first introduce the unique path loss model for RIS reflecting channels. Then, we evaluate the angle distributions based on a Poisson cluster process (PCP) framework, which theoretically demonstrates that the angles of incidence and reflection are uniformly distributed. Lastly, we derive closed-form expressions for coverage probabilities of the paired NOMA users. Our results show that 1) RIS-aided NOMA networks perform better than the traditional NOMA networks; 2) the SIC order in NOMA systems can be altered since RISs are able to change the channel gains of NOMA users.

preprint2020arXiv

Reconfigurable Intelligent Surfaces Aided Multi-Cell NOMA Networks: A Stochastic Geometry Model

By activating blocked users and altering successive interference cancellation (SIC) sequences, reconfigurable intelligent surfaces (RISs) become promising for enhancing non-orthogonal multiple access (NOMA) systems. The downlink RIS-aided NOMA networks are investigated via stochastic geometry. We first introduce the unique path loss model for RIS reflecting channels. Then, we evaluate the angle distributions based on a Poisson cluster process (PCP) model, which theoretically demonstrates that the angles of incidence and reflection are uniformly distributed. Additionally, we derive closed-form analytical and asymptotic expressions for coverage probabilities of the paired NOMA users. Lastly, we derive the analytical expressions of the ergodic rate for both of the paired NOMA users and calculate the asymptotic expressions for the typical user. The analytical results indicate that 1) the achievable rates reach an upper limit when the length of RIS increases; 2) exploiting RISs can enhance the path loss intercept to improve the performance without influencing the bandwidth. Our results show that 1) RIS-aided NOMA networks have superior performance than the conventional NOMA networks, and 2) the SIC order in NOMA systems can be altered since RISs are able to change the channel quality of NOMA users.