BZPEERReading, trust and collaboration for research
Menu

Discover

GraphFollow connections around a paper, topic or saved view.

Workspaces

HomePick up where your research flow left off.InboxHandle requests, replies and notifications from one place.CollectionsCurate reading lists, evidence sets and shareable dossiers.ResearchSee your private provenance graph, trail and imports.CollaborationMove from discovery into focused discussion rooms.PublishDraft, preview and publish full-text research articles.

Network

ExpertsFind specialists worth following or asking for help.CommunitiesJoin research circles organized around shared work.PartnersSee external organizations active around the same topics.

Opportunities

ListingsBrowse roles, calls and collaborations with clearer fit signals.

Account

Log inReturn to your reading and collaboration workspace.Create accountStart saving work, following people and joining teams.
Log inCreate account

Researcher profile

Ngoc Duy Nguyen

Ngoc Duy Nguyen contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate
Artificial IntelligenceMachine LearningComputer Science and Game TheoryMultiagent Systemsphysics.app-phRoboticscond-mat.mes-hallcond-mat.mtrl-sci

Trust snapshot

Quick read

Trust 21 - EmergingVerification L1Unclaimed author
6works
0followers
8topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

6 published item(s)

preprint2021arXiv

A Visual Communication Map for Multi-Agent Deep Reinforcement Learning

Deep reinforcement learning has been applied successfully to solve various real-world problems and the number of its applications in the multi-agent settings has been increasing. Multi-agent learning distinctly poses significant challenges in the effort to allocate a concealed communication medium. Agents receive thorough knowledge from the medium to determine subsequent actions in a distributed nature. Apparently, the goal is to leverage the cooperation of multiple agents to achieve a designated objective efficiently. Recent studies typically combine a specialized neural network with reinforcement learning to enable communication between agents. This approach, however, limits the number of agents or necessitates the homogeneity of the system. In this paper, we have proposed a more scalable approach that not only deals with a great number of agents but also enables collaboration between dissimilar functional agents and compatibly combined with any deep reinforcement learning methods. Specifically, we create a global communication map to represent the status of each agent in the system visually. The visual map and the environmental state are fed to a shared-parameter network to train multiple agents concurrently. Finally, we select the Asynchronous Advantage Actor-Critic (A3C) algorithm to demonstrate our proposed scheme, namely Visual communication map for Multi-agent A3C (VMA3C). Simulation results show that the use of visual communication map improves the performance of A3C regarding learning speed, reward achievement, and robustness in multi-agent problems.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Review, Analysis and Design of a Comprehensive Deep Reinforcement Learning Framework

The integration of deep learning to reinforcement learning (RL) has enabled RL to perform efficiently in high-dimensional environments. Deep RL methods have been applied to solve many complex real-world problems in recent years. However, development of a deep RL-based system is challenging because of various issues such as the selection of a suitable deep RL algorithm, its network configuration, training time, training methods, and so on. This paper proposes a comprehensive software framework that not only plays a vital role in designing a connect-the-dots deep RL architecture but also provides a guideline to develop a realistic RL application in a short time span. We have designed and developed a deep RL-based software framework that strictly ensures flexibility, robustness, and scalability. By inheriting the proposed architecture, software managers can foresee any challenges when designing a deep RL-based system. As a result, they can expedite the design process and actively control every stage of software development, which is especially critical in agile development environments. To enforce generalization, the proposed architecture does not depend on a specific RL algorithm, a network configuration, the number of agents, or the type of agents. Using our framework, software developers can develop and integrate new RL algorithms or new types of agents, and can flexibly change network configuration or the number of agents.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A Multi-Objective Deep Reinforcement Learning Framework

This paper introduces a new scalable multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We develop a high-performance MODRL framework that supports both single-policy and multi-policy strategies, as well as both linear and non-linear approaches to action selection. The experimental results on two benchmark problems (two-objective deep sea treasure environment and three-objective Mountain Car problem) indicate that the proposed framework is able to find the Pareto-optimal solutions effectively. The proposed framework is generic and highly modularized, which allows the integration of different deep reinforcement learning algorithms in different complex problem domains. This therefore overcomes many disadvantages involved with standard multi-objective reinforcement learning methods in the current literature. The proposed framework acts as a testbed platform that accelerates the development of MODRL for solving increasingly complicated multi-objective problems.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

On the origin of the giant spin detection efficiency in tunnel barrier based electrical spin detector

Efficient conversion of a spin signal into an electric voltage in mainstream semiconductors is one of the grand challenges of spintronics. This process is commonly achieved via a ferromagnetic tunnel barrier where non-linear electric transport occurs. In this work, we demonstrate that non-linearity may lead to a spin-to-charge conversion efficiency larger than 10 times the spin polarization of the tunnel barrier when the latter is under bias of a few mV. We identify the underlying mechanisms responsible for this remarkably efficient spin detection as the tunnel barrier deformation and the conduction band shift resulting from a change of applied voltage. In addition, we derive an approximate analytical expression for the detector spin sensitivity $P_{\textrm{det}}(V)$. Calculations performed for different barrier shapes show that this enhancement is present in oxide barriers as well as in Schottky tunnel barriers even if the dominant mechanisms differs with the barrier type. Moreover, although the spin signal is reduced at high temperatures, it remains superior to the value predicted by the linear model. Our findings shed light into the interpretation and understanding of electrical spin detection experiments and open new paths to optimize the performance of spin transport devices.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Opto-electronic properties and solar cell efficiency modelling of Cu$_2$ZnXS$_4$ (X=Sn,Ge,Si) kesterites

In this work, first principle calculations of Cu$_2$ZnSnS$_4$ (CZTS), Cu$_2$ZnGeS$_4$ (CZGS) and Cu$_2$ZnSiS$_4$ (CZSS) are performed to highlight the impact of the cationic substitution on the structural, electronic and optical properties of kesterite compounds. Direct bandgaps are reported with values of 1.32, 1.89 and 3.06 eV respectively for CZTS, CZGS and CZSS. In addition, absorption coefficient values of the order of $10^4$ cm$^{-1}$ are obtained, indicating the applicability of these materials as absorber layer for solar cell applications. In the second part of this study, ab initio results are used as input data to model the electrical power conversion efficiency of kesterite-based solar cell. In that perspective, we used an improved version of the Shockley-Queisser theoretical model including non-radiative recombination via an external parameter defined as the internal quantum efficiency. Based on predicted optimal absorber layer thicknesses, the variation of the solar cell maximal efficiency is studied as a function of the non-radiative recombination rate. Maximal efficiencies of 25.88, 19.94 and 3.11% are reported respectively for CZTS, CZGS and CZSS for vanishing non-radiative recombination rate. Using an internal quantum efficiency providing $V_{OC}$ values comparable to experimental measurements, solar cell efficiencies of 15.88, 14.98 and 2.66% are reported respectively for CZTS, CZGS and CZSS (for an optimal thickness of 1.15 $μ$m). With this methodology, we confirm the suitability of CZTS in single junction solar cells, with a possible efficiency improvement of 10% enabled through the reduction of the non-radiative recombination rate. In addition, CZGS appears to be an interesting candidate as top cell absorber layer for tandem approaches whereas CZSS might be interesting for transparent PV windows.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Deep Reinforcement Learning for Multi-Agent Systems: A Review of Challenges, Solutions and Applications

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The recent development of deep learning has enabled RL methods to drive optimal policies for sophisticated and capable agents, which can perform efficiently in these challenging environments. This paper addresses an important aspect of deep RL related to situations that require multiple agents to communicate and cooperate to solve complex tasks. A survey of different approaches to problems related to multi-agent deep RL (MADRL) is presented, including non-stationarity, partial observability, continuous state and action spaces, multi-agent training schemes, multi-agent transfer learning. The merits and demerits of the reviewed methods will be analyzed and discussed, with their corresponding applications explored. It is envisaged that this review provides insights about various MADRL methods and can lead to future development of more robust and highly useful multi-agent learning methods for solving real-world problems.

0 citations0 reviewsNo code linkedOpen access