Source author record

Ratnesh Sharma

Ratnesh Sharma appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

3works
5topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2020arXiv

Adaptive Traffic Control with Deep Reinforcement Learning: Towards State-of-the-art and Beyond

In this work, we study adaptive data-guided traffic planning and control using Reinforcement Learning (RL). We shift from the plain use of classic methods towards state-of-the-art in deep RL community. We embed several recent techniques in our algorithm that improve the original Deep Q-Networks (DQN) for discrete control and discuss the traffic-related interpretations that follow. We propose a novel DQN-based algorithm for Traffic Control (called TC-DQN+) as a tool for fast and more reliable traffic decision-making. We introduce a new form of reward function which is further discussed using illustrative examples with comparisons to traditional traffic control methods.

preprint2020arXiv

Stochastic Decision-Making Model for Aggregation of Residential Units with PV-Systems and Storages

Many residential energy consumers have installed photovoltaic (PV) panels and energy storage systems. These residential users can aggregate and participate in the energy markets. A stochastic decision making model for an aggregation of these residential units for participation in two-settlement markets is proposed in this paper. Scenarios are generated using Seasonal Autoregressive Integrated Moving Average (SARIMA) model and joint probability distribution function of the forecast errors to model the uncertainties of the real-time prices, PV generations and demands. The proposed scenario generation model of this paper treats forecast errors as random variable, which allows to reflect new information observed in the real-time market into scenario generation process without retraining SARIMA or re-fitting probability distribution functions over the forecast errors. This approach significantly improves the computational time of the proposed model. A simulation study is conducted for an aggregation of 6 residential units, and the results highlights the benefits of aggregation as well as the proposed stochastic decision-making model.

preprint2015arXiv

SDP-based State Estimation of Multi-phase Active Distribution Networks using micro-PMUs

Distribution system state estimation (DSSE) is an essential tool for operation of distribution networks, the results of which enables the operator to have a thorough observation of the system. Thus, most distribution management systems (DMS) include a single-phase state estimator. Due to non-convexity of the SE problem, heuristic and Newton methods do not guarantee the global solution. In contrast, SDP based SE is more promising to guarantee the globally optimal solution since it represents and solves the problem in a convex format. However, the observability of the power system is highly vulnerable to the set of measurements while employing the SDP-based SE, which is addressed in this report. An algorithm is proposed to generate additional measurements using the measurement data already gathered. The SDP-based SE is very sensitive to the level of noise in large power networks. Also, bad data detection algorithms proposed for Newton methods do not work for the SDP-based SE method due to larger number of state variables in SDP representation of power network. In this report, an algorithm is proposed to generate additional measurements using the measurement data already gathered in order to solve the observability issue. A network separation algorithm is developed to solve the entire problem for smaller sub-networks which include micro-PMUs to mitigate the adverse effects of noise for huge networks. An algorithm based on redundancy test is also developed for bad data detection. The algorithms are tested on single phase and multiphase test systems. The algorithms are applied EPRI Circuit 5 (2998-bus) test feeder to demonstrate the flexibility of the algorithms developed.