Source author record

Deborah Cohen

Deborah Cohen appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

6works
4topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

6 published item(s)

preprint2022arXiv

Dynamic Planning in Open-Ended Dialogue using Reinforcement Learning

Despite recent advances in natural language understanding and generation, and decades of research on the development of conversational bots, building automated agents that can carry on rich open-ended conversations with humans "in the wild" remains a formidable challenge. In this work we develop a real-time, open-ended dialogue system that uses reinforcement learning (RL) to power a bot's conversational skill at scale. Our work pairs the succinct embedding of the conversation state generated using SOTA (supervised) language models with RL techniques that are particularly suited to a dynamic action space that changes as the conversation progresses. Trained using crowd-sourced data, our novel system is able to substantially exceeds the (strong) baseline supervised model with respect to several metrics of interest in a live experiment with real users of the Google Assistant.

preprint2020arXiv

Action Assembly: Sparse Imitation Learning for Text Based Games with Combinatorial Action Spaces

We propose a computationally efficient algorithm that combines compressed sensing with imitation learning to solve text-based games with combinatorial action spaces. Specifically, we introduce a new compressed sensing algorithm, named IK-OMP, which can be seen as an extension to the Orthogonal Matching Pursuit (OMP). We incorporate IK-OMP into a supervised imitation learning setting and show that the combined approach (Sparse Imitation Learning, Sparse-IL) solves the entire text-based game of Zork1 with an action space of approximately 10 million actions given both perfect and noisy demonstrations.

preprint2016arXiv

CaSCADE: Compressed Carrier and DOA Estimation

Spectrum sensing and direction of arrival (DOA) estimation have been thoroughly investigated, both separately and as a joint task. Estimating the support of a set of signals and their DOAs is crucial to many signal processing applications, such as Cognitive Radio (CR). A challenging scenario, faced by CRs, is that of multiband signals, composed of several narrowband transmissions spread over a wide spectrum each with unknown carrier frequencies and DOAs. The Nyquist rate of such signals is high and constitutes a bottleneck both in the analog and digital domains. To alleviate the sampling rate issue, several sub-Nyquist sampling methods, such as multicoset sampling or the modulated wideband converter (MWC), have been proposed in the context of spectrum sensing. In this work, we first suggest an alternative sub-Nyquist sampling and signal reconstruction method to the MWC, based on a uniform linear array (ULA). We then extend our approach to joint spectrum sensing and DOA estimation and propose the CompreSsed CArrier and DOA Estimation (CaSCADE) system, composed of an L-shaped array with two ULAs. In both cases, we derive perfect recovery conditions of the signal parameters (carrier frequencies and DOAs if relevant) and the signal itself and provide two reconstruction algorithms, one based on the ESPRIT method and the second on compressed sensing techniques. Both our joint carriers and DOAs recovery algorithms overcome the well-known pairing issue between the two parameters. Simulations demonstrate that our alternative spectrum sensing system outperforms the MWC in terms of recovery error and design complexity and show joint carrier frequencies and DOAs from our CaSCADE system's sub-Nyquist samples.

preprint2016arXiv

Spectrum Sharing Radar: Coexistence via Xampling

This paper presents a spectrum sharing technology enabling interference-free operation of a surveillance radar and communication transmissions over a common spectrum. A cognitive radio receiver senses the spectrum using low sampling and processing rates. The radar is a cognitive system that employs a Xampling-based receiver and transmits in several narrow bands. Our main contribution is the alliance of two previous ideas, CRo and cognitive radar (CRr), and their adaptation to solve the spectrum sharing problem.

preprint2016arXiv

SUMMeR: Sub-Nyquist MIMO Radar

Multiple input multiple output (MIMO) radar exhibits several advantages with respect to traditional radar array systems in terms of flexibility and performance. However, MIMO radar poses new challenges for both hardware design and digital processing. In particular, achieving high azimuth resolution requires a large number of transmit and receive antennas. In addition, the digital processing is performed on samples of the received signal, from each transmitter to each receiver, at its Nyquist rate, which can be prohibitively large when high resolution is needed. Overcoming the rate bottleneck, sub-Nyquist sampling methods have been proposed that break the link between radar signal bandwidth and sampling rate. In this work, we extend these methods to MIMO configurations and propose a sub-Nyquist MIMO radar (SUMMeR) system that performs both time and spatial compression. We present a range-azimuth-Doppler recovery algorithm from sub-Nyquist samples obtained from a reduced number of transmitters and receivers, that exploits the sparsity of the recovered targets' parameters. This allows us to achieve reduction in the number of deployed antennas and the number of samples per receiver, without degrading the time and spatial resolutions. Simulations illustrate the detection performance of SUMMeR for different compression levels and shows that both time and spatial resolution are preserved, with respect to classic Nyquist MIMO configurations. We also examine the impact of design parameters, such as antennas' locations and carrier frequencies, on the detection performance, and provide guidelines for their choice.

preprint2013arXiv

Sub-Nyquist Sampling for Power Spectrum Sensing in Cognitive Radios: A Unified Approach

In light of the ever-increasing demand for new spectral bands and the underutilization of those already allocated, the concept of Cognitive Radio (CR) has emerged. Opportunistic users could exploit temporarily vacant bands after detecting the absence of activity of their owners. One of the crucial tasks in the CR cycle is therefore spectrum sensing and detection which has to be precise and efficient. Yet, CRs typically deal with wideband signals whose Nyquist rates are very high. In this paper, we propose to reconstruct the power spectrum of such signals from sub-Nyquist samples, rather than the signal itself as done in previous work, in order to perform detection. We consider both sparse and non sparse signals as well as blind and non blind detection in the sparse case. For each one of those scenarii, we derive the minimal sampling rate allowing perfect reconstruction of the signal's power spectrum in a noise-free environment and provide power spectrum recovery techniques that achieve those rates. The analysis is performed for two different signal models considered in the literature, which we refer to as the analog and digital models, and shows that both lead to similar results. Simulations demonstrate power spectrum recovery at the minimal rate in noise-free settings and show the impact of several parameters on the detector performance, including signal-to-noise ratio (SNR), sensing time and sampling rate.