Researcher profile

Danimir T. Doncevic

Danimir T. Doncevic contributes to research discovery and scholarly infrastructure.

ResearcherAffiliation not importedOpen to collaborate

Trust snapshot

Quick read

Trust 15 - UnverifiedVerification L1Unclaimed author
3works
0followers
9topics
4close collaborators

Actions

Decide how to stay connected

Follow researcher0

Identity and collaboration

How to connect with this researcher

Claiming links this public author record to a researcher profile and unlocks direct collaboration workflows.

Log in to claim

Direct collaboration

Open a focused conversation when the fit is right

Claim this author entity first to unlock direct invitations.

Research graph

See the researcher in context

Open full explorer

Inspect adjacent work, topics, institutions and collaborators without jumping out to a separate graph page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

3 published item(s)

preprint2022arXiv

Hearts Gym: Learning Reinforcement Learning as a Team Event

Amidst the COVID-19 pandemic, the authors of this paper organized a Reinforcement Learning (RL) course for a graduate school in the field of data science. We describe the strategy and materials for creating an exciting learning experience despite the ubiquitous Zoom fatigue and evaluate the course qualitatively. The key organizational features are a focus on a competitive hands-on setting in teams, supported by a minimum of lectures providing the essential background on RL. The practical part of the course revolved around Hearts Gym, an RL environment for the card game Hearts that we developed as an entry-level tutorial to RL. Participants were tasked with training agents to explore reward shaping and other RL hyperparameters. For a final evaluation, the agents of the participants competed against each other.

preprint2022arXiv

Identification of MIMO Wiener-type Koopman Models for Data-Driven Model Reduction using Deep Learning

We use Koopman theory to develop a data-driven nonlinear model reduction and identification strategy for multiple-input multiple-output (MIMO) input-affine dynamical systems. While the present literature has focused on linear and bilinear Koopman models, we derive and use a Wiener-type Koopman formulation. We discuss that the Wiener structure is particularly suitable for model reduction, and can be naturally derived from Koopman theory. Moreover, the Wiener block-structure unifies the mathematical simplicity of linear dynamical blocks and the accuracy of bilinear dynamics. We present a Koopman deep-learning strategy combining autoencoders and linear dynamics that generates low-order surrogate models of MIMO Wiener type. In three case studies, we apply our framework for identification and reduction of a system with input multiplicity, a chemical reactor and a high-purity distillation column. We compare the prediction performance of the identified Wiener models to linear and bilinear Koopman models. We observe the highest accuracy and strongest model reduction capabilities of low-order Wiener-type Koopman models, making them promising for control.

preprint2022arXiv

Personalized Algorithm Generation: A Case Study in Learning ODE Integrators

We study the learning of numerical algorithms for scientific computing, which combines mathematically driven, handcrafted design of general algorithm structure with a data-driven adaptation to specific classes of tasks. This represents a departure from the classical approaches in numerical analysis, which typically do not feature such learning-based adaptations. As a case study, we develop a machine learning approach that automatically learns effective solvers for initial value problems in the form of ordinary differential equations (ODEs), based on the Runge-Kutta (RK) integrator architecture. We show that we can learn high-order integrators for targeted families of differential equations without the need for computing integrator coefficients by hand. Moreover, we demonstrate that in certain cases we can obtain superior performance to classical RK methods. This can be attributed to certain properties of the ODE families being identified and exploited by the approach. Overall, this work demonstrates an effective learning-based approach to the design of algorithms for the numerical solution of differential equations. This can be readily extended to other numerical tasks.