BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Dong Eui Chang

Dong Eui Chang appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.OCArtificial IntelligenceMachine Learningmath-phmath.DSmath.MPphysics.class-pheess.SYNeural and Evolutionary ComputingRoboticsSystems and ControlComputational Engineering, Finance, and Scienceeess.SPmath.NAphysics.flu-dyn

Catalog footprint

What is connected

13works
15topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

13 published item(s)

preprint2022arXiv

Feedback Gradient Descent: Efficient and Stable Optimization with Orthogonality for DNNs

The optimization with orthogonality has been shown useful in training deep neural networks (DNNs). To impose orthogonality on DNNs, both computational efficiency and stability are important. However, existing methods utilizing Riemannian optimization or hard constraints can only ensure stability while those using soft constraints can only improve efficiency. In this paper, we propose a novel method, named Feedback Gradient Descent (FGD), to our knowledge, the first work showing high efficiency and stability simultaneously. FGD induces orthogonality based on the simple yet indispensable Euler discretization of a continuous-time dynamical system on the tangent bundle of the Stiefel manifold. In particular, inspired by a numerical integration method on manifolds called Feedback Integrators, we propose to instantiate it on the tangent bundle of the Stiefel manifold for the first time. In the extensive image classification experiments, FGD comprehensively outperforms the existing state-of-the-art methods in terms of accuracy, efficiency, and stability.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Interaction-aware Kalman Neural Networks for Trajectory Prediction

Forecasting the motion of surrounding obstacles (vehicles, bicycles, pedestrians and etc.) benefits the on-road motion planning for intelligent and autonomous vehicles. Complex scenes always yield great challenges in modeling the patterns of surrounding traffic. For example, one main challenge comes from the intractable interaction effects in a complex traffic system. In this paper, we propose a multi-layer architecture Interaction-aware Kalman Neural Networks (IaKNN) which involves an interaction layer for resolving high-dimensional traffic environmental observations as interaction-aware accelerations, a motion layer for transforming the accelerations to interaction aware trajectories, and a filter layer for estimating future trajectories with a Kalman filter network. Attributed to the multiple traffic data sources, our end-to-end trainable approach technically fuses dynamic and interaction-aware trajectories boosting the prediction performance. Experiments on the NGSIM dataset demonstrate that IaKNN outperforms the state-of-the-art methods in terms of effectiveness for traffic trajectory prediction.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

The Adaptive Dynamic Programming Toolbox

The paper develops the Adaptive Dynamic Programming Toolbox (ADPT), which solves optimal control problems for continuous-time nonlinear systems. Based on the adaptive dynamic programming technique, the ADPT computes optimal feedback controls from the system dynamics in the model-based working mode, or from measurements of trajectories of the system in the model-free working mode without the requirement of knowledge of the system model. Multiple options are provided such that the ADPT can accommodate various customized circumstances. Compared to other popular software toolboxes for optimal control, the ADPT enjoys its computational precision and speed, which is illustrated with its applications to a satellite attitude control problem.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Invariant extended Kalman filter on matrix Lie groups

We derive symmetry preserving invariant extended Kalman filters (IEKF) on matrix Lie groups. These Kalman filters have an advantage over conventional extended Kalman filters as the error dynamics for such filters are independent of the group configuration which, in turn, provides a uniform estimate of the region of convergence. The proposed IEKF differs from existing techniques in literature on the account that it is derived using minimal tools from differential geometry that simplifies its representation and derivation to a large extent. The filter error dynamics is defined on the Lie algebra directly instead of identifying the Lie algebra with an Euclidean space or defining the error dynamics in local coordinates using exponential map, and the associated differential Riccati equations are described on the corresponding space of linear operators using tensor algebra. The proposed filter is implemented for the attitude dynamics of the rigid body, which is a benchmark problem in control, and its performance is compared against a conventional extended Kalman filter (EKF). Numerical experiments support that the IEKF is computationally less intensive and gives better performance than the EKF.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Noise Removal of FTIR Hyperspectral Images via MMSE

Fourier transform infrared (FTIR) hyperspectral imaging systems are deployed in various fields where spectral information is exploited. Chemical warfare agent (CWA) detection is one of such fields and it requires a fast and accurate process from the measurement to the visualization of detection results, including noise removal. A general concern of existing noise removal algorithms is a trade-off between time and performance. This paper suggests a minimum mean square error (MMSE) approach as an efficient noise removal algorithm for FTIR hyperspectral images. The experimental result shows that the MMSE estimator spends less time to achieve comparable performance to the existing algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A Geometric Framework for Convolutional Neural Networks

In this paper, a geometric framework for neural networks is proposed. This framework uses the inner product space structure underlying the parameter set to perform gradient descent not in a component-based form, but in a coordinate-free manner. Convolutional neural networks are described in this framework in a compact form, with the gradients of standard --- and higher-order --- loss functions calculated for each layer of the network. This approach can be applied to other network structures and provides a basis on which to create new networks.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

A Novel Representation of Neural Networks

Deep Neural Networks (DNNs) have become very popular for prediction in many areas. Their strength is in representation with a high number of parameters that are commonly learned via gradient descent or similar optimization methods. However, the representation is non-standardized, and the gradient calculation methods are often performed using component-based approaches that break parameters down into scalar units, instead of considering the parameters as whole entities. In this work, these problems are addressed. Standard notation is used to represent DNNs in a compact framework. Gradients of DNN loss functions are calculated directly over the inner product space on which the parameters are defined. This framework is general and is applied to two common network types: the Multilayer Perceptron and the Deep Autoencoder.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Feedback Integrators

A new method is proposed to numerically integrate a dynamical system on a manifold such that the trajectory stably remains on the manifold and preserves first integrals of the system. The idea is that given an initial point in the manifold we extend the dynamics from the manifold to its ambient Euclidean space and then modify the dynamics outside the intersection of the manifold and the level sets of the first integrals containing the initial point such that the intersection becomes a unique local attractor of the resultant dynamics. While the modified dynamics theoretically produces the same trajectory as the original dynamics, it yields a numerical trajectory that stably remains on the manifold and preserves the first integrals. The big merit of our method is that the modified dynamics can be integrated with any ordinary numerical integrator such as Euler or Runge-Kutta. We illustrate this method by applying it to three famous problems: the free rigid body, the Kepler problem and a perturbed Kepler problem with rotational symmetry. We also carry out simulation studies to demonstrate the excellence of our method and make comparisons with the standard projection method, a splitting method and Störmer-Verlet schemes.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

On the Method of Interconnection and Damping Assignment Passivity-Based Control for the Stabilization of Mechanical Systems

Interconnection and damping assignment passivity-based control (IDA-PBC) is an excellent method to stabilize mechanical systems in the Hamiltonian formalism. In this paper, several improvements are made on the IDA-PBC method. The skew-symmetric interconnection submatrix in the conventional form of IDA-PBC is shown to have some redundancy for systems with the number of degrees of freedom greater than two, containing unnecessary components that do not contribute to the dynamics. To completely remove this redundancy, the use of quadratic gyroscopic forces is proposed in place of the skew-symmetric interconnection submatrix. Reduction of the number of matching partial differential equations in IDA-PBC and simplification of the structure of the matching partial differential equations are achieved by eliminating the gyroscopic force from the matching partial differential equations. In addition, easily verifiable criteria are provided for Lyapunov/exponential stabilizability by IDA-PBC for all linear controlled Hamiltonian systems with arbitrary degrees of underactuation and for all nonlinear controlled Hamiltonian systems with one degree of underactuation. A general design procedure for IDA-PBC is given and illustrated with examples. The duality of the new IDA-PBC method to the method of controlled Lagrangians is discussed. This paper renders the IDA-PBC method as powerful as the controlled Lagrangian method.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Lyapunov-based Low-thrust Optimal Orbit Transfer: An approach in Cartesian coordinates

This paper presents a simple approach to low-thrust optimal-fuel and optimal-time transfer problems between two elliptic orbits using the Cartesian coordinates system. In this case, an orbit is described by its specific angular momentum and Laplace vectors with a free injection point. Trajectory optimization with the pseudospectral method and nonlinear programming are supported by the initial guess generated from the Chang-Chichka-Marsden Lyapunov-based transfer controller. This approach successfully solves several low-thrust optimal problems. Numerical results show that the Lyapunov-based initial guess overcomes the difficulty in optimization caused by the strong oscillation of variables in the Cartesian coordinates system. Furthermore, a comparison of the results shows that obtaining the optimal transfer solution through the polynomial approximation by utilizing Cartesian coordinates is easier than using orbital elements, which normally produce strongly nonlinear equations of motion. In this paper, the Earth's oblateness and shadow effect are not taken into account.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

On the Damping-Induced Self-Recovery Phenomenon in Mechanical Systems with Several Unactuated Cyclic Variables

The damping-induced self-recovery phenomenon refers to the fundamental property of underactuated mechanical systems: if an unactuated cyclic variable is under a viscous damping-like force and the system starts from rest, then the cyclic variable will always move back to its initial condition as the actuated variables come to stop. The regular momentum conservation phenomenon can be viewed as the limit of the damping-induced self-recovery phenomenon in the sense that the self-recovery phenomenon disappears as the damping goes to zero. This paper generalizes the past result on damping-induced self-recovery for the case of a single unactuated cyclic variable to the case of multiple unactuated cyclic variables. We characterize a class of external forces that induce new conserved quantities, which we call the damping-induced momenta. The damping-induced momenta yield first-order asymptotically stable dynamics for the unactuated cyclic variables under some conditions, thereby inducing the self-recovery phenomenon. It is also shown that the viscous damping-like forces impose bounds on the range of trajectories of the unactuated cyclic variables. Two examples are presented to demonstrate the analytical discoveries: the planar pendulum with gimbal actuators and the three-link planar manipulator on a horizontal plane.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

On the Self-Recovery Phenomenon in the Process of Diffusion

We report a new phenomenon, called self-recovery, in the process of diffusion in a region with boundary. Suppose that a diffusing quantity is uniformly distributed initially and then gets excited by the change in the boundary values over a time interval. When the boundary values return to their initial values and stop varying afterwards, the value of a physical quantity related to the diffusion automatically comes back to its original value. This self-recovery phenomenon has been discovered and fairly well understood for finite-dimensional mechanical systems with viscous damping. In this paper, we show that it also occurs in the process of diffusion. Several examples are provided from fluid flows, quasi-static electromagnetic fields and heat conduction. In particular, our result in fluid flows provides a dynamic explanation for the famous experiment by Sir G.I. Taylor with glycerine in an annulus on kinematic reversibility of low-Reynolds-number flows.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

A Short Proof of the Pontryagin Maximum Principle on Manifolds

Applying the Tubular Neighborhood Theorem, we give a short and new proof of the Pontryagin Maximum Principle on a smooth manifold. The idea is as follows. Given a control system on a manifold $M$, we embed it into an open subset of some $\mathbb R^n$, and extend the control system to the open set. Then, we apply the Pontryagin Maximum Principle on $\mathbb R^n$ to the extended system and project the consequence to $M$.

0 citations0 reviewsNo code linkedOpen access