BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Remco Duits

Remco Duits appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
Computer Visionmath.DGmath.NAmath.APmath.OCMachine Learning

Catalog footprint

What is connected

11works
6topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

11 published item(s)

preprint2022arXiv

PDE-based Group Equivariant Convolutional Neural Networks

We present a PDE-based framework that generalizes Group equivariant Convolutional Neural Networks (G-CNNs). In this framework, a network layer is seen as a set of PDE-solvers where geometrically meaningful PDE-coefficients become the layer's trainable weights. Formulating our PDEs on homogeneous spaces allows these networks to be designed with built-in symmetries such as rotation in addition to the standard translation equivariance of CNNs. Having all the desired symmetries included in the design obviates the need to include them by means of costly techniques such as data augmentation. We will discuss our PDE-based G-CNNs (PDE-G-CNNs) in a general homogeneous space setting while also going into the specifics of our primary case of interest: roto-translation equivariance. We solve the PDE of interest by a combination of linear group convolutions and non-linear morphological group convolutions with analytic kernel approximations that we underpin with formal theorems. Our kernel approximations allow for fast GPU-implementation of the PDE-solvers, we release our implementation with this article in the form of the LieTorch extension to PyTorch, available at https://gitlab.com/bsmetsjr/lietorch . Just like for linear convolution a morphological convolution is specified by a kernel that we train in our PDE-G-CNNs. In PDE-G-CNNs we do not use non-linearities such as max/min-pooling and ReLUs as they are already subsumed by morphological convolutions. We present a set of experiments to demonstrate the strength of the proposed PDE-G-CNNs in increasing the performance of deep learning based imaging applications with far fewer parameters than traditional CNNs.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Roto-Translation Equivariant Convolutional Networks: Application to Histopathology Image Analysis

Rotation-invariance is a desired property of machine-learning models for medical image analysis and in particular for computational pathology applications. We propose a framework to encode the geometric structure of the special Euclidean motion group SE(2) in convolutional networks to yield translation and rotation equivariance via the introduction of SE(2)-group convolution layers. This structure enables models to learn feature representations with a discretized orientation dimension that guarantees that their outputs are invariant under a discrete set of rotations. Conventional approaches for rotation invariance rely mostly on data augmentation, but this does not guarantee the robustness of the output when the input is rotated. At that, trained conventional CNNs may require test-time rotation augmentation to reach their full capability. This study is focused on histopathology image analysis applications for which it is desirable that the arbitrary global orientation information of the imaged tissues is not captured by the machine learning models. The proposed framework is evaluated on three different histopathology image analysis tasks (mitosis detection, nuclei segmentation and tumor classification). We present a comparative analysis for each problem and show that consistent increase of performances can be achieved when using the proposed framework.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Numerical Approaches for Linear Left-invariant Diffusions on SE(2), their Comparison to Exact Solutions, and their Applications in Retinal Imaging

Left-invariant PDE-evolutions on the roto-translation group $SE(2)$ (and their resolvent equations) have been widely studied in the fields of cortical modeling and image analysis. They include hypo-elliptic diffusion (for contour enhancement) proposed by Citti & Sarti, and Petitot, and they include the direction process (for contour completion) proposed by Mumford. This paper presents a thorough study and comparison of the many numerical approaches, which, remarkably, is missing in the literature. Existing numerical approaches can be classified into 3 categories: Finite difference methods, Fourier based methods (equivalent to $SE(2)$-Fourier methods), and stochastic methods (Monte Carlo simulations). There are also 3 types of exact solutions to the PDE-evolutions that were derived explicitly (in the spatial Fourier domain) in previous works by Duits and van Almsick in 2005. Here we provide an overview of these 3 types of exact solutions and explain how they relate to each of the 3 numerical approaches. We compute relative errors of all numerical approaches to the exact solutions, and the Fourier based methods show us the best performance with smallest relative errors. We also provide an improvement of Mathematica algorithms for evaluating Mathieu-functions, crucial in implementations of the exact solutions. Furthermore, we include an asymptotical analysis of the singularities within the kernels and we propose a probabilistic extension of underlying stochastic processes that overcomes the singular behavior in the origin of time-integrated kernels. Finally, we show retinal imaging applications of combining left-invariant PDE-evolutions with invertible orientation scores.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

On sub-Riemannian geodesics in $SE(3)$ whose spatial projections do not have cusps

We consider the problem $\mathbf{P_{curve}}$ of minimizing $\int \limits_0^L \sqrt{ξ^2 + κ^2(s)} \, {\rm d}s$ for a curve $\mathbf{x}$ on $\mathbb R$ with fixed boundary points and directions. Here the total length $L\geq 0$ is free, $s$ denotes the arclength parameter, $κ$ denotes the absolute curvature of $\mathbf{x}$, and $ξ>0$ is constant. We lift problem $\mathbf{P_{curve}}$ on $\mathbb R^3$ to a sub-Riemannian problem $\mathbf{P_{mec}}$ on $\operatorname{SE(3)}\nolimits/(\{\mathbf{0}\}\times \operatorname{SO(2)}\nolimits)$. Here, for admissible boundary conditions, the spatial projections of sub-Riemannian geodesics do not exhibit cusps and they solve problem $\mathbf{P_{curve}}$. We apply the Pontryagin Maximum Principle (PMP) and prove Liouville integrability of the Hamiltonian system. We derive explicit analytic formulas for such sub-Riemannian geodesics, relying on the co-adjoint orbit structure, an underlying Cartan connection, and the matrix representation of $\operatorname{SE(3)}\nolimits$ arising in the Cartan-matrix. These formulas allow us to extract geometrical properties of the sub-Riemannian geodesics with cuspless projection, such as planarity conditions, explicit bounds on their torsion, and their symmetries. Furthermore, they allow us to parameterize all admissible boundary conditions reachable by geodesics with cuspless spatial projection. Such projections lay in the upper half space. We prove this for most cases, and the rest is checked numerically. Finally, we employ the formulas to numerically solve the boundary value problem, and visualize the set of admissible boundary conditions.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Invertible Orientation Scores of 3D Images

The enhancement and detection of elongated structures in noisy image data is relevant for many biomedical applications. To handle complex crossing structures in 2D images, 2D orientation scores were introduced, which already showed their use in a variety of applications. Here we extend this work to 3D orientation scores. First, we construct the orientation score from a given dataset, which is achieved by an invertible coherent state type of transform. For this transformation we introduce 3D versions of the 2D cake-wavelets, which are complex wavelets that can simultaneously detect oriented structures and oriented edges. For efficient implementation of the different steps in the wavelet creation we use a spherical harmonic transform. Finally, we show some first results of practical applications of 3D orientation scores.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Sub-Riemannian Fast Marching in SE(2)

We propose a Fast Marching based implementation for computing sub-Riemanninan (SR) geodesics in the roto-translation group SE(2), with a metric depending on a cost induced by the image data. The key ingredient is a Riemannian approximation of the SR-metric. Then, a state of the art Fast Marching solver that is able to deal with extreme anisotropies is used to compute a SR-distance map as the solution of a corresponding eikonal equation. Subsequent backtracking on the distance map gives the geodesics. To validate the method, we consider the uniform cost case in which exact formulas for SR-geodesics are known and we show remarkable accuracy of the numerically computed SR-spheres. We also show a dramatic decrease in computational time with respect to a previous PDE-based iterative approach. Regarding image analysis applications, we show the potential of considering these data adaptive geodesics for a fully automated retinal vessel tree segmentation.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Vesselness via Multiple Scale Orientation Scores

The multi-scale Frangi vesselness filter is an established tool in (retinal) vascular imaging. However, it cannot cope with crossings or bifurcations, since it only looks for elongated structures. Therefore, we disentangle crossing structures in the image via (multiple scale) invertible orientation scores. The described vesselness filter via scale-orientation scores performs considerably better at enhancing vessels throughout crossings and bifurcations than the Frangi version. Both methods are evaluated on a public dataset. Performance is measured by comparing ground truth data to the segmentation results obtained by basic thresholding and morphological component analysis of the filtered images.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

A Multi-Orientation Analysis Approach to Retinal Vessel Tracking

This paper presents a method for retinal vasculature extraction based on biologically inspired multi-orientation analysis. We apply multi-orientation analysis via so-called invertible orientation scores, modeling the cortical columns in the visual system of higher mammals. This allows us to generically deal with many hitherto complex problems inherent to vessel tracking, such as crossings, bifurcations, parallel vessels, vessels of varying widths and vessels with high curvature. Our approach applies tracking in invertible orientation scores via a novel geometrical principle for curve optimization in the Euclidean motion group SE(2). The method runs fully automatically and provides a detailed model of the retinal vasculature, which is crucial as a sound basis for further quantitative analysis of the retina, especially in screening applications.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Curve cuspless reconstruction via sub-Riemannian geometry

We consider the problem of minimizing $\int_{0}^L \sqrt{ξ^2 +K^2(s)}\, ds $ for a planar curve having fixed initial and final positions and directions. The total length $L$ is free. Here $s$ is the variable of arclength parametrization, $K(s)$ is the curvature of the curve and $ξ>0$ a parameter. This problem comes from a model of geometry of vision due to Petitot, Citti and Sarti. We study existence of local and global minimizers for this problem. We prove that if for a certain choice of boundary conditions there is no global minimizer, then there is neither a local minimizer nor a geodesic. We finally give properties of the set of boundary conditions for which there exists a solution to the problem.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Diffusion, Convection and Erosion on SE(3)/({0} \times SO(2)) and their Application to the Enhancement of Crossing Fibers

In this article we study both left-invariant (convection-)diffusions and left-invariant Hamilton-Jacobi equations on the space SE(3)/({0} \times SO(2)) of 3D-positions and orientations naturally embedded in the group SE(3) of 3D-rigid body movements. The general motivation for these (convection-)diffusions and erosions is to obtain crossing-preserving fiber enhancement on probability densities defined on the space of positions and orientations. The linear left-invariant (convection-)diffusions are forward Kolmogorov equations of Brownian motions on SE(3)/({0}\timesSO(2)) and can be solved by convolution with the corresponding Green's functions or by a finite difference scheme. The left-invariant Hamilton-Jacobi equations are Bellman equations of cost processes on SE(3)/({0}\timesSO(2)) and they are solved by a morphological convolution with the corresponding Green's functions. Furthermore, we consider pseudo-linear scale spaces on the space of positions and orientations that combines dilation and diffusion in a single evolution. In our design and analysis for appropriate linear, non-linear, morphological and pseudo-linear scale spaces on SE(3)/({0}\timesSO(2)) we employ the underlying differential geometry on SE(3), where the frame of left-invariant vector fields serves as a moving frame of reference. Furthermore, we will present new and simpler finite difference schemes for our diffusions, which are clear improvements of our previous finite difference schemes. We apply our theory to the enhancement of fibres in magnetic resonance imaging (MRI) techniques for imaging water diffusion processes in brain white matter. We provide experiments of our crossing-preserving evolutions on neural images of a human brain containing crossing fibers.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

Evolution Equations on Gabor Transforms and their Applications

We introduce a systematic approach to the design, implementation and analysis of left-invariant evolution schemes acting on Gabor transform, primarily for applications in signal and image analysis. Within this approach we relate operators on signals to operators on Gabor transforms. In order to obtain a translation and modulation invariant operator on the space of signals, the corresponding operator on the reproducing kernel space of Gabor transforms must be left invariant, i.e. it should commute with the left regular action of the reduced Heisenberg group H_r. By using the left-invariant vector fields on H_r in the generators of our evolution equations on Gabor transforms, we naturally employ the essential group structure on the domain of a Gabor transform. Here we distinguish between two tasks. Firstly, we consider non-linear adaptive left-invariant convection (reassignment) to sharpen Gabor transforms, while maintaining the original signal. Secondly, we consider signal enhancement via left-invariant diffusion on the corresponding Gabor transform. We provide numerical experiments and analytical evidence for our methods and we consider an explicit medical imaging application.

0 citations0 reviewsNo code linkedOpen access