BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Markus Haltmeier

Markus Haltmeier appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
math.NAMachine Learningeess.IVNumerical AnalysisComputer Visionmath.APmath.OCeess.SPApplicationsComputationInformation Theorymath.ITmath.STMethodologyphysics.data-anphysics.med-phStatistics TheorySystems and Control

Catalog footprint

What is connected

39works
18topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

39 published item(s)

preprint2026arXiv

HyDRA: Hybrid Denoising Regularization for Measurement-Only DEQ Training

Solving image reconstruction problems of the form \(\mathbf{A} \mathbf{x} = \mathbf{y}\) remains challenging due to ill-posedness and the lack of large-scale supervised datasets. Deep Equilibrium (DEQ) models have been used successfully but typically require supervised pairs \((\mathbf{x},\mathbf{y})\). In many practical settings, only measurements \(\mathbf{y}\) are available. We introduce HyDRA (Hybrid Denoising Regularization Adaptation), a measurement-only framework for DEQ training that combines measurement consistency with an adaptive denoising regularization term, together with a data-driven early stopping criterion. Experiments on sparse-view CT demonstrate competitive reconstruction quality and fast inference.

0 citations0 reviewsNo code linkedOpen access
preprint2026arXiv

Learning Regularization Functionals for Inverse Problems: A Comparative Study

In recent years, a variety of learned regularization frameworks for solving inverse problems in imaging have emerged. These offer flexible modeling together with mathematical insights. The proposed methods differ in their architectural design and training strategies, making direct comparison challenging due to non-modular implementations. We address this gap by collecting and unifying the available code into a common framework. This unified view allows us to systematically compare the approaches and highlight their strengths and limitations, providing valuable insights into their future potential. We also provide concise descriptions of each method, complemented by practical guidelines.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Convolutional Analysis Operator Learning by End-To-End Training of Iterative Neural Networks

The concept of sparsity has been extensively applied for regularization in image reconstruction. Typically, sparsifying transforms are either pre-trained on ground-truth images or adaptively trained during the reconstruction. Thereby, learning algorithms are designed to minimize some target function which encodes the desired properties of the transform. However, this procedure ignores the subsequently employed reconstruction algorithm as well as the physical model which is responsible for the image formation process. Iterative neural networks - which contain the physical model - can overcome these issues. In this work, we demonstrate how convolutional sparsifying filters can be efficiently learned by end-to-end training of iterative neural networks. We evaluated our approach on a non-Cartesian 2D cardiac cine MRI example and show that the obtained filters are better suitable for the corresponding reconstruction algorithm than the ones obtained by decoupled pre-training.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Convolutional Dictionary Learning by End-To-End Training of Iterative Neural Networks

Sparsity-based methods have a long history in the field of signal processing and have been successfully applied to various image reconstruction problems. The involved sparsifying transformations or dictionaries are typically either pre-trained using a model which reflects the assumed properties of the signals or adaptively learned during the reconstruction - yielding so-called blind Compressed Sensing approaches. However, by doing so, the transforms are never explicitly trained in conjunction with the physical model which generates the signals. In addition, properly choosing the involved regularization parameters remains a challenging task. Another recently emerged training-paradigm for regularization methods is to use iterative neural networks (INNs) - also known as unrolled networks - which contain the physical model. In this work, we construct an INN which can be used as a supervised and physics-informed online convolutional dictionary learning algorithm. We evaluated the proposed approach by applying it to a realistic large-scale dynamic MR reconstruction problem and compared it to several other recently published works. We show that the proposed INN improves over two conventional model-agnostic training methods and yields competitive results also compared to a deep INN. Further, it does not require to choose the regularization parameters and - in contrast to deep INNs - each network component is entirely interpretable.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Photoacoustic inversion formulas using mixed data on finite time intervals

We study the inverse source problem in photoacoustic tomography (PAT) for mixed data, which denote a weighted linear combination of the acoustic pressure and its normal derivative on an observation surface. We consider in particular the case where the data are only available on finite time intervals, which accounts for real-world usage of PAT where data are only feasible within a certain time interval. Extending our previous work, we derive explicit formulas up to a smoothing integral on convex domains with a smooth boundary, yielding exact reconstruction for circular or elliptical domains. We also present numerical reconstructions of our new exact inversion formulas on finite time intervals and compare them with the reconstructions of our previous formulas for unlimited time wave measurements.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Regularization of Inverse Problems by Filtered Diagonal Frame Decomposition

The characteristic feature of inverse problems is their instability with respect to data perturbations. In order to stabilize the inversion process, regularization methods have to be developed and applied. In this work we introduce and analyze the concept of filtered diagonal frame decomposition which extends the standard filtered singular value decomposition to the frame case. Frames as generalized singular system allows to better adapt to a given class of potential solutions. In this paper, we show that filtered diagonal frame decomposition yield a convergent regularization method. Moreover, we derive convergence rates under source type conditions and prove order optimality under the assumption that the considered frame is a Riesz-basis.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Surface Topography Characterization Using a Simple Optical Device and Artificial Neural Networks

State-of-the-art methods for quantifying wear in cylinder liners of large internal combustion engines require disassembly and cutting of the liner. This is followed by laboratory-based high-resolution microscopic surface depth measurement that quantitatively evaluates wear based on bearing load curves (Abbott-Firestone curves). Such methods are destructive, time-consuming and costly. The goal of the research presented is to develop nondestructive yet reliable methods for quantifying the surface topography. A novel machine learning framework is proposed that allows prediction of the bearing load curves from RGB images of the liner surface that can be collected with a handheld microscope. A joint deep learning approach involving two neural network modules optimizes the prediction quality of surface roughness parameters as well and is trained using a custom-built database containing 422 aligned depth profile and reflection image pairs of liner surfaces. The observed success suggests its great potential for on-site wear assessment of engines during service.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Unpaired Single-Image Depth Synthesis with cycle-consistent Wasserstein GANs

Real-time estimation of actual environment depth is an essential module for various autonomous system tasks such as localization, obstacle detection and pose estimation. During the last decade of machine learning, extensive deployment of deep learning methods to computer vision tasks yielded successful approaches for realistic depth synthesis out of a simple RGB modality. While most of these models rest on paired depth data or availability of video sequences and stereo images, there is a lack of methods facing single-image depth synthesis in an unsupervised manner. Therefore, in this study, latest advancements in the field of generative neural networks are leveraged to fully unsupervised single-image depth synthesis. To be more exact, two cycle-consistent generators for RGB-to-depth and depth-to-RGB transfer are implemented and simultaneously optimized using the Wasserstein-1 distance. To ensure plausibility of the proposed method, we apply the models to a self acquised industrial data set as well as to the renown NYU Depth v2 data set, which allows comparison with existing approaches. The observed success in this study suggests high potential for unpaired single-image depth estimation in real world applications.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Unsupervised Joint Image Transfer and Uncertainty Quantification Using Patch Invariant Networks

Unsupervised image transfer enables intra- and inter-modality image translation in applications where a large amount of paired training data is not abundant. To ensure a structure-preserving mapping from the input to the target domain, existing methods for unpaired image transfer are commonly based on cycle-consistency, causing additional computational resources and instability due to the learning of an inverse mapping. This paper presents a novel method for uni-directional domain mapping that does not rely on any paired training data. A proper transfer is achieved by using a GAN architecture and a novel generator loss based on patch invariance. To be more specific, the generator outputs are evaluated and compared at different scales, also leading to an increased focus on high-frequency details as well as an implicit data augmentation. This novel patch loss also offers the possibility to accurately predict aleatoric uncertainty by modeling an input-dependent scale map for the patch residuals. The proposed method is comprehensively evaluated on three well-established medical databases. As compared to four state-of-the-art methods, we observe significantly higher accuracy on these datasets, indicating great potential of the proposed method for unpaired image transfer with uncertainty taken into account. Implementation of the proposed framework is released here: \url{https://github.com/anger-man/unsupervised-image-transfer-and-uq}.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Unsupervised Single-shot Depth Estimation using Perceptual Reconstruction

Real-time estimation of actual object depth is an essential module for various autonomous system tasks such as 3D reconstruction, scene understanding and condition assessment. During the last decade of machine learning, extensive deployment of deep learning methods to computer vision tasks has yielded approaches that succeed in achieving realistic depth synthesis out of a simple RGB modality. Most of these models are based on paired RGB-depth data and/or the availability of video sequences and stereo images. The lack of sequences, stereo data and RGB-depth pairs makes depth estimation a fully unsupervised single-image transfer problem that has barely been explored so far. This study builds on recent advances in the field of generative neural networks in order to establish fully unsupervised single-shot depth estimation. Two generators for RGB-to-depth and depth-to-RGB transfer are implemented and simultaneously optimized using the Wasserstein-1 distance, a novel perceptual reconstruction term and hand-crafted image filters. We comprehensively evaluate the models using industrial surface depth data as well as the Texas 3D Face Recognition Database, the CelebAMask-HQ database of human portraits and the SURREAL dataset that records body depth. For each evaluation dataset the proposed method shows a significant increase in depth accuracy compared to state-of-the-art single-image transfer methods.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

A Variational View on Statistical Multiscale Estimation

We present a unifying view on various statistical estimation techniques including penalization, variational and thresholding methods. These estimators will be analyzed in the context of statistical linear inverse problems including nonparametric and change point regression, and high dimensional linear models as examples. Our approach reveals many seemingly unrelated estimation schemes as special instances of a general class of variational multiscale estimators, named MIND (MultIscale Nemirovskii--Dantzig). These estimators result from minimizing certain regularization functionals under convex constraints that can be seen as multiple statistical tests for local hypotheses. For computational purposes, we recast MIND in terms of simpler unconstraint optimization problems via Lagrangian penalization as well as Fenchel duality. Performance of several MINDs is demonstrated on numerical examples.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

An End-To-End-Trainable Iterative Network Architecture for Accelerated Radial Multi-Coil 2D Cine MR Image Reconstruction

Purpose: Iterative Convolutional Neural Networks (CNNs) which resemble unrolled learned iterative schemes have shown to consistently deliver state-of-the-art results for image reconstruction problems across different imaging modalities. However, because these methodes include the forward model in the architecture, their applicability is often restricted to either relatively small reconstruction problems or to problems with operators which are computationally cheap to compute. As a consequence, they have so far not been applied to dynamic non-Cartesian multi-coil reconstruction problems. Methods: In this work, we propose a CNN-architecture for image reconstruction of accelerated 2D radial cine MRI with multiple receiver coils. The network is based on a computationally light CNN-component and a subsequent conjugate gradient (CG) method which can be jointly trained end-to-end using an efficient training strategy. We investigate the proposed training-strategy and compare our method to other well-known reconstruction techniques with learned and non-learned regularization methods. Results: Our proposed method outperforms all other methods based on non-learned regularization. Further, it performs similar or better than a CNN-based method employing a 3D U-Net and a method using adaptive dictionary learning. In addition, we empirically demonstrate that even by training the network with only iteration, it is possible to increase the length of the network at test time and further improve the results. Conclusions: End-to-end training allows to highly reduce the number of trainable parameters of and stabilize the reconstruction network. Further, because it is possible to change the length of the network at test time, the need to find a compromise between the complexity of the CNN-block and the number of iterations in each CG-block becomes irrelevant.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Augmented NETT Regularization of Inverse Problems

We propose aNETT (augmented NETwork Tikhonov) regularization as a novel data-driven reconstruction framework for solving inverse problems. An encoder-decoder type network defines a regularizer consisting of a penalty term that enforces regularity in the encoder domain, augmented by a penalty that penalizes the distance to the data manifold. We present a rigorous convergence analysis including stability estimates and convergence rates. For that purpose, we prove the coercivity of the regularizer used without requiring explicit coercivity assumptions for the networks involved. We propose a possible realization together with a network architecture and a modular training strategy. Applications to sparse-view and low-dose CT show that aNETT achieves results comparable to state-of-the-art deep-learning-based reconstruction methods. Unlike learned iterative methods, aNETT does not require repeated application of the forward and adjoint models, which enables the use of aNETT for inverse problems with numerically expensive forward models. Furthermore, we show that aNETT trained on coarsely sampled data can leverage an increased sampling rate without the need for retraining.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Deep Structure Learning using Feature Extraction in Trained Projection Space

Over the last decade of machine learning, convolutional neural networks have been the most striking successes for feature extraction of rich sensory and high-dimensional data. While learning data representations via convolutions is already well studied and efficiently implemented in various deep learning libraries, one often faces limited memory capacity and insufficient number of training data, especially for high-dimensional and large-scale tasks. To overcome these limitations, we introduce a network architecture using a self-adjusting and data dependent version of the Radon-transform (linear data projection), also known as x-ray projection, to enable feature extraction via convolutions in lower-dimensional space. The resulting framework, named PiNet, can be trained end-to-end and shows promising performance on volumetric segmentation tasks. We test proposed model on public datasets to show that our approach achieves comparable results only using fractional amount of parameters. Investigation of memory usage and processing time confirms PiNet's superior efficiency compared to other segmentation models.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Multi-Scale Factorization of the Wave Equation with Application to Compressed Sensing Photoacoustic Tomography

Performing a large number of spatial measurements enables high-resolution photoacoustic imaging without specific prior information. However, the acquisition of spatial measurements is time-consuming, costly, and technically challenging. By exploiting nonlinear prior information, compressed sensing techniques in combination with sophisticated reconstruction algorithms allow reducing the number of measurements while maintaining high spatial resolution. To this end, in this work we propose a multiscale factorization for the wave equation that decomposes the measured data into a low-frequency factor and sparse high-frequency factors. By extending the acoustic reciprocity principle, we transfer sparsity in the measurement domain into spatial sparsity of the initial pressure, which allows the use of sparse reconstruction techniques. Numerical results are presented that demonstrate the feasibility of the proposed framework.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Recovering the Initial Data of the Wave Equation from Neumann Traces

We study the problem of recovering the initial data (f, 0) of the standard wave equation from the Neumann trace (the normal derivative) of the solution on the boundary of convex domains in arbitrary spatial dimension. Among others, this problem is relevant for tomographic image reconstruction including photoacoustic tomography. We establish explicit inversion formulas of the back-projection type that recover the initial data up to an additive term defined by a smoothing integral operator. In the case that the boundary of the domain is an ellipsoid, the integral operator vanishes, and hence we obtain an analytic formula for recovering the initial data from Neumann traces of the wave equation on ellipsoids.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

A Joint Deep Learning Approach for Automated Liver and Tumor Segmentation

Hepatocellular carcinoma (HCC) is the most common type of primary liver cancer in adults, and the most common cause of death of people suffering from cirrhosis. The segmentation of liver lesions in CT images allows assessment of tumor load, treatment planning, prognosis and monitoring of treatment response. Manual segmentation is a very time-consuming task and in many cases, prone to inaccuracies and automatic tools for tumor detection and segmentation are desirable. In this paper, we compare two network architectures, one that is composed of one neural network and manages the segmentation task in one step and one that consists of two consecutive fully convolutional neural networks. The first network segments the liver whereas the second network segments the actual tumor inside the liver. Our networks are trained on a subset of the LiTS (Liver Tumor Segmentation) Challenge and evaluated on data.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Data-consistent neural networks for solving nonlinear inverse problems

Data assisted reconstruction algorithms, incorporating trained neural networks, are a novel paradigm for solving inverse problems. One approach is to first apply a classical reconstruction method and then apply a neural network to improve its solution. Empirical evidence shows that such two-step methods provide high-quality reconstructions, but they lack a convergence analysis. In this paper we formalize the use of such two-step approaches with classical regularization theory. We propose data-consistent neural networks that we combine with classical regularization methods. This yields a data-driven regularization method for which we provide a full convergence analysis with respect to noise. Numerical simulations show that compared to standard two-step deep learning methods, our approach provides better stability with respect to structural changes in the test set, while performing similarly on test data similar to the training set. Our method provides a stable solution of inverse problems that exploits both the known nonlinear forward model as well as the desired solution manifold from data.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Deep synthesis regularization of inverse problems

Recently, a large number of efficient deep learning methods for solving inverse problems have been developed and show outstanding numerical performance. For these deep learning methods, however, a solid theoretical foundation in the form of reconstruction guarantees is missing. In contrast, for classical reconstruction methods, such as convex variational and frame-based regularization, theoretical convergence and convergence rate results are well established. In this paper, we introduce deep synthesis regularization (DESYRE) using neural networks as nonlinear synthesis operator bridging the gap between these two worlds. The proposed method allows to exploit the deep learning benefits of being well adjustable to available training data and on the other hand comes with a solid mathematical foundation. We present a complete convergence analysis with convergence rates for the proposed deep synthesis regularization. We present a strategy for constructing a synthesis network as part of an analysis-synthesis sequence together with an appropriate training strategy. Numerical results show the plausibility of our approach.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Neural Networks-based Regularization for Large-Scale Medical Image Reconstruction

In this paper we present a generalized Deep Learning-based approach for solving ill-posed large-scale inverse problems occuring in medical image reconstruction. Recently, Deep Learning methods using iterative neural networks and cascaded neural networks have been reported to achieve state-of-the-art results with respect to various quantitative quality measures as PSNR, NRMSE and SSIM across different imaging modalities. However, the fact that these approaches employ the forward and adjoint operators repeatedly in the network architecture requires the network to process the whole images or volumes at once, which for some applications is computationally infeasible. In this work, we follow a different reconstruction strategy by decoupling the regularization of the solution from ensuring consistency with the measured data. The regularization is given in the form of an image prior obtained by the output of a previously trained neural network which is used in a Tikhonov regularization framework. By doing so, more complex and sophisticated network architectures can be used for the removal of the artefacts or noise than it is usually the case in iterative networks. Due to the large scale of the considered problems and the resulting computational complexity of the employed networks, the priors are obtained by processing the images or volumes as patches or slices. We evaluated the method for the cases of 3D cone-beam low dose CT and undersampled 2D radial cine MRI and compared it to a total variation-minimization-based reconstruction algorithm as well as to a method with regularization based on learned overcomplete dictionaries. The proposed method outperformed all the reported methods with respect to all chosen quantitative measures and further accelerates the regularization step in the reconstruction by several orders of magnitude.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Regularization of Inverse Problems by Neural Networks

Inverse problems arise in a variety of imaging applications including computed tomography, non-destructive testing, and remote sensing. The characteristic features of inverse problems are the non-uniqueness and instability of their solutions. Therefore, any reasonable solution method requires the use of regularization tools that select specific solutions and at the same time stabilize the inversion process. Recently, data-driven methods using deep learning techniques and neural networks demonstrated to significantly outperform classical solution methods for inverse problems. In this chapter, we give an overview of inverse problems and demonstrate the necessity of regularization concepts for their solution. We show that neural networks can be used for the data-driven solution of inverse problems and review existing deep learning methods for inverse problems. In particular, we view these deep learning methods from the perspective of regularization theory, the mathematical foundation of stable solution methods for inverse problems. This chapter is more than just a review as many of the presented theoretical results extend existing ones.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Sparse aNETT for Solving Inverse Problems with Deep Learning

We propose a sparse reconstruction framework (aNETT) for solving inverse problems. Opposed to existing sparse reconstruction techniques that are based on linear sparsifying transforms, we train an autoencoder network $D \circ E$ with $E$ acting as a nonlinear sparsifying transform and minimize a Tikhonov functional with learned regularizer formed by the $\ell^q$-norm of the encoder coefficients and a penalty for the distance to the data manifold. We propose a strategy for training an autoencoder based on a sample set of the underlying image class such that the autoencoder is independent of the forward operator and is subsequently adapted to the specific forward model. Numerical results are presented for sparse view CT, which clearly demonstrate the feasibility, robustness and the improved generalization capability and stability of aNETT over post-processing networks.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

The conical Radon transform with vertices on triple lines

We study the inversion of the conical Radon which integrates a function in three-dimensional space from integrals over circular cones. The conical Radon recently got significant attention due to its relevance in various imaging applications such as Compton camera imaging and single scattering optical tomography. The unrestricted conical Radon transform is over-determined because the manifold of all cones depends on six variables: the center position, the axis orientation and the opening angle of the cone. In this work, we consider a particular restricted transform using triple line sensors where integrals over a three-dimensional set of cones are collected, determined by a one-dimensional vertex set, a one-dimensional set of central axes, and the one-dimensional set of opening angle. As the main result in this paper, we derive an analytic inversion formula for the restricted conical Radon transform. Along that way we define a certain ray transform adapted to the triple line sensor for which we establish an analytic inversion formula.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Unsupervised Adaptive Neural Network Regularization for Accelerated Radial Cine MRI

In this work, we propose an iterative reconstruction scheme (ALONE - Adaptive Learning Of NEtworks) for 2D radial cine MRI based on ground truth-free unsupervised learning of shallow convolutional neural networks. The network is trained to approximate patches of the current estimate of the solution during the reconstruction. By imposing a shallow network topology and constraining the $L_2$-norm of the learned filters, the network's representation power is limited in order not to be able to recover noise. Therefore, the network can be interpreted to perform a low dimensional approximation of the patches for stabilizing the inversion process. We compare the proposed reconstruction scheme to two ground truth-free reconstruction methods, namely a well known Total Variation (TV) minimization and an unsupervised adaptive Dictionary Learning (DIC) method. The proposed method outperforms both methods with respect to all reported quantitative measures. Further, in contrast to DIC, where the sparse approximation of the patches involves the solution of a complex optimization problem, ALONE only requires a forward pass of all patches through the shallow network and therefore significantly accelerates the reconstruction.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Photoacoustic Tomography with Direction Dependent Data: An Exact Series Reconstruction Approach

Photoacoustic image reconstruction often assumes that the restriction of the acoustic pressure on the detection surface is given. However, commonly used detectors often have a certain directivity and frequency dependence, in which case the measured data are more accurately described as a linear combination of the acoustic pressure and its normal derivative on the detection surface. In this paper, we consider the inverse source problem for data that are a combination of an acoustic pressure of the wave equation and its normal derivative For the special case of a spherical detection geometry we derive exact frequency domain reconstruction formulas. We present numerical results showing the robustness and validity of the derived formulas. Moreover, we compare several different combinations of the pressure and its normal derivative showing that used measurement model significantly affects the recovered initial pressure.

0 citations0 reviewsNo code linkedOpen access
preprint2019arXiv

Random 2.5D U-net for Fully 3D Segmentation

Convolutional neural networks are state-of-the-art for various segmentation tasks. While for 2D images these networks are also computationally efficient, 3D convolutions have huge storage requirements and therefore, end-to-end training is limited by GPU memory and data size. To overcome this issue, we introduce a network structure for volumetric data without 3D convolution layers. The main idea is to include projections from different directions to transform the volumetric data to a sequence of images, where each image contains information of the full data. We then apply 2D convolutions to these projection images and lift them again to volumetric data using a trainable reconstruction algorithm. The proposed architecture can be applied end-to-end to very large data volumes without cropping or sliding-window techniques. For a tested sparse binary segmentation task, it outperforms already known standard approaches and is more resistant to generation of artefacts.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Analytic inversion of a conical Radon transform arising in application of Compton cameras on the cylinder

Single photon emission computed tomography (SPECT) is a well established clinical tool for functional imaging. A limitation of current SPECT systems is the use of mechanical collimation, where only a small fraction of the emitted photons is actually used for image reconstruction. This results in large noise level and finally in a limited spatial resolution. In order to decrease the noise level and to increase the imaging resolution, Compton cameras have been proposed as an alternative to mechanical collimators. Image reconstruction in SPECT with Compton cameras yields to the problem of recovering a marker distribution from integrals over conical surfaces. Due to this and other applications, such conical Radon transforms recently got significant attention. In the current paper we consider the case where the cones of integration have vertices on a circular cylinder and axis pointing to the symmetry axis of the cylinder. As main results we derive analytic reconstruction methods for the considered transform. We also investigate the V-line transform with vertices on a circle and symmetry axis orthogonal to the circle, which arises in the special case where the absorber distribution is located in a horizontal plane.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Compressed sensing and sparsity in photoacoustic tomography

Increasing the imaging speed is a central aim in photoacoustic tomography. This issue is especially important in the case of sequential scanning approaches as applied for most existing optical detection schemes. In this work we address this issue using techniques of compressed sensing. We demonstrate, that the number of measurements can significantly be reduced by allowing general linear measurements instead of point-wise pressure values. A main requirement in compressed sensing is the sparsity of the unknowns to be recovered. For that purpose we develop the concept of sparsifying temporal transforms for three-dimensional photoacoustic tomography. We establish a two-stage algorithm that recovers the complete pressure Signals in a first step and then applies a standard reconstruction algorithm such as back-projection. This yields a novel reconstruction method with much lower complexity than existing compressed sensing approaches for photoacoustic tomography. Reconstruction results for simulated and for experimental data verify that the proposed compressed sensing scheme allows to significantly reducing the number of spatial measurements without reducing the spatial resolution.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

Inversion of the attenuated V-line transform for SPECT with Compton cameras

The Compton camera is a promising alternative to the Anger camera for imaging gamma radiation, with the potential to significantly increase the sensitivity of SPECT. Two-dimensional Compton camera image reconstruction can be implemented by inversion of the V-line transform, which integrates the emission distribution over V-lines (unions of two half-lines), that have vertices on a surrounding detector array. Inversion of the V-line transform without attenuation has recently been addressed by several authors. However, it is well known from standard SPECT that ignoring attenuation can significantly degrade the quality of the reconstructed image. In this paper we address this issue and study the attenuated V-line transform accounting for attenuation of photons in SPECT with Compton cameras. We derive an analytic inversion approach based on circular harmonics expansion, and show uniqueness of reconstruction for the attenuated V-line transform. We further develop a discrete image reconstruction algorithm based on our analytic studies, and present numerical results that demonstrate the effectiveness of our algorithm.

0 citations0 reviewsNo code linkedOpen access
preprint2016arXiv

The spherical mean Radon transform with centers on cylindrical surfaces

Recovering a function from its spherical Radon transform with centers of spheres of integration restricted to a hypersurface is at the heart of several modern imaging technologies, including SAR, ultrasound imaging, and photo- and thermoacoustic tomography. In this paper we study an inversion of the spherical Radon transform with centers of integration restricted to cylindrical surfaces of the form $Γ\times \mathbb{R}^m$, where $Γ$ is a hypersurface in $\mathbb{R}^n$. We show that this transform can be decomposed into two lower dimensional spherical Radon transforms, one with centers on $Γ$ and one with a planar center-set in $\mathbb{R}^{m+1}$. Together with explicit inversion formulas for the spherical Radon transform with a planar center-set and existing algorithms for inverting the spherical Radon transform with a center-set $\mathbb{R}$, this yields reconstruction procedures for general cylindrical domains. In the special case of spherical or elliptical cylinders we obtain novel explicit inversion formulas. For three spatial dimensions, these inversion formulas can be implemented efficiently by backprojection type algorithms only requiring $\mathcal O(N^{4/3})$ floating point operations, where $N$ is the total number of unknowns to be recovered. We present numerical results demonstrating the efficiency of the derived algorithms.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

A Novel Compressed Sensing Scheme for Photoacoustic Tomography

Speeding up the data acquisition is one of the central aims to advance tomographic imaging. On the one hand, this reduces motion artifacts due to undesired movements, and on the other hand this decreases the examination time for the patient. In this article, we propose a new scheme for speeding up the data collection process in photoacoustic tomography. Our proposal is based on compressed sensing and reduces acquisition time and system costs while maintaining image quality. As measurement data we use random combinations of pressure values that we use to recover a complete set of pressure data prior to the actual image reconstruction. We obtain theoretical recovery guarantees for our compressed sensing scheme and support the theory by reconstruction results on simulated data as well as on experimental data.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Single-stage reconstruction algorithm for quantitative photoacoustic tomography

The development of efficient and accurate image reconstruction algorithms is one of the cornerstones of computed tomography. Existing algorithms for quantitative photoacoustic tomography currently operate in a two-stage procedure: First an inverse source problem for the acoustic wave propagation is solved, whereas in a second step the optical parameters are estimated from the result of the first step. Such an approach has several drawbacks. In this paper we therefore propose the use of single-stage reconstruction algorithms for quantitative photoacoustic tomography, where the optical parameters are directly reconstructed from the observed acoustical data. In that context we formulate the image reconstruction problem of quantitative photoacoustic tomography as a single nonlinear inverse problem by coupling the radiative transfer equation with the acoustic wave equation. The inverse problem is approached by Tikhonov regularization with a convex penalty in combination with the proximal gradient iteration for minimizing the Tikhonov functional. We present numerical results, where the proposed single-stage algorithm shows an improved reconstruction quality at a similar computational cost.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Universal inversion formulas for recovering a function from spherical means

The problem of reconstruction a function from spherical means is at the heart of several modern imaging modalities and other applications. In this paper we derive universal back-projection type reconstruction formulas for recovering a function in arbitrary dimension from averages over spheres centered on the boundary an arbitrarily shaped smooth convex domain. Provided that the unknown function is supported inside that domain, the derived formulas recover the unknown function up to an explicitly computed smoothing integral operator. For elliptical domains the integral operator is shown to vanish and hence we establish exact inversion formulas for recovering a function from spherical means centered on the boundary of elliptical domains in arbitrary dimension.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Aggregated motion estimation for real-time MRI reconstruction

Real-time magnetic resonance imaging (MRI) methods generally shorten the measuring time by acquiring less data than needed according to the sampling theorem. In order to obtain a proper image from such undersampled data, the reconstruction is commonly defined as the solution of an inverse problem, which is regularized by a priori assumptions about the object. While practical realizations have hitherto been surprisingly successful, strong assumptions about the continuity of image features may affect the temporal fidelity of the estimated images. Here we propose a novel approach for the reconstruction of serial real-time MRI data which integrates the deformations between nearby frames into the data consistency term. The method is not required to be affine or rigid and does not need additional measurements. Moreover, it handles multi-channel MRI data by simultaneously determining the image and its coil sensitivity profiles in a nonlinear formulation which also adapts to non-Cartesian (e.g., radial) sampling schemes. Experimental results of a motion phantom with controlled speed and in vivo measurements of rapid tongue movements demonstrate image improvements in preserving temporal fidelity and removing residual artifacts.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Exact reconstruction formulas for a Radon transform over cones

Inversion of Radon transforms is the mathematical foundation of many modern tomographic imaging modalities. In this paper we study a conical Radon transform, which is important for computed tomography taking Compton scattering into account. The conical Radon transform we study integrates a function in $\R^d$ over all conical surfaces having vertices on a hyperplane and symmetry axis orthogonal to this plane. As the main result we derive exact reconstruction formulas of the filtered back-projection type for inverting this transform.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Extreme Value Analysis of Empirical Frame Coefficients and Implications for Denoising by Soft-Thresholding

Denoising by frame thresholding is one of the most basic and efficient methods for recovering a discrete signal or image from data that are corrupted by additive Gaussian white noise. The basic idea is to select a frame of analyzing elements that separates the data in few large coefficients due to the signal and many small coefficients mainly due to the noise ε_n. Removing all data coefficients being in magnitude below a certain threshold yields a reconstruction of the original signal. In order to properly balance the amount of noise to be removed and the relevant signal features to be kept, a precise understanding of the statistical properties of thresholding is important. For that purpose we derive the asymptotic distribution of max_{ω\in Ω_n} |<ϕ_ω^n,ε_n>| for a wide class of redundant frames (ϕ_ω^n: ω\in Ω_n}. Based on our theoretical results we give a rationale for universal extreme value thresholding techniques yielding asymptotically sharp confidence regions and smoothness estimates corresponding to prescribed significance levels. The results cover many frames used in imaging and signal recovery applications, such as redundant wavelet systems, curvelet frames, or unions of bases. We show that `generically' a standard Gumbel law results as it is known from the case of orthonormal wavelet bases. However, for specific highly redundant frames other limiting laws may occur. We indeed verify that the translation invariant wavelet transform shows a different asymptotic behaviour.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Inversion of circular means and the wave equation on convex planar domains

We study the problem of recovering the initial data of the two dimensional wave equation from values of its solution on the boundary $\partial \Om$ of a smooth convex bounded domain $\Om \subset \R^2$. As a main result we establish back-projection type inversion formulas that recover any initial data with support in $\Om$ modulo an explicitly computed smoothing integral operator $\K_\Om$. For circular and elliptical domains the operator $\K_\Om$ is shown to vanish identically and hence we establish exact inversion formulas of the back-projection type in these cases. Similar results are obtained for recovering a function from its mean values over circles with centers on $\partial \Om$. Both reconstruction problems are, amongst others, essential for the hybrid imaging modalities photoacoustic and thermoacoustic tomography.

0 citations0 reviewsNo code linkedOpen access
preprint2011arXiv

The Residual Method for Regularizing Ill-Posed Problems

Although the \emph{residual method}, or \emph{constrained regularization}, is frequently used in applications, a detailed study of its properties is still missing. This sharply contrasts the progress of the theory of Tikhonov regularization, where a series of new results for regularization in Banach spaces has been published in the recent years. The present paper intends to bridge the gap between the existing theories as far as possible. We develop a stability and convergence theory for the residual method in general topological spaces. In addition, we prove convergence rates in terms of (generalized) Bregman distances, which can also be applied to non-convex regularization functionals. We provide three examples that show the applicability of our theory. The first example is the regularized solution of linear operator equations on $L^p$-spaces, where we show that the results of Tikhonov regularization generalize unchanged to the residual method. As a second example, we consider the problem of density estimation from a finite number of sampling points, using the Wasserstein distance as a fidelity term and an entropy measure as regularization term. It is shown that the densities obtained in this way depend continuously on the location of the sampled points and that the underlying density can be recovered as the number of sampling points tends to infinity. Finally, we apply our theory to compressed sensing. Here, we show the well-posedness of the method and derive convergence rates both for convex and non-convex regularization under rather weak conditions.

0 citations0 reviewsNo code linkedOpen access
preprint2008arXiv

On regularization methods of EM-Kaczmarz type

We consider regularization methods of Kaczmarz type in connection with the expectation-maximization (EM) algorithm for solving ill-posed equations. For noisy data, our methods are stabilized extensions of the well established ordered-subsets expectation-maximization iteration (OS-EM). We show monotonicity properties of the methods and present a numerical experiment which indicates that the extended OS-EM methods we propose are much faster than the standard EM algorithm.

0 citations0 reviewsNo code linkedOpen access