BZPEERPapers, people, evidence and research paths
Menu

Discover

SearchFind papers, people, topics, institutions and opportunities from one place.GraphSee how papers, authors, topics and evidence connect.

Research tools

HomeContinue from the papers, people and topics that matter now.CollectionsTurn saved papers into reading lists, evidence maps and shareable context.ResearchReconstruct the path that led you from search to paper to question.CollaborationMove from a paper, topic or expert request into a focused thread.PublishCreate full-text research articles with metadata, formulas and versions.

Network

ExpertsFind specialists whose work and reviews explain why they can help.CommunitiesJoin research groups organized around papers, topics and shared evidence.

Opportunities

ListingsBrowse roles, calls and collaborations connected to real research context.

Account

Log inReturn to your saved papers, graph views and active threads.Create accountStart saving papers, building a research trail and joining teams.
Log inCreate account

Source author record

Roarke Horstmeyer

Roarke Horstmeyer appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record
physics.opticsComputer Visioneess.IVMachine LearningBiological PhysicsCell BehaviorCryptography and Securityphysics.data-anTissues and Organs

Catalog footprint

What is connected

18works
9topics
4close collaborators

Actions

Connect this record

Log in to claim
Open graphBrowse works

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

18 published item(s)

preprint2022arXiv

Imaging dynamics beneath turbid media via parallelized single-photon detection

Noninvasive optical imaging through dynamic scattering media has numerous important biomedical applications but still remains a challenging task. While standard diffuse imaging methods measure optical absorption or fluorescent emission, it is also well-established that the temporal correlation of scattered coherent light diffuses through tissue much like optical intensity. Few works to date, however, have aimed to experimentally measure and process such temporal correlation data to demonstrate deep-tissue video reconstruction of decorrelation dynamics. In this work, we utilize a single-photon avalanche diode (SPAD) array camera to simultaneously monitor the temporal dynamics of speckle fluctuations at the single-photon level from 12 different phantom tissue surface locations delivered via a customized fiber bundle array. We then apply a deep neural network to convert the acquired single-photon measurements into video of scattering dynamics beneath rapidly decorrelating tissue phantoms. We demonstrate the ability to reconstruct images of transient (0.1-0.4s) dynamic events occurring up to 8 mm beneath a decorrelating tissue phantom with millimeter-scale resolution, and highlight how our model can flexibly extend to monitor flow speed within buried phantom vessels.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Tensorial tomographic differential phase-contrast microscopy

We report Tensorial Tomographic Differential Phase-Contrast microscopy (T2DPC), a quantitative label-free tomographic imaging method for simultaneous measurement of phase and anisotropy. T2DPC extends differential phase-contrast microscopy, a quantitative phase imaging technique, to highlight the vectorial nature of light. The method solves for permittivity tensor of anisotropic samples from intensity measurements acquired with a standard microscope equipped with an LED matrix, a circular polarizer, and a polarization-sensitive camera. We demonstrate accurate volumetric reconstructions of refractive index, birefringence, and orientation for various validation samples, and show that the reconstructed polarization structures of a biological specimen are predictive of pathology.

0 citations0 reviewsNo code linkedOpen access
preprint2022arXiv

Transient motion classification through turbid volumes via parallelized single-photon detection and deep contrastive embedding

Fast noninvasive probing of spatially varying decorrelating events, such as cerebral blood flow beneath the human skull, is an essential task in various scientific and clinical settings. One of the primary optical techniques used is diffuse correlation spectroscopy (DCS), whose classical implementation uses a single or few single-photon detectors, resulting in poor spatial localization accuracy and relatively low temporal resolution. Here, we propose a technique termed Classifying Rapid decorrelation Events via Parallelized single photon dEtection (CREPE)}, a new form of DCS that can probe and classify different decorrelating movements hidden underneath turbid volume with high sensitivity using parallelized speckle detection from a $32\times32$ pixel SPAD array. We evaluate our setup by classifying different spatiotemporal-decorrelating patterns hidden beneath a 5mm tissue-like phantom made with rapidly decorrelating dynamic scattering media. Twelve multi-mode fibers are used to collect scattered light from different positions on the surface of the tissue phantom. To validate our setup, we generate perturbed decorrelation patterns by both a digital micromirror device (DMD) modulated at multi-kilo-hertz rates, as well as a vessel phantom containing flowing fluid. Along with a deep contrastive learning algorithm that outperforms classic unsupervised learning methods, we demonstrate our approach can accurately detect and classify different transient decorrelation events (happening in 0.1-0.4s) underneath turbid scattering media, without any data labeling. This has the potential to be applied to noninvasively monitor deep tissue motion patterns, for example identifying normal or abnormal cerebral blood flow events, at multi-Hertz rates within a compact and static detection probe.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Increasing a microscope's effective field of view via overlapped imaging and machine learning

This work demonstrates a multi-lens microscopic imaging system that overlaps multiple independent fields of view on a single sensor for high-efficiency automated specimen analysis. Automatic detection, classification and counting of various morphological features of interest is now a crucial component of both biomedical research and disease diagnosis. While convolutional neural networks (CNNs) have dramatically improved the accuracy of counting cells and sub-cellular features from acquired digital image data, the overall throughput is still typically hindered by the limited space-bandwidth product (SBP) of conventional microscopes. Here, we show both in simulation and experiment that overlapped imaging and co-designed analysis software can achieve accurate detection of diagnostically-relevant features for several applications, including counting of white blood cells and the malaria parasite, leading to multi-fold increase in detection and processing throughput with minimal reduction in accuracy.

0 citations0 reviewsNo code linkedOpen access
preprint2021arXiv

Roadmap on Wavefront Shaping and deep imaging in complex media

The last decade has seen the development of a wide set of tools, such as wavefront shaping, computational or fundamental methods, that allow to understand and control light propagation in a complex medium, such as biological tissues or multimode fibers. A vibrant and diverse community is now working on this field, that has revolutionized the prospect of diffraction-limited imaging at depth in tissues. This roadmap highlights several key aspects of this fast developing field, and some of the challenges and opportunities ahead.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Physics-enhanced machine learning for virtual fluorescence microscopy

This paper introduces a new method of data-driven microscope design for virtual fluorescence microscopy. Our results show that by including a model of illumination within the first layers of a deep convolutional neural network, it is possible to learn task-specific LED patterns that substantially improve the ability to infer fluorescence image information from unstained transmission microscopy images. We validated our method on two different experimental setups, with different magnifications and different sample types, to show a consistent improvement in performance as compared to conventional illumination methods. Additionally, to understand the importance of learned illumination on inference task, we varied the dynamic range of the fluorescent image targets (from one to seven bits), and showed that the margin of improvement for learned patterns increased with the information content of the target. This work demonstrates the power of programmable optical elements at enabling better machine learning algorithm performance and at providing physical insight into next generation of machine-controlled imaging systems.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Reconstructing undersampled photoacoustic microscopy images using deep learning

One primary technical challenge in photoacoustic microscopy (PAM) is the necessary compromise between spatial resolution and imaging speed. In this study, we propose a novel application of deep learning principles to reconstruct undersampled PAM images and transcend the trade-off between spatial resolution and imaging speed. We compared various convolutional neural network (CNN) architectures, and selected a fully dense U-net (FD U-net) model that produced the best results. To mimic various undersampling conditions in practice, we artificially downsampled fully-sampled PAM images of mouse brain vasculature at different ratios. This allowed us to not only definitively establish the ground truth, but also train and test our deep learning model at various imaging conditions. Our results and numerical analysis have collectively demonstrated the robust performance of our model to reconstruct PAM images with as few as 2% of the original pixels, which may effectively shorten the imaging time without substantially sacrificing the image quality.

0 citations0 reviewsNo code linkedOpen access
preprint2020arXiv

Towards an Intelligent Microscope: adaptively learned illumination for optimal sample classification

Recent machine learning techniques have dramatically changed how we process digital images. However, the way in which we capture images is still largely driven by human intuition and experience. This restriction is in part due to the many available degrees of freedom that alter the image acquisition process (lens focus, exposure, filtering, etc). Here we focus on one such degree of freedom - illumination within a microscope - which can drastically alter information captured by the image sensor. We present a reinforcement learning system that adaptively explores optimal patterns to illuminate specimens for immediate classification. The agent uses a recurrent latent space to encode a large set of variably-illuminated samples and illumination patterns. We train our agent using a reward that balances classification confidence with image acquisition cost. By synthesizing knowledge over multiple snapshots, the agent can classify on the basis of all previous images with higher accuracy than from naively illuminated images, thus demonstrating a smarter way to physically capture task-specific information.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Diffraction tomography with Fourier ptychography

This article presents a method to perform diffraction tomography in a standard microscope that includes an LED array for illumination. After acquiring a sequence of intensity-only images of a thick sample, a ptychography-based reconstruction algorithm solves for its unknown complex index of refraction across three dimensions. The experimental microscope demonstrates a spatial resolution of 0.39 $μ$m and an axial resolution of 3.7 $μ$m at the Nyquist-Shannon sampling limit (0.54 $μ$m and 5.0 $μ$m at the Sparrow limit, respectively), across a total imaging volume of 2.2 mm $\times$ 2.2 mm $\times$ 110 $μ$m. Unlike competing methods, the 3D tomograms presented in this article are continuous, quantitative, and formed without the need for interferometry or any moving parts. Wide field-of-view reconstructions of thick biological specimens demonstrate potential applications in pathology and developmental biology.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Toward Long Distance, Sub-diffraction Imaging Using Coherent Camera Arrays

In this work, we propose using camera arrays coupled with coherent illumination as an effective method of improving spatial resolution in long distance images by a factor of ten and beyond. Recent advances in ptychography have demonstrated that one can image beyond the diffraction limit of the objective lens in a microscope. We demonstrate a similar imaging system to image beyond the diffraction limit in long range imaging. We emulate a camera array with a single camera attached to an X-Y translation stage. We show that an appropriate phase retrieval based reconstruction algorithm can be used to effectively recover the lost high resolution details from the multiple low resolution acquired images. We analyze the effects of noise, required degree of image overlap, and the effect of increasing synthetic aperture size on the reconstructed image quality. We show that coherent camera arrays have the potential to greatly improve imaging performance. Our simulations show resolution gains of 10x and more are achievable. Furthermore, experimental results from our proof-of-concept systems show resolution gains of 4x-7x for real scenes. Finally, we introduce and analyze in simulation a new strategy to capture macroscopic Fourier Ptychography images in a single snapshot, albeit using a camera array.

0 citations0 reviewsNo code linkedOpen access
preprint2015arXiv

Translation correlations in anisotropically scattering media

Controlling light propagation across scattering media by wavefront shaping holds great promise for a wide range of communications and imaging applications. However, finding the right wavefront to shape is a challenge when the mapping between input and output scattered wavefronts (i.e. the transmission matrix) is not known. Correlations in transmission matrices, especially the so-called memory-effect, have been exploited to address this limitation. However, the traditional memory-effect applies to thin scattering layers at a distance from the target, which precludes its use within thick scattering media, such as fog and biological tissue. Here, we theoretically predict and experimentally verify new transmission matrix correlations within thick anisotropically scattering media, with important implications for biomedical imaging and adaptive optics.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Reconfigurable random bit storage using polymer-dispersed liquid crystal

We present an optical method of storing random cryptographic keys, at high densities, within an electronically reconfigurable volume of polymer-dispersed liquid crystal (PDLC) film. We demonstrate how temporary application of a voltage above PDLC's saturation threshold can completely randomize (i.e., decorrelate) its optical scattering potential in less than a second. A unique optical setup is built around this resettable PDLC film to non-electronically save many random cryptographic bits, with minimal error, over a period of one day. These random bits, stored at an unprecedented density (10 Gb per cubic millimeter), can then be erased and transformed into a new random key space in less than one second. Cryptographic applications of such a volumetric memory device include use as a crypto-currency wallet and as a source of resettable "fingerprints" for time-sensitive authentication.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Solving ptychography with a convex relaxation

Ptychography is a powerful computational imaging technique that transforms a collection of low-resolution images into a high-resolution sample reconstruction. Unfortunately, algorithms that are currently used to solve this reconstruction problem lack stability, robustness, and theoretical guarantees. Recently, convex optimization algorithms have improved the accuracy and reliability of several related reconstruction efforts. This paper proposes a convex formulation of the ptychography problem. This formulation has no local minima, it can be solved using a wide range of algorithms, it can incorporate appropriate noise models, and it can include multiple a priori constraints. The paper considers a specific algorithm, based on low-rank factorization, whose runtime and memory usage are near-linear in the size of the output image. Experiments demonstrate that this approach offers a 25% lower background variance on average than alternating projections, the current standard algorithm for ptychographic reconstruction.

0 citations0 reviewsNo code linkedOpen access
preprint2014arXiv

Wide-field, high-resolution Fourier ptychographic microscopy

In this article, we report an imaging method, termed Fourier ptychographic microscopy (FPM), which iteratively stitches together a number of variably illuminated, low-resolution intensity images in Fourier space to produce a wide-field, high-resolution complex sample image. By adopting a wavefront correction strategy, the FPM method can also correct for aberrations and digitally extend a microscope's depth-of-focus beyond the physical limitations of its optics. As a demonstration, we built a microscope prototype with a resolution of 0.78 um, a field-of-view of ~120 mm2, and a resolution-invariant depth-of-focus of 0.3 mm (characterized at 632 nm). Gigapixel colour images of histology slides verify FPM's successful operation. The reported imaging procedure transforms the general challenge of high-throughput, high-resolution microscopy from one that is coupled to the physical limitations of the system's optics to one that is solvable through computation.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Characterization of shift-variant pupil aberrations for wide field-of-view microscopy

We describe a simple and robust approach for characterizing the shift-variant pupil aberrations of wide field-of-view microscopy systems. We derive the location-dependent pupil transfer functions by first capturing multiple intensity images at different defocus settings; a generalized pattern search (GPS) algorithm is then applied to recover the complex pupil functions at ~350 different spatial locations over the entire field-of-view. Parameter fitting transforms these pupil functions into accurate 2D aberration maps. We demonstrate shift-variant aberration compensation by using an information-preserving image deconvolution scheme over the entire field-of-view. Such automated shift-variant pupil characterization will facilitate new approaches of aberration correction for future gigapixel imaging platforms.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Physical key-protected one-time pad

We describe an encrypted communication principle that can form a perfectly secure link between two parties without electronically saving either of their keys. Instead, cryptographic key bits are kept safe within the unique mesoscopic randomness of two volumetric scattering materials. We demonstrate how a shared set of patterned optical probes can generate 10 gigabits of statistically verified randomness between a pair of unique 2 cubic millimeter scattering objects. This shared randomness is used to facilitate information-theoretically secure communication following a modified one-time pad protocol. Benefits of volumetric physical storage over electronic memory include the inability to probe, duplicate or selectively reset any random bits without fundamentally altering the entire key space. Beyond the demonstrated communication scheme, our ability to securely couple the randomness contained within two unique physical objects may help strengthen the hardware for a large class of cryptographic protocols, which is currently a critically weak link in the security pipeline of our increasingly mobile communication culture.

0 citations0 reviewsNo code linkedOpen access
preprint2013arXiv

Quantitative phase imaging via Fourier ptychographic microscopy

Fourier ptychographic microscopy (FPM) is a recently developed imaging modality that uses angularly varying illumination to extend a system performance beyond the limit defined by its optical elements. The FPM technique applies a novel phase retrieval procedure to achieve both resolution enhancement and complex image recovery. In this letter, we compare FPM data to both theoretical prediction and phase-shifting digital holography measurement to show that its acquired phase maps are quantitative and artifact-free. We additionally explore the relationship between the achievable spatial and optical thickness resolution offered by a reconstructed FPM phase image. We conclude by demonstrating both enhanced visualization and the collection of otherwise unobservable sample information using FPM quantitative phase.

0 citations0 reviewsNo code linkedOpen access
preprint2010arXiv

View-Dependent Displays and the Space of Light Fields

In this paper we explore how light propagates from thin elements into a volume for viewing. In particular, devices that are typically connected with geometric optics, like parallax barriers, differ in treatment with those that obey physical optics, like holograms. However, the two concepts are often used to achieve the same effect of capturing or displaying a combination of spatial and angular information. This paper attempts to connect the two approaches under a general framework based in ray space, from which insights into applications and limitations of both parallax-based and holography-based systems can be observed. We show that each display form can generate a light distribution that can always be expressed as a rank-1 matrix. Knowledge of this limitation is then discussed in the context of extending the capabilities of current display forms by considering the use of partially coherent light.

0 citations0 reviewsNo code linkedOpen access