Paper detail

XPipeline: Starlight subtraction at scale for MagAO-X

MagAO-X is an extreme adaptive optics (ExAO) instrument for the Magellan Clay 6.5-meter telescope at Las Campanas Observatory in Chile. Its high spatial and temporal resolution can produce data rates of 1 TB/hr or more, including all AO system telemetry and science images. We describe the tools and architecture we use for commanding, telemetry, and science data transmission and storage. The high data volumes require a distributed approach to data processing, and we have developed a pipeline that can scale from a single laptop to dozens of HPC nodes. The same codebase can then be used for both quick-look functionality at the telescope and for post-processing. We present the software and infrastructure we have developed for ExAO data post-processing, and illustrate their use with recently acquired direct-imaging data.

preprint2022arXivOpen access
0citations
0reviews
0saves
Nocode
Nodataset
0institutions

Next steps

Decide what to do with this paper

Use like or dislike for the fast social read. The more specific scholarly feedback stays available below when needed.

Log in to curate

Reading frame

Keep the important context close to the paper

Keep the important signals around this paper in one place: votes, save state, collection context, reviews and the metadata you need before deciding what to do next.

Add specific reaction

Move through the context

Research map

Open full explorer

Move through nearby people, institutions, topics and adjacent work without leaving the paper page.

Building this graph slice

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Structured reviews

0 review(s)

ContributeLeave structured feedbackUse the review template when you have a concrete strength, concern or method question.Open review form

No structured reviews yet. High-signal critique starts here.

Work discussion

0 comment(s)

DiscussAdd a high-signal commentKeep quick notes, caveats and replication pointers separate from formal reviews.Open comment form

No discussion yet. The first strong comment sets the tone.