Source author record

Norman Gray

Norman Gray appears in the imported research catalog. Authorship, coauthor and topic links are available while profile ownership is still unclaimed.

ResearcherUnclaimed source record

Catalog footprint

What is connected

15works
11topics
4close collaborators

Actions

Connect this record

Log in to claim

Research graph

See the researcher in context

Open full explorer

Inspect adjacent papers, topics, institutions and collaborators without losing the researcher page.

Building this map preview

BZPEER is loading the nearby papers, people, topics and institutions for this page.

Published work

15 published item(s)

preprint2015arXiv

Learning from FITS: Limitations in use in modern astronomical research

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard, however, is showing its age. Developed in the late 1970s, the FITS authors made a number of implementation choices that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not anticipate the challenges which we are facing today in astronomical computing. Difficulties we now face include, but are not limited to, addressing the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets, and capturing significantly more complex metadata and data relationships. There are members of the community today who find some or all of these limitations unworkable, and have decided to move ahead with storing data in other formats. If this fragmentation continues, we risk abandoning the advantages of broad interoperability, and ready archivability, that the FITS format provides for astronomy. In this paper we detail some selected important problems which exist within the FITS standard today. These problems may provide insight into deeper underlying issues which reside in the format and we provide a discussion of some lessons learned. It is not our intention here to prescribe specific remedies to these issues; rather, it is to call attention of the FITS and greater astronomical computing communities to these problems in the hope that it will spur action to address them.

preprint2015arXiv

Significant problems in FITS limit its use in modern astronomical research

The Flexible Image Transport System (FITS) standard has been a great boon to astronomy, allowing observatories, scientists and the public to exchange astronomical information easily. The FITS standard is, however, showing its age. Developed in the late 1970s the FITS authors made a number of implementation choices for the format that, while common at the time, are now seen to limit its utility with modern data. The authors of the FITS standard could not appreciate the challenges which we would be facing today in astronomical computing. Difficulties we now face include, but are not limited to, having to address the need to handle an expanded range of specialized data product types (data models), being more conducive to the networked exchange and storage of data, handling very large datasets and the need to capture significantly more complex metadata and data relationships. There are members of the community today who find some (or all) of these limitations unworkable, and have decided to move ahead with storing data in other formats. This reaction should be taken as a wakeup call to the FITS community to make changes in the FITS standard, or to see its usage fall. In this paper we detail some selected important problems which exist within the FITS standard today. It is not our intention to prescribe specific remedies to these issues; rather, we hope to call attention of the FITS and greater astronomical computing communities to these issues in the hopes that it will spur action to address them.

preprint2015arXiv

Xoxa: a lightweight approach to normalizing and signing XML

Cryptographically signing XML, and normalizing it prior to signing, are forbiddingly intricate problems in the general case. This is largely because of the complexities of the XML Information Set. We can define a more aggressive normalization, which dispenses with distinctions and features which are unimportant in a large class of cases, and thus define a straightforwardly implementable and portable signature framework.

preprint2014arXiv

Learning from 25 years of the extensible N-Dimensional Data Format

The extensible N-Dimensional Data Format (NDF) was designed and developed in the late 1980s to provide a data model suitable for use in a variety of astronomy data processing applications supported by the UK Starlink Project. Starlink applications were used extensively, primarily in the UK astronomical community, and form the basis of a number of advanced data reduction pipelines today. This paper provides an overview of the historical drivers for the development of NDF and the lessons learned from using a defined hierarchical data model for many years in data reduction software, data pipelines and in data acquisition systems.

preprint2014arXiv

The Unified Astronomy Thesaurus

The Unified Astronomy Thesaurus (UAT) is an open, interoperable and community-supported thesaurus which unifies the existing divergent and isolated Astronomy & Astrophysics vocabularies into a single high-quality, freely-available open thesaurus formalizing astronomical concepts and their inter-relationships. The UAT builds upon the existing IAU Thesaurus with major contributions from the astronomy portions of the thesauri developed by the Institute of Physics Publishing, the American Institute of Physics, and SPIE. We describe the effort behind the creation of the UAT and the process through which we plan to maintain the document updated through broad community participation.

preprint2013arXiv

Tagging and Linking Lecture Audio Recordings: Goals and Practice

Making and distributing audio recordings of lectures is cheap and technically straightforward, and these recordings represent an underexploited teaching resource. We explore the reasons why such recordings are not more used; we believe the barriers inhibiting such use should be easily overcome. Students can listen to a lecture they missed, or re-listen to a lecture at revision time, but their interaction is limited by the affordances of the replaying technology. Listening to lecture audio is generally solitary, linear, and disjoint from other available media. In this paper, we describe a tool we are developing at the University of Glasgow, which enriches students' interactions with lecture audio. We describe our experiments with this tool in session 2012--13. Fewer students used the tool than we expected would naturally do so, and we discuss some possible explanations for this.

preprint2012arXiv

Astronomy and Computing: a New Journal for the Astronomical Computing Community

We introduce \emph{Astronomy and Computing}, a new journal for the growing population of people working in the domain where astronomy overlaps with computer science and information technology. The journal aims to provide a new communication channel within that community, which is not well served by current journals, and to help secure recognition of its true importance within modern astronomy. In this inaugural editorial, we describe the rationale for creating the journal, outline its scope and ambitions, and seek input from the community in defining in detail how the journal should work towards its high-level goals.

preprint2012arXiv

DMP Planning for Big Science Projects

This report exists to provide high-level guidance for the strategic and engineering development of Data Management and Preservation plans for 'Big Science' data. Although the report's nominal audience is therefore rather narrow, we intend the document to be of use to other planners and data architects who wish to implement good practice in this area. For the purposes of this report, we presume that the reader is broadly persuaded (by external fiat if nothing else) of the need to preserve research data appropriately, and that they have both sophisticated technical support and the budget to support developments. The goal of the document is not to provide mechanically applicable recipes, but to allow the user to develop and lead a high-level plan which is appropriate to their organisation. Throughout, the report is informed where appropriate by the OAIS reference model.

preprint2012arXiv

Managing Research Data in Big Science

The project which led to this report was funded by JISC in 2010--2011 as part of its 'Managing Research Data' programme, to examine the way in which Big Science data is managed, and produce any recommendations which may be appropriate. Big science data is different: it comes in large volumes, and it is shared and exploited in ways which may differ from other disciplines. This project has explored these differences using as a case-study Gravitational Wave data generated by the LSC, and has produced recommendations intended to be useful variously to JISC, the funding council (STFC) and the LSC community. In Sect. 1 we define what we mean by 'big science', describe the overall data culture there, laying stress on how it necessarily or contingently differs from other disciplines. In Sect. 2 we discuss the benefits of a formal data-preservation strategy, and the cases for open data and for well-preserved data that follow from that. This leads to our recommendations that, in essence, funders should adopt rather light-touch prescriptions regarding data preservation planning: normal data management practice, in the areas under study, corresponds to notably good practice in most other areas, so that the only change we suggest is to make this planning more formal, which makes it more easily auditable, and more amenable to constructive criticism. In Sect. 3 we briefly discuss the LIGO data management plan, and pull together whatever information is available on the estimation of digital preservation costs. The report is informed, throughout, by the OAIS reference model for an open archive.

preprint2011arXiv

A Journal for the Astronomical Computing Community?

One of the Birds of a Feather (BoF) discussion sessions at ADASS XX considered whether a new journal is needed to serve the astronomical computing community. In this paper we discuss the nature and requirements of that community, outline the analysis that led us to propose this as a topic for a BoF, and review the discussion from the BoF session itself. We also present the results from a survey designed to assess the suitability of astronomical computing papers of different kinds for publication in a range of existing astronomical and scientific computing journals. The discussion in the BoF session was somewhat inconclusive, and it seems likely that this topic will be debated again at a future ADASS or in a similar forum.

preprint2011arXiv

AstroDAbis: Annotations and Cross-Matches for Remote Catalogues

Astronomers are good at sharing data, but poorer at sharing knowledge. Almost all astronomical data ends up in open archives, and access to these is being simplified by the development of the global Virtual Observatory (VO). This is a great advance, but the fundamental problem remains that these archives contain only basic observational data, whereas all the astrophysical interpretation of that data -- which source is a quasar, which a low-mass star, and which an image artefact -- is contained in journal papers, with very little linkage back from the literature to the original data archives. It is therefore currently impossible for an astronomer to pose a query like "give me all sources in this data archive that have been identified as quasars" and this limits the effective exploitation of these archives, as the user of an archive has no direct means of taking advantage of the knowledge derived by its previous users. The AstroDAbis service aims to address this, in a prototype service enabling astronomers to record annotations and cross-identifications in the AstroDAbis service, annotating objects in other catalogues. We have deployed two interfaces to the annotations, namely one astronomy-specific one using the TAP protocol}, and a second exploiting generic Linked Open Data (LOD) and RDF techniques.

preprint2011arXiv

Digital Preservation and Astronomy: Lessons for funders and the funded

Astronomy looks after its data better than most disciplines, and it is no coincidence that the consensus standard for the archival preservation of all types of digital assets -- the OAIS Reference Model -- emerged originally from the space science community. It is useful to highlight both what is different about astronomy (and indeed about Big Science in general), what could be improved, and what is exemplary, and in the process I will give a brief introduction to the framework of the OAIS model, and its useful conceptual vocabulary. I will illustrate this with a discussion of the spectrum of big-science data management practices from astronomy, through gravitational wave (GW) data, to particle physics.

preprint2011arXiv

Why don't we already have an Integrated Framework for the Publication and Preservation of all Data Products?

Astronomy has long had a working network of archives supporting the curation of publications and data. The discipline has already created many of the features which perplex other areas of science: (1) data repositories: (supra)national institutes, dedicated to large projects; a culture of user-contributed data; practical experience of long-term data preservation; (2) dataset identifiers: the community has already piloted experiments, knows what can undermine these efforts, and is participating in the development of next-generation standards; (3) citation of datasets in papers: the community has an innovative and expanding infrastructure for the curation of data and bibliographic resources, and through them a community of author s and editors familiar with such electronic publication efforts; as well, it has experimented with next-generation web standards (e.g. the Semantic Web); (4) publisher buy-in: publishers in this area have been willing to innovate within the constraints of their commercial imperatives. What can possibly be missing? Why don't we have an integrated framework for the publication and preservation of all data products already? Are there technical barriers? We don't believe so. Are there cultural or commercial forces inhibiting this? We aren't aware of any. This Birds of a Feather session (BoF) attempted to identify existing barriers to the creation of such a framework, and attempted to identify the parties or groups which can contribute to the creation of a VO-powered data-publishing framework.

preprint1995arXiv

Particle acceleration and entropy considerations

Possible entropy constraints on particle acceleration spectra are discussed. Solar flare models invoke a variety of initial distributions of the primary energy release over the particles of the flare plasma -- ie., the partition of the energy between thermal and nonthermal components. It is suggested that, while this partition can take any value as far as energy is concerned, the entropy of a particle distribution may provide a useful measure of the likelihood of its being produced for a prescribed total energy. The Gibbs' entropy is calculated for several nonthermal isotropic distribution functions $f$, for a single particle species, and compared with that of a Maxwellian, all distributions having the same total number and energy of particles. Speculations are made on the relevance of some of the results to the cosmic ray power-law spectrum, on their relation to the observed frequency distribution of nonthermal flare hard X-ray spectrum parameters and on the additional energy release required to achieve lower entropy $f$s.

preprint1995arXiv

Prominence and flare fine structure from cross-field thermal conduction

Thermal conduction across a magnetic field is strongly suppressed compared with conduction along the field. However, if a flare is heated by a highly filamented beam directed along the field, then the array of heated cells in a cross-section of the flare will result in both small spatial scales (with consequently large temperature gradients) and a large surface area for the heated volume, providing a geometrical enhancement of the total cross-field energy flux. To investigate the importance of this filamentary geometry, we present a simple model of a single heated filament surrounded by an optically thin radiating shell, obtain an analytical expression for the stable equilibrium temperature profile within the shell, and use this to impose limits on the size of filament for which this model is appropriate. We find that this mechanism by itself is capable of transporting a power of the same order as a large flare, with a moderate range of filament sizes. The length scales are substantially smaller than can be resolved at present, although they should be regarded as underestimates.