2dFdr Pipeline As a Web Service (PAWS): on demand reduction of archival 2dF-AAOmega observations

Brent Miszalski*, Simon J. O'Toole, Kate Sheng, James Tocknell

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

Abstract

The Two-degree Field (2dF) facility of the Anglo-Australian Telescope (AAT) continues to take regular observations with millions of spectra collected over its lifetime. While individual projects have used the 2dFdr data reduction package to reduce and publish their own spectra, the majority of 2dF spectra are relatively inaccessible inside raw files located in the AAT archive. Here we introduce our 2dFdr Pipeline As a Web Service (PAWS) system that allows users to reduce 2dF-AAOmega observations on demand from the upgraded AAT archive. Without downloading data or installing 2dFdr, users can select science observations and reduction parameters before jobs are submitted for reduction. The system uses docker-py and Celery to robustly execute the reduction workflows, while a custom job tracking system keeps users informed of job progress. Data products may be downloaded and individual spectra can be viewed interactively. We intend to support additional instruments in the future.

Original languageEnglish
Title of host publicationSoftware and Cyberinfrastructure for Astronomy VII
EditorsJorge Ibsen, Gianluca Chiozzi
Place of PublicationWashington, DC
PublisherSPIE
Pages1-4
Number of pages4
ISBN (Electronic)9781510653603
ISBN (Print)9781510653597
DOIs
Publication statusPublished - 2022
EventSoftware and Cyberinfrastructure for Astronomy VII 2022 - Montreal, Canada
Duration: 17 Jul 202221 Jul 2022

Publication series

NameProceedings of SPIE
PublisherSPIE
Volume12189
ISSN (Print)0277-786X
ISSN (Electronic)1996-756X

Conference

ConferenceSoftware and Cyberinfrastructure for Astronomy VII 2022
Country/TerritoryCanada
CityMontreal
Period17/07/2221/07/22

Keywords

  • Data reduction pipelines
  • pipeline as a web service
  • telescope archives
  • 2dFdr
  • automation

Fingerprint

Dive into the research topics of '2dFdr Pipeline As a Web Service (PAWS): on demand reduction of archival 2dF-AAOmega observations'. Together they form a unique fingerprint.

Cite this