The continuing evolution of the Data Central web service

James Tocknell

The continuing evolution of the Data Central web service

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution

Abstract

Since 2017, Data Central (Mannering & O’Toole 2019) has evolved from a single monolithic application to a science platform. A significant part of this evolution has been due to large structural changes in the core web service known internally as dcapi, written in Django, with DjangoRestFramework and React being key supporting components. These changes include the introduction of private data releases (implying a significant change in access control and how it is tracked internally, including the merging of databases), the move from Hadoop to PostgreSQL, and the splitting out of non-survey-based components (including the telescope archive, user registration and management, and user support). In this poster, we cover the technical reasons behind these changes, and reflect on how choices at the start of the project still inform the choices we make now about future directions of this service.

Original language	English
Title of host publication	Astronomical Data Analysis Software and Systems XXXIII
Editors	Alice Jacques, Robert Seaman, Natalie Gandilo, Tyler Linder
Place of Publication	Online
Publisher	Astronomical Society of the Pacific
Pages	458-460
Number of pages	3
ISBN (Electronic)	9781583819708
ISBN (Print)	9781583819692
Publication status	Published - 2025
Event	Astronomical Data Analysis Software and Systems XXXIII (33rd : 2023) - Tucson, United States Duration: 5 Nov 2023 → 9 Nov 2023 Conference number: 33rd

Publication series

Name	ASP Conference Series
Publisher	Astronomical Society of the Pacific
Volume	541

Conference

Conference	Astronomical Data Analysis Software and Systems XXXIII (33rd : 2023)
Abbreviated title	ADASS XXXIII
Country/Territory	United States
City	Tucson
Period	5/11/23 → 9/11/23

Access to Document

https://www.aspbooks.org/a/volumes/article_details/?paper_id=41227Licence: Unspecified

Cite this

@inproceedings{0995be5ac0a74bc19df3cbd41eb09a30,

title = "The continuing evolution of the Data Central web service",

abstract = "Since 2017, Data Central (Mannering \& O{\textquoteright}Toole 2019) has evolved from a single monolithic application to a science platform. A significant part of this evolution has been due to large structural changes in the core web service known internally as dcapi, written in Django, with DjangoRestFramework and React being key supporting components. These changes include the introduction of private data releases (implying a significant change in access control and how it is tracked internally, including the merging of databases), the move from Hadoop to PostgreSQL, and the splitting out of non-survey-based components (including the telescope archive, user registration and management, and user support). In this poster, we cover the technical reasons behind these changes, and reflect on how choices at the start of the project still inform the choices we make now about future directions of this service. ",

author = "James Tocknell",

year = "2025",

language = "English",

isbn = "9781583819692",

series = "ASP Conference Series",

publisher = "Astronomical Society of the Pacific",

pages = "458--460",

editor = "Alice Jacques and Robert Seaman and Natalie Gandilo and Tyler Linder",

booktitle = "Astronomical Data Analysis Software and Systems XXXIII",

note = "Astronomical Data Analysis Software and Systems XXXIII (33rd : 2023), ADASS XXXIII ; Conference date: 05-11-2023 Through 09-11-2023",

}

Tocknell, J 2025, The continuing evolution of the Data Central web service. in A Jacques, R Seaman, N Gandilo & T Linder (eds), Astronomical Data Analysis Software and Systems XXXIII. ASP Conference Series, vol. 541, Astronomical Society of the Pacific, Online, pp. 458-460, Astronomical Data Analysis Software and Systems XXXIII (33rd : 2023), Tucson, Arizona, United States, 5/11/23. <https://www.aspbooks.org/a/volumes/article_details/?paper_id=41227>

The continuing evolution of the Data Central web service. / Tocknell, James.
Astronomical Data Analysis Software and Systems XXXIII. ed. / Alice Jacques; Robert Seaman; Natalie Gandilo; Tyler Linder. Online: Astronomical Society of the Pacific, 2025. p. 458-460 (ASP Conference Series; Vol. 541).

Research output: Chapter in Book/Report/Conference proceeding › Conference proceeding contribution

TY - GEN

T1 - The continuing evolution of the Data Central web service

AU - Tocknell, James

N1 - Conference code: 33rd

PY - 2025

Y1 - 2025

N2 - Since 2017, Data Central (Mannering & O’Toole 2019) has evolved from a single monolithic application to a science platform. A significant part of this evolution has been due to large structural changes in the core web service known internally as dcapi, written in Django, with DjangoRestFramework and React being key supporting components. These changes include the introduction of private data releases (implying a significant change in access control and how it is tracked internally, including the merging of databases), the move from Hadoop to PostgreSQL, and the splitting out of non-survey-based components (including the telescope archive, user registration and management, and user support). In this poster, we cover the technical reasons behind these changes, and reflect on how choices at the start of the project still inform the choices we make now about future directions of this service.

AB - Since 2017, Data Central (Mannering & O’Toole 2019) has evolved from a single monolithic application to a science platform. A significant part of this evolution has been due to large structural changes in the core web service known internally as dcapi, written in Django, with DjangoRestFramework and React being key supporting components. These changes include the introduction of private data releases (implying a significant change in access control and how it is tracked internally, including the merging of databases), the move from Hadoop to PostgreSQL, and the splitting out of non-survey-based components (including the telescope archive, user registration and management, and user support). In this poster, we cover the technical reasons behind these changes, and reflect on how choices at the start of the project still inform the choices we make now about future directions of this service.

UR - https://www.aspbooks.org/a/volumes/table_of_contents/541

M3 - Conference proceeding contribution

SN - 9781583819692

T3 - ASP Conference Series

SP - 458

EP - 460

BT - Astronomical Data Analysis Software and Systems XXXIII

A2 - Jacques, Alice

A2 - Seaman, Robert

A2 - Gandilo, Natalie

A2 - Linder, Tyler

PB - Astronomical Society of the Pacific

CY - Online

T2 - Astronomical Data Analysis Software and Systems XXXIII (33rd : 2023)

Y2 - 5 November 2023 through 9 November 2023

ER -

The continuing evolution of the Data Central web service

Abstract

Publication series

Conference

Access to Document

Other files and links

Fingerprint

Cite this