ESO's ArchiveComputing framework

Andreas J. Wicenec; Jens Knudstrup

doi:10.1117/12.461148

27 November 2002 ESO's ArchiveComputing framework

Andreas J. Wicenec, Jens Knudstrup

Proceedings Volume 4845, Advanced Global Communications Technologies for Astronomy II; (2002) https://doi.org/10.1117/12.461148
Event: Astronomical Telescopes and Instrumentation, 2002, Waikoloa, Hawai'i, United States

Abstract

ESO's Science Archive is distributed across four different sites on two continents. With the huge amount of data produced by the various instruments this poses special requirements on the way data is transfered between the sites and distributed to the various subscribers. ESO's latest development, the Next Generation Archive System (NGAS), is based on cheap ATA disks connected to custom PCs running http based servers controlling the archiving process, supporting retrieval and checking the health status of the disks and the data itself. The current deployment of this system covers just a single 8kx8k pixel wide field imager, which is producing about 30 GB of raw data per night. The next generation of wide field telescopes/instruments VISTA/VISTACam and VST/OmegaCam will produce data rates well exceeding 500 GB and 125 GB during a single typical night, respectively. The total data rate of all ESO telescopes/instruments will grow to about 0.75 TB/night once VISTA is operational. The archiving of this data is essential, the next important step is to support not just only retrieval, but also flexible processing schemes of the data within the archive cluster directly.

Citation Download Citation

Andreas J. Wicenec and Jens Knudstrup "ESO's ArchiveComputing framework", Proc. SPIE 4845, Advanced Global Communications Technologies for Astronomy II, (27 November 2002); https://doi.org/10.1117/12.461148

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available