Next: GIGAWULF: Powering the Isaac Newton Group's Data Pipeline
Up: Science Data Pipelines
Previous: The Networked Telescope: Progress Toward a Grid Architecture for Pipeline Processing
Table of Contents -
Subject Index -
Author Index -
Search -
PS reprint -
PDF reprint
Hook, R. N., Arnouts, S., Benoist, C., da Costa, L., Mignani, R., Rite, C., Schirmer, M., Slijkhuis, R., Vandame, B., & Wicenec, A. 2001, in ASP Conf. Ser., Vol. 238, Astronomical Data Analysis Software and Systems X, eds. F. R. Harnden, Jr., F. A. Primini, & H. E. Payne (San Francisco: ASP), 283
The ESO Imaging Survey Project: Status and Pipeline Software
Richard N. Hook1, Stephane Arnouts,
Christophe Benoist, Luiz da Costa,
Roberto Mignani, Charles Rité, Michael Schirmer, Remco Slijkhuis,
Benoît Vandame, Andreas Wicenec
European Southern Observatory, Karl-Schwarzschild Str.2, D-85748 Garching bei München, Germany
Abstract:
The ESO Imaging Survey (EIS) is a major public imaging survey project
being conducted by the European Southern Observatory using several
different telescopes and detectors at La Silla in Chile. The primary
aim is the identification of samples suitable for more detailed
study using the ESO Very Large Telescope (VLT). The first part of the
project consisted of two parts: EIS-Wide, an optical survey to moderate
depth (

) covering about 20 square degrees; and EIS-Deep,
which covered
smaller areas of sky to greater depth (

) and also included deep near-IR
imaging. These surveys are essentially complete and the data are available
to users world-wide through the
EIS web pages.
Following a successful pilot project with the new Wide Field Imager (WFI)
on the 2.2m telescope at La Silla, the EIS team is now engaged in a public
imaging survey using the WFI telescope in conjunction with IR imaging using
SOFI on the NTT. Three deep fields of one degree square, including the
Chandra Deep Field South (CDF-S), are being
imaged in the optical along with smaller sub-areas in IR bands. In
addition, 160 stellar fields have been
imaged as part of the preparations for the use of the FLAMES fibre-feed
system for spectrographs on the VLT.
To support the large data volume from this survey and to facilitate its
rapid scientific exploitation, a complete end-to-end pipeline system has
been developed. Here we give a brief outline of the project so far, and
describe the motivation and architecture for the pipeline software.
The ESO Imaging Survey (EIS) was established at the European Southern
Observatory in 1997 to perform appropriate public surveys to help identify
samples of interesting objects for the ESO Very Large Telescope, which was
then approaching completion. Existing surveys at that time did not go deep
enough to reach the spectroscopic limits of the new generation of large
telescopes. A working group was established to oversee the surveys, and a visitor
programme established to allow experts from the community to be funded to
work at ESO as part of the EIS team. EIS aimed to establish a framework for
future imaging surveys and to foster collaboration with the European astronomical
community.
The first phase of the survey was EIS-Wide, which was devoted to moderately
deep imaging (
) in BVI in four patches of
the southern sky. A total of 17 square degrees in I and smaller areas
in B and V were obtained using the EMMI instrument on the ESO NTT. This
was complemented by EIS-Deep, which imaged two smaller fields (the Hubble
Deep Field South and the Chandra Deep Field South) to greater depth
(
)
and also included near infrared imaging with SOFI. Data were made public in
1998 and described in accompanying papers (Nonino et al. 1999;
Olsen et al.
1999a; Prandoni et al. 1999; Zaggia et al. 1999; Olsen et al. 1999b;
Benoist et al. 1999; Scodeggio et al. 1999).
In 1999 the Wide Field Imager (WFI) on the 2.2m telescope at La Silla was
available. This efficient, wide-field mosaic camera system was used in a pilot
project to complete EIS-Wide and image many stellar fields. From November
1999 this was extended into a formal Deep Public Survey which is currently
in progress. It covers three fields, each
degrees in the
UBVRI optical bands and covering 450arcmin
at JKs in the near
infrared. This is supplemented
by 160 stellar fields in preparation for the FLAMES multi-fibre spectrograph
to be installed on the VLT. These and the earlier fields are shown on
Figure 1.
An example of a small piece of an EIS-Wide patch is given as
Figure 2, which shows how many overlapping small fields, from different
telescopes and cameras, can be mosaiced effectively and aligned from
separate astrometric solutions. Some initial science results on distant
galaxy clusters have been published (Olsen et al. 1999a, 1999b; Scodeggio
et al. 1999) along with preliminary lists of interesting
colour-selected point-sources (Prandoni et al. 1999; Zaggia et al. 1999).
A much larger area of sky is now available in BVI from the combined
pilot and EIS-Wide surveys and is yet to be fully explored.
Extensive follow-up observations, with the VLT and other telescopes, are
currently in progress.
Figure 1:
The Southern Sky showing the positions of
the EIS fields
along with the Milky Way. The main fields are individually labeled. Asterisks
are open cluster, diamonds globular cluster, crosses local group galaxies
triangles Milky Way bulge/halo fields and squares Sagittarius Dwarf and
LMC/SMC fields.
 |
Figure 2:
Example of a small piece of EIS-Wide Patch D. The blue and
green channels come from 2.2/WFI B and V data and the red from earlier
NTT/EMMI I band imaging.
 |
The initial data volume and rate were modest and a pragmatic approach of
re-using existing software was adopted (Hook et al. 1998). Tools pressed
into service included SExtractor (Bertin & Arnouts 1996)
for object catalogue preparation, IRAF
for standard frame reduction, Drizzle (in adapted form) for image coaddition,
and Eclipse (Devillard 1999) for reducing IR data. The LDAC tools, developed
for the DENIS survey (Epchtein et al. 1998) were used for the
demanding astrometric and
photometric calibration steps. These items were controlled from shell scripts.
Unfortunately the simultaneous observing, software development, reduction,
data-release, science analysis, and publication of results by a small team,
combined with the increase in data volume from the WFI and critical staff
changes led to an impossible situation and a major pipeline overhaul was
conducted in 1999.
The current pipeline design aims for robustness and ease of use but accepts
the constraint that it would be impossible to create a fully automatic system
using the resources available. Extensive use of a Sybase database allows
tracking of the processing and storage of some intermediate information.
The use of Objectivity was considered but inadequate resources
were available for such an initiative.
The ESO archive provides both a repository for the raw data and
a mechanism for distributing the data products to the community.
Python has been adopted as the pipeline glue language, with a GUI (written in
Tkinter) layered on top for ease of use and training for a rapidly changing
group. The GUI provides both high level pipeline control panels and access
to lower-level functions for expert use. It is an end-to-end system with
components to address aspects of the data-flow from proposal preparation
through to catalogue preparation and science backend tasks such as preparing
colour-colour plots and determining photometric redshifts.
Some components remain from the earlier work but entirely new pipeline
software has been created for the Deep and Pre-FLAMES reductions.
The pipeline components and infra-structure are mostly in place at the time
of writing but not all are in full operation.
The current EIS survey is only a small part of the planned European imaging
surveys for the near future. Over the next two years the VLT Survey Telescope,
a 2.5m dedicated survey telescope to be sited adjacent to the VLT, and
VISTA, a UK project for a 4m optical-IR survey telescope, also on the same
site, will conduct much larger surveys.
References
Benoist, C., et al. 1999, A&A, 346, 58
Bertin, E. & Arnouts, S. 1996, A&AS, 117, 393
Devillard, N. 1999, in ASP Conf. Ser., Vol. 172, Astronomical Data Analysis
Software and Systems VIII, ed. David M. Mehringer, Raymond L. Plante, &
Douglas A. Roberts (San Francisco: ASP), 333
Epchtein, N., et al. 1998, ESO Messenger, 87, 27
Hook, R. N., Bertin, E., da Costa, L., Deul, E., Freudling, W.,
Nonino, M., & Wicenec, A. 1998, in ASP Conf. Ser., Vol. 145, Astronomical Data Analysis
Software and Systems VII, ed. R. Albrecht, R. N. Hook, &
H. A. Bushouse
(San Francisco: ASP), 320
Nonino, M., et al. 1999, A&AS, 137, 51
Olsen, L. F., et al. 1999a, A&A, 345, 363
Olsen, L. F., et al. 1999b, A&A, 345, 681
Prandoni I., et al. 1999, A&A, 345, 448
Scodeggio, M., et al. 1999, A&AS, 137, 83
Zaggia, S., et al. 1999, A&AS, 137, 75
Footnotes
- ... Hook1
- Space Telescope - European Coordinating Facility
© Copyright 2001 Astronomical Society of the Pacific, 390 Ashton Avenue, San Francisco, California 94112, USA
Next: GIGAWULF: Powering the Isaac Newton Group's Data Pipeline
Up: Science Data Pipelines
Previous: The Networked Telescope: Progress Toward a Grid Architecture for Pipeline Processing
Table of Contents -
Subject Index -
Author Index -
Search -
PS reprint -
PDF reprint
adass-editors@head-cfa.harvard.edu