Next: New Tools for the Analysis of ISOPHOT P32 Mapping Data in PIA
Up: Software Applications
Previous: A System for Web-based Access to the HSOS Database
Table of Contents -
Subject Index -
Author Index -
Search -
PS reprint -
PDF reprint
Offenberg, J. D., Fixsen, D. J., Nieto-Santisteban, M. A., Sengupta, R., Mather, J. C., & Stockman, H. S. 2001, in ASP Conf. Ser., Vol. 238, Astronomical Data Analysis Software and Systems X, eds. F. R. Harnden, Jr., F. A. Primini, & H. E. Payne (San Francisco: ASP), 396
Uniform Data Sampling: Noise Reduction & Cosmic Rays
J. D. Offenberg1,
D. J. Fixsen2,
M. A. Nieto-Santisteban3,
R. Sengupta4,
J. C. Mather5,
H. S. Stockman6
Abstract:
As computers and scientific instruments become more complicated and
more powerful (Moore's Law), we can perform astronomical observations
never before
contemplated. As larger data volumes are acquired, as more complex
instruments are designed, and as observatories are placed in distant
space locations with constrained downlink capacity, the need for
automated, robust image processing tools will increase.
We present a robust, optimized algorithm to perform automated
processing of array image data obtained with a non-destructive
read-out. We present the derivation of the noise effects of this
algorithm and compare alternative strategies.
The effects of radiation and cosmic rays can be a formidable source of
data loss for a space-based observatory. Several solutions to the
problem of identifying and removing cosmic rays exist. We evaluate
Up-the-Ramp sampling with on-the-fly cosmic ray identification and
mitigation, which is described in detail by Fixsen et al. (2000)
and compared to Fowler Sampling (Fowler & Gatley 1990). We
concentrate on Up-the-Ramp sampling for study because it provides
better signal-to-noise in what is probably the most
difficult-to-measure regime, the read-noise limit. In the absence of
cosmic rays, Up-the-Ramp sampling provides modestly (
) higher
signal-to-noise than does Fowler Sampling (Garnett & Forrest 1993).
The fact that an Up-the-Ramp sequence can be screened for cosmic rays
and other glitches improves this result. Furthermore, on-the-fly
cosmic ray rejection allows longer integration times which also
improves the signal-to-noise in the faint limit (Offenberg et al. 2001).
The following discussion is largely an excerpt from Offenberg et al. 2001.
Fowler sampling reduces the effect of read noise to
(for an
observation sequence consisting of
samples,
Fowler-pairs).
However, when a pixel is impacted by a cosmic ray during an
observation, the cosmic ray essentially injects infinite variance and
reduces the signal to noise to zero at that location. If we start
with the Fowler sampling signal-to-noise function in the read-noise limit, from
Garnett & Forrest (1993; Eqn. 6),
 |
(1) |
where
is the flux of the target,
is the observation time,
is the read noise,
is the Fowler duty cycle, and
is the time between sample intervals (determined by engineering or
scientific constraints on the system). We note that this
formula breaks down for relatively small numbers of samples
(i.e.,
large with respect to
).
is the signal, so
the remaining terms are the noise, which is the square-root of the
variance,
. If we consider two cases, ``no-cosmic-ray'' and
``hit-by-cosmic-ray,'' and combine the variances according to
 |
(2) |
we can rewrite Equation 1 as
 |
(3) |
As the weight is the inverse of the variance (
),
Equation 3 can be rewritten as
 |
(4) |
is the variance in the no-cosmic-ray case, taken from
Equation 1, and
is the probability of a pixel
surviving without a cosmic ray hit. For simplicity, we define
to be the probability of a pixel being hit by a cosmic ray per time
unit
, so
is the probability of ``survival'' and
. As a cosmic ray hit injects infinite
uncertainty, the variance in the cosmic ray case is
.
Plugging in to Equation 4, we get the signal-to-noise for
Fowler sampling in the read-noise limited case with cosmic rays,
Equation 5:
 |
(5) |
For a given integration time
and minimum read time
, the
maximum
occurs with duty cycle
. If we plug
this back into Equation 5, we get
 |
(6) |
From here, it is possible to find the value of
which gives the best signal-to-noise for a single observation; it
occurs at
. If, however, we consider the
observation as a series of
equal observations with a specific
total observation time,
, the signal-to-noise for the series
is
 |
(7) |
If we hold
constant and find the optimum
, we find it at
. In either case, it is important
to note that there is an optimal value for
, and extending the
observation beyond that time will ruin the data.
It is worth noting that the result assumes that all cosmic ray events
can be identified a posteriori. This is not necessarily the
case, particularly when it is considered that, in the one-image case,
the fraction of pixels surviving without a cosmic ray impact is
; for the multi-image case, the
fraction of survivors is
. In both
cases, the number of ``good'' pixels is so low that separating them
from the impacted pixels will not be a trivial task. For example, the
median operation would not be able to identify a good samples, as more
than half of the samples would be impacted by cosmic rays. In practice,
the detector will often saturate before this limit is reached, but
this shorter integration time means that less-than-optimal
signal-to-noise will be obtained.
Up-the-Ramp sampling reduces the effect of read noise to
, for N
uniformly-spaced samples with equal weighting (which is the optimal
weighting for the read-noise limited case). When a pixel is impacted
by a cosmic ray, the Up-the-Ramp algorithm preserves the ``good'' data
for that pixel. The exact quality of the preserved data depends on
the number of cosmic ray hits and their timing within the observation.
For example, a cosmic ray hit which just trims off the last sample in
the sequence has minimal impact compared to a cosmic ray hit that
occurs in the middle of the observation sequence. The variance of a
Uniformly-sampled sequence with
samples is proportional to
. If an Up-the-Ramp sequence is broken into
chunks by a cosmic ray, the variance becomes
 |
(8) |
When there are zero cosmic ray
events, of course,
. If there is one cosmic ray event during
the sequence, the variance becomes
 |
(9) |
If we assume (as is reasonable) that the cosmic ray
events are randomly distributed over time and find the expectation
value for all values of
, we find that the typical
(plus a small term in
, which we will
ignore for simplicity). If we perform a similar computation for two
cosmic ray events, we find that
(again, plus
lower-order terms which we ignore). In general, we find that it is
possible to find a valid result with a finite variance for any
sequence broken up by cosmic ray events provided we have at least two
consecutive ``good'' samples (for all practical purposes, we can
ignore the situation where this is not the case). To simplify the
following, we consider only three cases: The
no-cosmic-ray case
, the one-cosmic-ray case
and
all multiple-cosmic-ray cases combined as one,
, where
is a small but non-zero
number, roughly 0.3.
The Up-the-Ramp signal-to-noise function for the read-noise limited
case (Garnett & Forrest 1993; Eqn. 20) is
 |
(10) |
We combine the variances in the three
possible cases with the three-case equivalent to
Equation 2, and thus arrive at
 |
(11) |
where
is the probability of a pixel being impacted by
cosmic
rays during the integration. We note, as did Garnett & Forrest, that
there would be no reason to limit the number of samples to anything
less than the maximum possible number, so we can set
.
Using the definition of
described earlier,
,
and
. Putting these values back into
Equation 11, we get:
![\begin{displaymath}
SN_{UC} = \frac{F T}{\sqrt{2}\sigma_r}\sqrt{\frac{T^2-\delta...
...rac{T}{\delta t}(1-P)P^{T/\delta t - 1} +
\epsilon\right]^{1/2}\end{displaymath}](img54.gif) |
(12) |
If we seek the maximum value of
with respect to
, we find that
is strictly
increasing if
(otherwise we would have an integration
shorter than one sample time, which would be useless),
and
(both of which are true by construction). This result
applies whether we are considering one independent integration or a
series of observations to be combined later. As the derivative is
strictly positive, the signal-to-noise continues to increase with the
sample time, although as
, the gain in
signal-to-noise asymptotically approaches zero. So, extending the
observing time while using Up-the-Ramp sampling with cosmic ray
rejection does not damage the data (although we might be spending time
with little or no gain). As noted earlier for the Fowler-sampling
case, there is an optimal observing time, beyond which further
observation reduces the overall signal-to-noise.
References
Fixsen, D. J., et al. 2000, PASP, 112, 1350
Fowler, A. M. & Gatley, I. 1990, ApJ, 353, L33
Garnett, J. D. & Forrest, W. J. 1993, Proc. SPIE, 1946, 395
Offenberg, J. D., et al. 2001, PASP, 113, in press
Footnotes
- ... Offenberg1
- Raytheon ITSS, 4500 Forbes Blvd, Lanham MD 20706
- ... Fixsen2
- Raytheon ITSS, 4500 Forbes Blvd, Lanham MD 20706
- ... Nieto-Santisteban3
- Space Telescope Science Institute, 3700 San Martin Dr., Baltimore MD 21818
- ... R. Sengupta4
- Raytheon ITSS, 4500 Forbes Blvd, Lanham MD 20706
- ... Mather5
- Code 685, NASA's Goddard Space Flight Center, Greenbelt MD 20771
- ... Stockman6
- Space Telescope Science Institute, 3700 San Martin Dr., Baltimore MD 21818
© Copyright 2001 Astronomical Society of the Pacific, 390 Ashton Avenue, San Francisco, California 94112, USA
Next: New Tools for the Analysis of ISOPHOT P32 Mapping Data in PIA
Up: Software Applications
Previous: A System for Web-based Access to the HSOS Database
Table of Contents -
Subject Index -
Author Index -
Search -
PS reprint -
PDF reprint
adass-editors@head-cfa.harvard.edu