Initial 2MASS "Hot-Pixel" Analysis

Initial 2MASS "Hot-Pixel" Analysis

Scan characteristics:

ORDate = 970418; Hemisp = n; DayNum = 49. Scans S001-S005 are low density (high Galactic latitude) regions. Scan 6 is through M51, 7-8 through M3, and scan 9 is though M63, so these are excluded in this initial analysis.

Processing:

First Gene Kopan's "freak" program was executed on the single frame extraction files /o1/970418n/sSSS/flat/[j,h,k]SSS.fex, which produced 256^2 images (*.fex.fits) containing an extraction count for each pixel. Calls like the following:
         freak k001.fex 14.0
resulted in extraction counts for point sources brighter than 14th mag. Most pixels are 0 or 1 in low density scans. Therefore the images were thresdholded above 1.

Next the *.fex.fits images were transformed into (X,Y) plots with numerical symbols representing the extraction count. This allows much more convenient visualization of the extraction count at each pixel than is possible by looking at the direct "freak" images. Movies of scans 001-005 fex results for bands J, H and K were also produced to conviently search for scan-to-scan persistence. See Figure 1.

The hot or "warm" pixel events are minimal at J and H, and the results are summarized below. The situation at K is more complex, so additional software was written to automate the comparison of the extraction counts on scans k001-k005 and to perform statistical comparisons and summaries.

Analysis Summary

1) Pixels with 2 extractions (blue "2" in Figure 1) can probably be ignored in all bands. The movies for scans 001-005 at J, H, and K show they are random events that do not persist across scans; these are point sources that happen to fall in the same array pixel for different frames [different sky positions]). Note that the vertical banding of pixels with 2-extraction is due to the fact that a point source will repeat in ~6 frames at the same X (cross-scan) position due to sub-pixel dithering.

2) J-array: There appear to be no significant hot pixels in the J array. The two 3-fex events (yellow "3" in Figure 1) at pixels (57,139) and (57,181) only appear in S003 (j003.fex.fits).

3) H-array: There is only one definite hot pixel persistent in all 5 scans: (8,117). The number of H<14 mag extractions at pixel (8,117) is 15,9,7,4,28 in scans S001-S005 respectively. A hot pixel mask (used to construct a simple image mask) for the H array in the format prescribed by John Fowler (2-May-97) would thus be simply (H, X, Y):

2   8 117

Following is a tally of the number of "warm" pixels (3-5 counts in randomly distributed pixels) in each H-band scan:

Table 1--- Potential "Warm" pixels in the H Array
ScanNumber of "warm" pixelsPixel(s)
H0011(254,7)
H0020---
H0035(31,63);(58,18);(59,101);(60,184);(231,75)
H0044(38,245);(126,34);(127,117);(254,78)
H0054(41,38);(42,121);(43,204);(79,32)

Figure 1 and Table 1 show that none of these "warm" pixel candidates are persistent in different scans. They occur in 14 different pixels in the 5 scans examined. Further analysis is desirable to learn if their frequency is consistent with random sources that happen to fall in the same array pixel for different frames [different sky positions], or whether they may be due to a weak "persistence" effect after the pixels are illuminated by a very bright source (or cosmic ray?). As discussed below, such analysis will likely be necessary for K array anyway, since the majority of hot pixels (FEX > 5) are not seen in all K scans.

4) K-array: There are 7 pixels with >=4 frame extractions which are present in all 5 scans examined here. The number of source extractions (frames effected) for each of the 5 scans for these pixels are tabulated here:

Table 2--- Hot Pixels (FEX >= 4) Present in all 5 Scans at K
PixelNumber of Frames in which the Pixel is "Hot"
K001K002K003K004K005
(66,225)995116
(87,242)5771636762
(91,229)6639552148
(141,254)531543816
(177,209)6067695436
(186,194)2854113038
(231,206)5126621

The K array mask (in the format requested by John Fowler) for these 7 pixels which occur in all 5 scans is referred to here as the "AND mask". Although this is certainly not a complete list of problem pixels, these are the only pixels which are consistently hot across scans.

Examination of the data in Figure 1 shows many intermitent hot pixel candidates (FEX >= 4) in addition to those discussed above which are present in all 5 scans. They range from pixels which appear hot in the majority (3-5) of the scans, to a few pixels which are very "hot" (>10 frame extractions) in only 1 or 2 of the 5 scans, but lack even a moderate number of extactions in the remaining majority of scans. Examples:

There is a total of 55 pixels in the K array in which more than 3 frame extractions (FEX >= 4) occur in at least one scan (K001 or K002 or K003 or K004 or K005). This complete list of mostly intermittent hot pixels is referred to here as the "OR mask". Of course, the "AND mask" discussed above in which FEX >= 4 in all 5 scans (K001 and K002 and K003 and K004 and K005) is a small pixel subset (13%) of the "OR mask". Figure 2 is a plot of the K array mask, with the 7 AND pixels plotted in red and the remaining 48 OR pixels plotted in yellow.

Figure 2--- K Array "OR mask"

A statistical comparison was made between the distributions of the FEX data for scans K001-K005, after thresholding the data at FEX >2. Basic summary statistics are tabulated below. Comparisons of the distributions in a pair-wise fashion shows no evidence for significantly different means (Student's t test) or variances (F test) in the extraction counts for scans K001-005. Likewise, the non-parametric K-S statistic, which measures the significance of the maximum value of the absolute difference between two observed cumulative distribution functions (CDFs), independent of their intrinsic underlying distribution functions, shows no differences between the CDFs at a significance level of 0.05 or better (smaller).

Table 3--- Statistical Comparison of FEX Distributions for >2 Extractions with K<14 mag
ScanNo. Pixels with FEX>2Min. Extactions (Frames)Max. Extractions (Frames)Mean SigmaMedian
K0013336617.519.010
K0023637115.919.48
K0033138616.923.27
K00432310618.824.67
K0052939017.322.05

For these 5 K-band scans, we conclude that the number of candidate hot pixels is about 30, and a "typical" median hot pixel is on for 8 frames (17 in the mean, skewed by a few pixels with many frame extractions). A zeroth-order pixel mask of hot pixels which occur on all 5 scans examined here accounts for only 7 out of ~30 pixels that are likely to appear hot (FEX > 5), or at least "warm" (FEX > 3), during any particular K scan. The intermittent nature of most hot pixel events (the fact that they occur on different pixels in different scans) indicates that more detailed study is warrented. The next step might be a trend analysis to determine if intermittent (or "transient") hot pixels occur on frames which follow illumination by an extremely bright source or cosmic ray on a previous frame. Also, the possibility of computing dynamic "hot pixel masks" using on-the-fly analysis of the FEX data such as that performed here might be considered. However, any such process would be complicated (foiled?) by varying source density in different regions of the sky.


Last update: 06-May-97, Joe Mazzarella (mazz@ipac.caltech.edu )