Authors:
(1) Hyosun park, Department of Astronomy, Yonsei University, Seoul, Republic of Korea;
(2) Yongsik Jo, Artificial Intelligence Graduate School, UNIST, Ulsan, Republic of Korea;
(3) Seokun Kang, Artificial Intelligence Graduate School, UNIST, Ulsan, Republic of Korea;
(4) Taehwan Kim, Artificial Intelligence Graduate School, UNIST, Ulsan, Republic of Korea;
(5) M. James Jee, Department of Astronomy, Yonsei University, Seoul, Republic of Korea and Department of Physics and Astronomy, University of California, Davis, CA, USA.
Table of Links
2 Method
2.1. Overview and 2.2. Encoder-Decoder Architecture
2.3. Transformers for Image Restoration
4 JWST Test Dataset Results and 4.1. PSNR and SSIM
4.3. Restoration of Morphological Parameters
4.4. Restoration of Photometric Parameters
5.2. Restoration of Multi-epoch HST Images and Comparison with Multi-epoch JWST Images
6 Limitations
6.1. Degradation in Restoration Quality Due to High Noise Level
6.2. Point Source Recovery Test
6.3. Artifacts Due to Pixel Correlation
7 Conclusions and Acknowledgements
Appendix: A. Image restoration test with Blank Noise-Only Images
3.3. JWST Dataset
We applied nearly the same procedures used for creating the HST dataset to sample the JWST image. The only difference is the criteria for the noise level. Since the JWST images prior to degrading serve as GT, the noise level must be considerably lower. We accepted an image only if its rms noise after the min-max normalization became less than 0.02.
One non-trivial issue is how to handle the difference in pixel scale between JWST and HST. NIRCAM’s native pixel scale is 0.03′′ (0.06′′) for the short (long) wavelength channel, which is different from the HST/ACS pixel scale 0.05′′. We considered resampling the JWST pixel scale to 0.05′′. However, the interpolation noise degraded the original quality non-negligibly. Therefore, we maintained the original scale. Therefore, our JWST galaxies are 40% larger or 20% smaller than the HST ones on average. However, as we demonstrate in §4, our HST image restoration is not significantly affected by this pixel scale inconsistency.
Another tricky issue is the JWST’s intrinsic PSF. Although JWST’s PSF is on average much smaller than that of HST, its long wavelength channel PSF width can be similar to that of the HST/ACS PSF. One may consider deconvolving JWST image with its own PSF as an attempt to further enhance its resolution and thus better represent the truth. Perhaps this is achievable with an approach similar to the current method explored here. However, this is beyond the scope of this study. In the current investigation, we use JWST images without deconvolution. Thus, the effective PSF of the LQ images that we describe below includes the convolutions by both JWST’s and HST’s PSFs.
We standardize the postage-stamp image size to 64 Ă— 64 pixels. A smaller image is expanded by padding pixels to its four edges in such a way that both the noise and background levels match the original image. A larger image is trimmed to 64 Ă—64 pixels. We discarded the galaxy images whose profiles were prematurely truncated by the trimming procedure. We collected 113,485 postage-stamp galaxy images from the JWST NIRCam F115W, F200W, F277W, and F444W images from various fields publicly available in August 2023 the Mikulski Archive for Space Telescopes (MAST)[4]. The dataset serves as the GT component in our finetuning dataset.
The LQ counterpart is generated by convolving the JWST GT galaxy images with the HST PSF and adding Gaussian noises. Although the pixel scale is different from the HST image, we scaled the HST PSF size, assuming the 0.05′′ pixel scale. This is because, eventually, we desire to restore the HST images whose pixel scale is 0.05′′. The applied noise distribution follows that of the HST dataset. The ratios among the training, validation, and test datasets are 8:1:1.
This paper is available on arxiv under CC BY 4.0 Deed license.
[4] https://archive.stsci.edu/
