Convolutional Autoencoder-Based Multispectral Image Fusion



Journal Title

Journal ISSN

Volume Title


Institute of Electrical and Electronics Engineers Inc.


This paper presents a deep learning-based pansharpening method for fusion of panchromatic and multispectral images in remote sensing applications. This method can be categorized as a component substitution method in which a convolutional autoencoder network is trained to generate original panchromatic images from their spatially degraded versions. Low resolution multispectral images are then fed into the trained convolutional autoencoder network to generate estimated high resolution multispectral images. The fusion is achieved by injecting the detail map of each spectral band into the corresponding estimated high resolution multispectral bands. Full reference and no-reference metrics are computed for the images of three satellite datasets. These measures are compared with the existing fusion methods whose codes are publicly available. The results obtained indicate the effectiveness of the developed deep learning-based method for multispectral image fusion. © 2019 IEEE.



Convolutions (Mathematics), Deep learning, Remote sensing, Multispectral imaging, Remote sensing


IEEE Open Access. Commercial reuse is prohibited., ©2019 IEEE,