scispace - formally typeset
Journal ArticleDOI

Assessment of image fusion procedures using entropy, image quality, and multispectral classification

TLDR
Images fusion procedures for the fusion of multi-spectral ASTER data and a RadarSAT-1 SAR scene are explored to determine which fusion procedure merged the largest amount of SAR texture into the ASTER scenes, while also preserving the spectral content.
Abstract
The use of disparate data sources within a pixel level image fusion procedure has been well documented for pan-sharpening studies. The present paper explores various image fusion procedures for the fusion of multi-spectral ASTER data and a RadarSAT-1 SAR scene. The research sought to determine which fusion procedure merged the largest amount of SAR texture into the ASTER scenes, while also preserving the spectral content. An additional application based maximum likelihood classification assessment was also undertaken. Three SAR scenes were tested namely, one backscatter scene and two textural measures calculated using grey level co-occurrence matrices (GLCM). Each of these were fused to the ASTER data using the following established approaches; Brovey transformation, Intensity Hue and Saturation, Principal Component Substitution, Discrete wavelet transformation, and a modified discrete wavelet transformation using the IHS approach. Resulting data sets were assessed using qualitative and quantitative (entropy, universal image quality index, maximum likelihood classification) approaches. Results from the study indicated that while all post fusion data sets contained more information (entropy analysis), only the frequency-based fusion approaches managed to preserve the spectral quality of the original imagery. Furthermore results also indicated that the textural (mean, contrast) SAR scenes did not add any significant amount of information to the post-fusion imagery. Classification accuracy was not improved when comparing ASTER optical data and pseudo optical bands generated from the fusion analysis. Accuracies range from 68.4% for the ASTER data to well below 50% for the component substitution methods. Frequency based approaches also returned lower accuracies when compared to the unfused optical data. The present study essentially replicated (pan-sharpening) studies using the high resolution SAR scene as a pseudo panchromatic band.

read more

Citations
More filters
Journal ArticleDOI

FusionGAN: A generative adversarial network for infrared and visible image fusion

TL;DR: This paper proposes a novel method to fuse two types of information using a generative adversarial network, termed as FusionGAN, which establishes an adversarial game between a generator and a discriminator, where the generator aims to generate a fused image with major infrared intensities together with additional visible gradients.
Journal ArticleDOI

Infrared and visible image fusion methods and applications: A survey

TL;DR: This survey comprehensively survey the existing methods and applications for the fusion of infrared and visible images, which can serve as a reference for researchers inrared and visible image fusion and related fields.
Journal ArticleDOI

DDcGAN: A Dual-Discriminator Conditional Generative Adversarial Network for Multi-Resolution Image Fusion

TL;DR: A new end-to-end model, termed as dual-discriminator conditional generative adversarial network (DDcGAN), for fusing infrared and visible images of different resolutions, which establishes an adversarial game between a generator and two discriminators.
Journal ArticleDOI

Water footprint benchmarks for crop production: A first global assessment

TL;DR: In this paper, a set of global water footprint (WF) benchmark values for a large number of crops grown in the world were established and a spatial distribution of the green-blue and grey WFs of different crops was calculated at a spatial resolution of 5 by 5′ with a dynamic water balance and crop yield model.
Journal ArticleDOI

Infrared and visible image fusion via detail preserving adversarial learning

TL;DR: This paper proposes an end-to-end model for infrared and visible image fusion based on detail preserving adversarial learning that is able to overcome the limitations of the manual and complicated design of activity-level measurement and fusion rules in traditional fusion methods.
References
More filters
Journal ArticleDOI

A mathematical theory of communication

TL;DR: This final installment of the paper considers the case where the signals or the messages or both are continuously variable, in contrast with the discrete nature assumed until now.
Journal ArticleDOI

A theory for multiresolution signal decomposition: the wavelet representation

TL;DR: In this paper, it is shown that the difference of information between the approximation of a signal at the resolutions 2/sup j+1/ and 2 /sup j/ (where j is an integer) can be extracted by decomposing this signal on a wavelet orthonormal basis of L/sup 2/(R/sup n/), the vector space of measurable, square-integrable n-dimensional functions.
Book

The Mathematical Theory of Communication

TL;DR: The Mathematical Theory of Communication (MTOC) as discussed by the authors was originally published as a paper on communication theory more than fifty years ago and has since gone through four hardcover and sixteen paperback printings.
Book

Remote sensing and image interpretation

TL;DR: In this article, the authors present a textbook for introductory courses in remote sensing, which includes concepts and foundations of remote sensing; elements of photographic systems; introduction to airphoto interpretation; air photo interpretation for terrain evaluation; photogrammetry; radiometric characteristics of aerial photographs; aerial thermography; multispectral scanning and spectral pattern recognition; microwave sensing; and remote sensing from space.
Journal ArticleDOI

Remote Sensing and Image Interpretation

TL;DR: In this article, the concept of remote sensing elements of photogrammetry was introduced. Butterfly, thermal, and hyperspectral sensors were used to interpret multispectral, thermal and hypererspectral images.
Related Papers (5)