Survey on the Estimation of Mutual Information Methods as a Measure of Dependency Versus Correlation Analysis
| dc.contributor.author | Gencaga, Deniz | en_US |
| dc.contributor.author | Malakar, Nabin K. | en_US |
| dc.contributor.author | Lary, David J. | en_US |
| dc.contributor.utdAuthor | Gencaga, Deniz | en_US |
| dc.contributor.utdAuthor | Malakar, Nabin K. | en_US |
| dc.contributor.utdAuthor | Lary, David J. | en_US |
| dc.date.accessioned | 2016-07-20T22:31:44Z | |
| dc.date.available | 2016-07-20T22:31:44Z | |
| dc.date.created | 2015-02 | en_US |
| dc.date.issued | 2015-02 | en_US |
| dc.description.abstract | In this survey, we present and compare different approaches to estimate Mutual Information (MI) from data to analyse general dependencies between variables of interest in a system. We demonstrate the performance difference of MI versus correlation analysis, which is only optimal in case of linear dependencies. First, we use a piece-wise constant Bayesian methodology using a general Dirichlet prior. In this estimation method, we use a two-stage approach where we approximate the probability distribution first and then calculate the marginal and joint entropies. Here, we demonstrate the performance of this Bayesian approach versus the others for computing the dependency between different variables. We also compare these with linear correlation analysis. Finally, we apply MI and correlation analysis to the identification of the bias in the determination of the aerosol optical depth (AOD) by the satellite based Moderate Resolution Imaging Spectroradiometer (MODIS) and the ground based AErosol RObotic NETwork (AERONET). Here, we observe that the AOD measurements by these two instruments might be different for the same location. The reason of this bias is explored by quantifying the dependencies between the bias and 15 other variables including cloud cover, surface reflectivity and others. | en_US |
| dc.identifier.bibliographicCitation | Gencaga, D., N. K. Malakar, and D. J. Lary. 2014. "Survey on the estimation of mutual information methods as a measure of dependency versus correlation analysis." AIP Conference Proceedings 1636, doi:10.1063/1.4903714. | en_US |
| dc.identifier.issn | 0094-243X | en_US |
| dc.identifier.uri | http://hdl.handle.net/10735.1/4951 | |
| dc.identifier.volume | 1636 | en_US |
| dc.relation.uri | http://dx.doi.org/10.1063/1.4903714 | |
| dc.rights | ©2014 American Institute of Physics. This article may be downloaded for personal use only. Any other use requires prior permission of the author and the American Institute of Physics. | en_US |
| dc.source | AIP Conference Proceedings | |
| dc.subject | Information theory | en_US |
| dc.subject | Entropy | en_US |
| dc.subject | Correlation (Statistics) | en_US |
| dc.subject | Bayesian statistical decision theory | en_US |
| dc.subject | Uncertainty (Information theory) | en_US |
| dc.title | Survey on the Estimation of Mutual Information Methods as a Measure of Dependency Versus Correlation Analysis | en_US |
| dc.type.genre | Article | en_US |