Title: MUTUAL INFORMATION FUNCTIONS VERSUS CORRELATION-FUNCTIONS
Author(s): LI WT
Source: JOURNAL OF STATISTICAL PHYSICS 60 (5-6): 823-837 SEP 1990

citation information (apr 2008, from ISI web of knowledge)


79.  Zhao Y, Billings SA
Neighborhood detection using mutual information for the identification of cellular automata
IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART B-CYBERNETICS   Volume: 36   Issue: 2   Pages: 473-479   Published: APR 2006

78.  Cancho RFI, Capocci A, Caldarelli G
Spectral methods cluster words of the same class in a syntactic dependency network
INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS   Volume: 17   Issue: 7   Pages: 2453-2463   Published: JUL 2007

77.  Li WT
Three lectures on case-control genetic association analysis
BRIEFINGS IN BIOINFORMATICS   Volume: 9   Issue: 1   Pages: 1-13   Published: JAN 2008

76. Swati D
In silico comparison of bacterial strains using mutual information 
JOURNAL OF BIOSCIENCES 32 (6): 1169-1184 SEP 2007

75. White RA, Szurmant H, Hoch JA, et al.
Features of protein-protein interactions in two-component signaling deduced from genomic libraries 
METHODS IN ENZYMOLOGY 422: 75+ 2007

74.  Chapeau-Blondeau F
Autocorrelation versus entropy-based autoinformation for measuring dependence in random signal 
PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS 380: 1-18 JUL 1 2007


73.  Bettencourt LMA, Stephens GJ, Ham MI, et al.
Functional structure of cortical neuronal networks grown in vitro 
PHYSICAL REVIEW E 75 (2): Art. No. 021915 Part 1 FEB 2007 

72.  Carreras I, Chlamtac I, De Pellegrini F, et al.
BIONETS: Bio-inspired networking for pervasive communication environments 
IEEE TRANSACTIONS ON VEHICULAR TECHNOLOGY 56 (1): 218-229 JAN 2007

71. Tourassi GD, Harrawood B, Singh S, et al.
Evaluation of information-theoretic similarity measures for content-based retrieval and detection of masses in mammograms 
MEDICAL PHYSICS 34 (1): 140-150 JAN 2007


70. Galka A, Ozaki T, Bayard JB, et al.
Whitening as a tool for estimating mutual information in spatiotemporal data sets 
JOURNAL OF STATISTICAL PHYSICS 124 (5): 1275-1315 SEP 2006

69. Halbiniak Z, Jozwiak IJ
Deterministic chaos in the processor load 
CHAOS SOLITONS & FRACTALS 31 (2): 409-416 JAN 2007

68
       Li WT, Wang MY, Irigoyen P, et al.
       Inferring causal relationships among intermediate phenotypes and biomarkers:
       a case study of rheumatoid arthritis 
       BIOINFORMATICS 22 (12): 1503-1507 JUN 15 2006 

67
       Cancho RFI, Lusseau D
       Long-term correlations in the surface behavior of dolphins 
       EUROPHYSICS LETTERS 74 (6): 1095-1101 JUN 2006 

66
       Molini A, La Barbera P, Lanza LG
       Correlation patterns and information flows in rainfall fields 
       JOURNAL OF HYDROLOGY 322 (1-4): 89-104 MAY 15 2006 
65
       Berryman MJ, Allison A, Wilkinson CR, et al.
       Review of signal processing in genetics 
       FLUCTUATION AND NOISE LETTERS 5 (4): R13-R35 DEC 2005 

64
       Kolasa J
       Complexity, system integration, and susceptibility to change: Biodiversity connection 
       ECOLOGICAL COMPLEXITY 2 (4): 431-442 DEC 2005 
63
       Wang R, Cai X
       Hierarchical structure, disassortativity and information measures of
       the US flight network 
       CHINESE PHYSICS LETTERS 22 (10): 2715-2718 OCT 2005 
62
      Ryu YU, Yue WT
      Firm bankruptcy prediction: Experimental comparison of isotonic separation and other
      classification approaches 
      IEEE TRANSACTIONS ON SYSTEMS MAN AND CYBERNETICS PART
      A-SYSTEMS AND HUMANS 35 (5): 727-737 SEP 2005 

61
       Johnson JR, Wing S
       A solar cycle dependence of nonlinearity in magnetospheric activity 
       JOURNAL OF GEOPHYSICAL RESEARCH-SPACE PHYSICS 110 (A4): Art. No.
       A04211 APR 22 2005 

60 
       Isohata Y, Hayashi M
       Analyses of DNA base sequences for eukaryotes in terms of power spectrum method 
       JAPANESE JOURNAL OF APPLIED PHYSICS PART 1-REGULAR PAPERS
       SHORT NOTES & REVIEW PAPERS 44 (2): 1143-1146 FEB 2005 
59 
       Huang D, Chow TWS
       Effective feature selection scheme using mutual information 
       NEUROCOMPUTING 63: 325-343 JAN 2005 
58. 
       Chow TWS, Huang D
       Estimating optimal feature subsets using efficient estimation of high-dimensional mutual
       information 
       IEEE TRANSACTIONS ON NEURAL NETWORKS 16 (1): 213-224 JAN 2005 

57.
       Phillips JD, Walls MD
       Flow partitioning and unstable divergence in fluviokarst evolution in central
       Kentucky 
       NONLINEAR PROCESSES IN GEOPHYSICS 11 (3): 371-381 2004 

56. 
       Dima RI, Thirumalai D
       Proteins associated with diseases show enhanced sequence correlation between
       charged residues 
       BIOINFORMATICS 20 (15): 2345-2354 OCT 12 2004 
    55. 
       Berryman MJ, Allison A, Abbott D
       Mutual information for examining correlations in DNA 
       FLUCTUATION AND NOISE LETTERS 4 (2): L237-L246 JUN 2004 

1. 
       Cazelles B
       Symbolic dynamics for identifying similarity between rhythms of ecological time
       series 
       ECOLOGY LETTERS 7 (9): 755-763 SEP 2004 
    2. 
       Choi B, Hendtlass T, Bluff K
       A comparison of neural network input vector selection techniques 
       LECTURE NOTES IN COMPUTER SCIENCE 3029: 1-10 2004 
    3. 
       Erb I, Ay N
       Multi-information in the thermodynamic limit 
       JOURNAL OF STATISTICAL PHYSICS 115 (3-4): 949-976 MAY 2004 
    4. 
       Audit B, Vaillant C, Arneodo A, et al.
       Wavelet analysis of DNA bending profiles reveals structural constraints on the
       evolution of genomic sequences 
       JOURNAL OF BIOLOGICAL PHYSICS 30 (1): 33-81 2004 
    5. 
       Dehnert M, Helm WE, Hutt MT
       A discrete autoregressive process as a model for short-range correlations in DNA
       sequences 
       PHYSICA A-STATISTICAL MECHANICS AND ITS APPLICATIONS 327
       (3-4): 535-553 SEP 15 2003 
    6. 
       Lee SK, Kim YH, Moon BR
       Finding the optimal gene order in displaying microarray data 
       LECTURE NOTES IN COMPUTER SCIENCE 2724: 2215-2226 2003 
    7. 
       Tourassi GD, Vargas-Voracek R, Catarious DM, et al.
       Computer-assisted detection of mammographic masses: A template matching
       scheme based on mutual information 
       MEDICAL PHYSICS 30 (8): 2123-2130 AUG 2003 
    8. 
       Crutchfield JP, Feldman DP
       Regularities unseen, randomness observed: Levels of entropy convergence 
       CHAOS 13 (1): 25-54 MAR 2003 
    9. 
       Daw CS, Finney CEA, Tracy ER
       A review of symbolic analysis of experimental data 
       REVIEW OF SCIENTIFIC INSTRUMENTS 74 (2): 915-930 FEB 2003 
    10. 
       Bernaola-Galvan P, Carpena P, Roman-Roldan R, et al.
       Study of statistical correlations in DNA sequences 
       GENE 300 (1-2): 105-115 OCT 30 2002 

11. 
       Oosawa C, Savageau MA
       Effects of alternative connectivity on behavior of randomly constructed Boolean
       networks 
       PHYSICA D 170 (2): 143-161 SEP 1 2002 
    12. 
       Kim SJ, Aizawa Y
       Generation of the correlation between rule and density in rule-dynamical systems 
       JOURNAL OF THE PHYSICAL SOCIETY OF JAPAN 71 (8): 1798-1801 AUG
       2002 
    13. 
       Wu F, Zheng WM
       Which are more random: Coding or noncoding DNA sequences? 
       COMMUNICATIONS IN THEORETICAL PHYSICS 37 (5): 637-640 MAY 15 2002
    14. 
       Grosse I, Bernaola-Galvan P, Carpena P, et al.
       Analysis of symbolic sequences using the Jensen-Shannon divergence 
       PHYSICAL REVIEW E 65 (4): Art. No. 041905 Part 1 APR 2002 
    15. 
       De Polavieja GG
       Errors drive the evolution of biological signalling to costly codes 
       JOURNAL OF THEORETICAL BIOLOGY 214 (4): 657-664 FEB 21 2002 
    16. 
       Tourassi GD, Frederick ED, Markey MK, et al.
       Application of the mutual information criterion for feature selection in
       computer-aided diagnosis 
       MEDICAL PHYSICS 28 (12): 2394-2402 DEC 2001 
    17. 
       Yang ZR, Zwolinski M
       Mutual information theory for adaptive mixture models 
       IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE
       INTELLIGENCE 23 (4): 396-403 APR 2001 
    18. 
       Migita M, Mizukami E, Gunji YP
       Temporal criterion for behavior: orientation of the young Japanese flounder
       Paralichthys olivaceus 
       BEHAVIOURAL PROCESSES 52 (2-3): 77-87 DEC 7 2000 
    19. 
       Yulmetyev R, Hanggi P, Gafarov F
       Stochastic dynamics of time correlation in complex systems with discrete time 
       PHYSICAL REVIEW E 62 (5): 6178-6194 Part A NOV 2000 
    20. 
       Guharay S, Hunt BR, Yorke JA, et al.
       Correlations in DNA sequences across the three domains of life 
       PHYSICA D-NONLINEAR PHENOMENA 146 (1-4): 388-396 NOV 15 2000 

21. 
       Tanaka N, Okamoto H, Naito M
       Detecting and evaluating intrinsic nonlinearity present in the mutual dependence
       between two variables 
       PHYSICA D 147 (1-2): 1-11 DEC 1 2000 
    22. 
       Mansilla R
       Algorithmic complexity in the minority game 
       PHYSICAL REVIEW E 62 (4): 4553-4557 Part A OCT 2000 
    23. 
       Ibanez JJ, De Alba S
       Pedodiversity and scaling laws: sharing Martin and Rey's opinion on the role of the
       Shannon index as a measure of diversity 
       GEODERMA 98 (1-2): 5-9 NOV 2000 
    24. 
       Matsuda H
       Physical nature of higher-order mutual information: Intrinsic correlations and
       frustration 
       PHYSICAL REVIEW E 62 (3): 3096-3102 Part A SEP 2000 
    25. 
       Li WT, Reich J
       A complete enumeration and classification of two-locus disease models 
       HUMAN HEREDITY 50 (6): 334-349 NOV-DEC 2000 
    26. 
       Grosse I, Herzel H, Buldyrev SV, et al.
       Species independence of mutual information in coding and noncoding DNA 
       PHYSICAL REVIEW E 61 (5): 5624-5629 Part B MAY 2000 
    27. 
       Zoldi SM, Krystal A, Greenside HS
       Stationarity and redundancy of multichannel EEG data recorded during generalized
       tonic-clonic seizures 
       BRAIN TOPOGRAPHY 12 (3): 187-200 SPR 2000 
    28. 
       Feixas M, del Acebo E, Bekaert P, et al.
       An information theory framework for the analysis of scene complexity 
       COMPUTER GRAPHICS FORUM 18 (3): C95-C106 Sp. Iss. CI 1999 
    29. 
       Compiani M, Fariselli P, Martelli PL, et al.
       Neural networks to study invariant features of protein folding 
       THEORETICAL CHEMISTRY ACCOUNTS 101 (1-3): 21-26 FEB 1999 
    30. 
       Voss H, Kurths J
       Test for nonlinear dynamical behavior in symbol sequences 
       PHYSICAL REVIEW E 58 (1): 1155-1158 JUL 1998 

31. 
       Li WT
       The study of correlation structures of DNA sequences: a critical review 
       COMPUTERS & CHEMISTRY 21 (4): 257-271 1997 
    32. 
       Ito K, Gunji YP
       Self-organized criticality resulting from minimization of perpetual disequilibration 
       PHYSICA D 102 (3-4): 275-284 APR 1 1997 
    33. 
       Paulus MP
       Long-range interactions in sequences of human behavior 
       PHYSICAL REVIEW E 55 (3): 3249-3256 Part B MAR 1997 
    34. 
       Delgado J, Sole RV
       Collective-induced computation 
       PHYSICAL REVIEW E 55 (3): 2338-2344 Part A MAR 1997 
    35. 
       Herzel H, Grosse I
       Correlations in DNA sequences: The role of protein coding segments 
       PHYSICAL REVIEW E 55 (1): 800-810 Part B JAN 1997 
    36. 
       Zheng GL, Billings SA
       Radial basis function network configuration using mutual information and the
       orthogonal least squares algorithm 
       NEURAL NETWORKS 9 (9): 1619-1637 DEC 1996 
    37. 
       Matsuda H, Kudo K, Nakamura R, et al.
       Mutual information of ising systems 
       INTERNATIONAL JOURNAL OF THEORETICAL PHYSICS 35 (4): 839-845 APR
       1996 
    38. 
       WOLPERT DH, WOLF DR
       ESTIMATING FUNCTIONS OF PROBABILITY-DISTRIBUTIONS FROM A
       FINITE-SET OF SAMPLES 
       PHYSICAL REVIEW E 52 (6): 6841-6854 Part B DEC 1995 
[more detailed analysis on "finite size effect"]

    39. 
       MOON YI, RAJAGOPALAN B, LALL U
       ESTIMATION OF MUTUAL INFORMATION USING KERNEL DENSITY
       ESTIMATORS 
       PHYSICAL REVIEW E 52 (3): 2318-2321 Part A SEP 1995 
    40. 
       MANSILLA R, MATEOREIG R
       ON THE MATHEMATICAL-MODELING OF INTRONIC SECTORS OF THE DNA
       MOLECULE 
       INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS 5 (4): 1235-1241
       AUG 1995 

41. 
       EBELING W, POSCHEL T, ALBRECHT KF
       ENTROPY - TRANSINFORMATION AND WORD DISTRIBUTION OF
       INFORMATION-CARRYING SEQUENCES 
       INTERNATIONAL JOURNAL OF BIFURCATION AND CHAOS 5 (1): 51-61 FEB
       1995 
    42. 
       HERZEL H, GROSSE I
       MEASURING CORRELATIONS IN SYMBOL SEQUENCES 
       PHYSICA A 216 (4): 518-542 JUL 1 1995 
[There are several nice extensions in this paper: (1) correlation 
function is represented by a product of the correlation matrix and 
two arrays ("bilinear" form), thus separating the coordinate-invariant 
part of the correlation function; (2) correlation matrix doesn't 
have to be symmetric, and correlation functions fail to detect 
the asymmetric part of the correlation; (3) the finite-size effect 
on mutual information now is easily obtained from the finite-size 
effect on entropy calculation. ]

    43. 
       EBELING W, NEIMAN A
       LONG-RANGE CORRELATIONS BETWEEN LETTERS AND SENTENCES IN
       TEXTS 
       PHYSICA A 215 (3): 233-241 MAY 1 1995 
    44. 
       CHERN JL
       MEMORY FLOW STRUCTURES LORENZ CHAOS 
       PHYSICAL REVIEW E 50 (6): 4315-4318 DEC 1994 
    45. 
       LI WT, MARR TG, KANEKO K
       UNDERSTANDING LONG-RANGE CORRELATIONS IN DNA-SEQUENCES 
       PHYSICA D 75 (1-3): 392-416 AUG 1 1994 
    46. 
       BATTITI R
       USING MUTUAL INFORMATION FOR SELECTING FEATURES IN SUPERVISED
       NEURAL-NET LEARNING 
       IEEE TRANSACTIONS ON NEURAL NETWORKS 5 (4): 537-550 JUL 1994 
    47. 
       PHILLIPS JD
       DETERMINISTIC UNCERTAINTY IN LANDSCAPES 
       EARTH SURFACE PROCESSES AND LANDFORMS 19 (5): 389-401 AUG 1994 
    48. 
       EBELING W, POSCHEL T
       ENTROPY AND LONG-RANGE CORRELATIONS IN LITERARY ENGLISH 
       EUROPHYSICS LETTERS 26 (4): 241-246 MAY 1 1994 
    49. 
       EBELING W
       CHAOS, ORDER, AND INFORMATION IN THE EVOLUTION OF STRINGS 
       APPLIED MATHEMATICS AND COMPUTATION 56 (2-3): 131-151 JUL 1993 
    50. 
       BREEDON JL, PACKARD NH
       NONLINEAR-ANALYSIS OF DATA SAMPLED NONUNIFORMLY IN TIME 
       PHYSICA D 58 (1-4): 273-283 SEP 15 1992 

51. 
       LI W, KANEKO K
       LONG-RANGE CORRELATION AND PARTIAL 1/F-ALPHA SPECTRUM IN A
       NONCODING DNA-SEQUENCE 
       EUROPHYSICS LETTERS 17 (7): 655-660 FEB 7 1992 
    52. 
       LI WT
       EXPANSION-MODIFICATION SYSTEMS - A MODEL FOR SPATIAL 1/F
       SPECTRA 
       PHYSICAL REVIEW A 43 (10): 5240-5260 MAY 15 1991 
    53. 
       LI WT, PACKARD NH, LANGTON CG
       TRANSITION PHENOMENA IN CELLULAR AUTOMATA RULE SPACE 
       PHYSICA D 45 (1-3): 77-94 SEP 1990 



more...