Evaluation of Systems' Irregularity and Complexity: Sample Entropy, Its Derivatives, and Their Applications Across Scales and Disciplines

Evaluation of Systems' Irregularity and Complexity: Sample Entropy, Its Derivatives, and Their Applications Across Scales and Disciplines PDF

Author: Anne Humeau-Heurtier

Publisher:

Published: 2018

Total Pages:

ISBN-13: 9783038973331

DOWNLOAD EBOOK →

Based on information theory, a number of entropy measures have been proposed since the 1990s to assess systems' irregularity, such as approximate entropy, sample entropy, permutation entropy, intrinsic mode entropy, and dispersion entropy, to cite only a few. Among them, sample entropy has been used in a very large variety of disciplines for both univariate and multivariate data. However, improvements to the sample entropy algorithm are still being proposed because sample entropy is unstable for short time series, may be sensitive to parameter values, and can be too time-consuming for long data. At the same time, it is worth noting that sample entropy does not take into account the multiple temporal scales inherent in complex systems. It is maximized for completely random processes and is used only to quantify the irregularity of signals on a single scale. This is why analyses of irregularity-with sample entropy or its derivatives-at multiple time scales have been proposed to assess systems' complexity. This Book presents contributions related to new and original research based on the use of sample entropy or its derivatives.

Multiscale Entropy Approaches and Their Applications

Multiscale Entropy Approaches and Their Applications PDF

Author: Anne Humeau-Heurtier

Publisher: MDPI

Published: 2020-11-06

Total Pages: 446

ISBN-13: 3039433407

DOWNLOAD EBOOK →

Multiscale entropy (MSE) measures to evaluate the complexity of time series by taking into account the multiple time scales in physical systems were proposed in the early 2000s. Since then, these approaches have received a great deal of attention and have been used in a wide range of applications. Multivariate approaches have also been developed. The algorithms for an MSE approach are composed of two main steps: (i) a coarse-graining procedure to represent the system’s dynamics on different scales and (ii) the entropy computation for the original signal and for the coarse-grained time series to evaluate the irregularity for each scale. Moreover, different entropy measures have been associated with the coarse-graining approach, each one having its advantages and drawbacks. In this Special Issue, we gathered 24 papers focusing on either the theory or applications of MSE approaches. These papers can be divided into two groups: papers that propose new developments in entropy-based measures or improve the understanding of existing ones (9 papers) and papers that propose new applications of existing entropy-based measures (14 papers). Moreover, one paper presents a review of cross-entropy methods and their multiscale approaches.

Multiscale Entropy Approaches and Their Applications

Multiscale Entropy Approaches and Their Applications PDF

Author: Anne Humeau-Heurtier

Publisher:

Published: 2020

Total Pages: 446

ISBN-13: 9783039433414

DOWNLOAD EBOOK →

Multiscale entropy (MSE) measures to evaluate the complexity of time series by taking into account the multiple time scales in physical systems were proposed in the early 2000s. Since then, these approaches have received a great deal of attention and have been used in a wide range of applications. Multivariate approaches have also been developed. The algorithms for an MSE approach are composed of two main steps: (i) a coarse-graining procedure to represent the system's dynamics on different scales and (ii) the entropy computation for the original signal and for the coarse-grained time series to evaluate the irregularity for each scale. Moreover, different entropy measures have been associated with the coarse-graining approach, each one having its advantages and drawbacks. In this Special Issue, we gathered 24 papers focusing on either the theory or applications of MSE approaches. These papers can be divided into two groups: papers that propose new developments in entropy-based measures or improve the understanding of existing ones (9 papers) and papers that propose new applications of existing entropy-based measures (14 papers). Moreover, one paper presents a review of cross-entropy methods and their multiscale approaches.

Frontiers in Entropy Across the Disciplines - Panorama of Entropy: Theory, Computation, and Applications

Frontiers in Entropy Across the Disciplines - Panorama of Entropy: Theory, Computation, and Applications PDF

Author: M. Zuhair Nashed

Publisher: World Scientific Publishing Company

Published: 2022-10-04

Total Pages: 0

ISBN-13: 9789811259395

DOWNLOAD EBOOK →

Frontiers in Entropy Across the Disciplines presents a panorama of entropy emphasizing mathematical theory, physical and scientific significance, computational methods, and applications in mathematics, physics, statistics, engineering, biomedical signals, and signal processing.In the last century classical concepts of entropy were introduced in the areas of thermodynamics, information theory, probability theory, statistics, dynamical systems, and ergodic theory. During the past 50 years, dozens of new concepts of entropy have been introduced and studied in many disciplines. This volume captures significant developments in this arena. It features expository, review, and research papers by distinguished mathematicians and scientists from many disciplines. The level of mathematics ranges from intermediate level to research level. Each chapter contains a comprehensive list of references. Topics include entropy and society, entropy and time, Souriau entropy on symplectic model of statistical physics, new definitions of entropy, geometric theory of heat and information, maximum entropy in Bayesian networks, maximum entropy methods, entropy analysis of biomedical signals (review and comparison of methods), spectral entropy and its application to video coding and speech coding, a comprehensive review of 50 years of entropy in dynamics, a comprehensive review on entropy, entropy-like quantities and applications, topological entropy of multimodal maps, entropy production in complex systems, entropy production and convergence to equilibrium, reversibility and irreversibility in entropy, nonequilibrium entropy, index of various entropy, entropy and the greatest blunder ever.

Statistical Mechanics

Statistical Mechanics PDF

Author: James Sethna

Publisher: OUP Oxford

Published: 2006-04-07

Total Pages: 374

ISBN-13: 0191566217

DOWNLOAD EBOOK →

In each generation, scientists must redefine their fields: abstracting, simplifying and distilling the previous standard topics to make room for new advances and methods. Sethna's book takes this step for statistical mechanics - a field rooted in physics and chemistry whose ideas and methods are now central to information theory, complexity, and modern biology. Aimed at advanced undergraduates and early graduate students in all of these fields, Sethna limits his main presentation to the topics that future mathematicians and biologists, as well as physicists and chemists, will find fascinating and central to their work. The amazing breadth of the field is reflected in the author's large supply of carefully crafted exercises, each an introduction to a whole field of study: everything from chaos through information theory to life at the end of the universe.

Bulletin of the Atomic Scientists

Bulletin of the Atomic Scientists PDF

Author:

Publisher:

Published: 1972-10

Total Pages: 64

ISBN-13:

DOWNLOAD EBOOK →

The Bulletin of the Atomic Scientists is the premier public resource on scientific and technological developments that impact global security. Founded by Manhattan Project Scientists, the Bulletin's iconic "Doomsday Clock" stimulates solutions for a safer world.

Information, Physics, and Computation

Information, Physics, and Computation PDF

Author: Marc Mézard

Publisher: Oxford University Press

Published: 2009-01-22

Total Pages: 584

ISBN-13: 019857083X

DOWNLOAD EBOOK →

A very active field of research is emerging at the frontier of statistical physics, theoretical computer science/discrete mathematics, and coding/information theory. This book sets up a common language and pool of concepts, accessible to students and researchers from each of these fields.

Index Medicus

Index Medicus PDF

Author:

Publisher:

Published: 2001

Total Pages: 1632

ISBN-13:

DOWNLOAD EBOOK →

Vols. for 1963- include as pt. 2 of the Jan. issue: Medical subject headings.

Dealing with Complexity

Dealing with Complexity PDF

Author: Robert L. Flood

Publisher: Springer Science & Business Media

Published: 2013-03-09

Total Pages: 291

ISBN-13: 1475722354

DOWNLOAD EBOOK →

Contents 11. 2. 2. Four Main Areas of Dispute 247 11. 2. 3. Summary . . . 248 11. 3. Making Sense of the Issues . . 248 11. 3. 1. Introduction . . . . 248 11. 3. 2. The Scientific Approach 248 11. 3. 3. Science and Matters of Society . 249 11. 3. 4. Summary . 251 11. 4. Tying It All Together . . . . 251 11. 4. 1. Introduction . . . . 251 11. 4. 2. A Unifying Framework 251 11. 4. 3. Critical Systems Thinking 253 11. 4. 4. Summary 254 11. 5. Conclusion 254 Questions . . . 255 REFERENCES . . . . . . . . . . . . . . . . . . . 257 INDEX . . . . . . . . . . . . . . . . . . . . . . 267 Chapter One SYSTEMS Origin and Evolution, Terms and Concepts 1. 1. INTRODUCTION We start this book with Theme A (see Figure P. I in the Preface), which aims to develop an essential and fundamental understanding of systems science. So, what is systems science? When asked to explain what systems science is all about, many systems scientists are confronted with a rather daunting task. The discipline tends to be presented and understood in a fragmented way and very few people hold an overview understanding of the subject matter, while also having sufficient in-depth competence in many and broad-ranging subject areas where the ideas are used. Indeed, it was precisely this difficulty that identified the need for a comprehensive well-documented account such as is presented here in Dealing with Complexity.