The relationship between transfer entropy and directed information

Author(s):  
Ying Liu ◽  
Selin Aviyente
2008 ◽  
Vol 33 (4) ◽  
pp. 27-46 ◽  
Author(s):  
Y V Reddy ◽  
A Sebastin

Interactions between the foreign exchange market and the stock market of a country are considered to be an important internal force of the markets in a financially liberalized environment. If causal relationship from a market to the other is not detected, then informational efficiency exists in the other whereas existence of causality implies that hedging of exposure to one market by taking position in the other market will be effective. The temporal relationship between the forex market and the stock market of developing and developed countries has been studied, especially after the East Asian financial crisis of 1997–98, using various methods like cross-correlation, cross-spectrum, and error correction model, but these methods identify only linear relations. A statistically rigorous approach to the detection of interdependence, including non-linear dynamic relationships, between time series is provided by tools defined using the information theoretic concept of entropy. Entropy is the amount of disorder in the system and also is the amount of information needed to predict the next measurement with a certain precision. The mutual information between two random variables X and Y with a joint probability mass function p(x,y) and marginal mass functions p(x) and p(y), is defined as the relative entropy between the joint distribution p(x,y) and the product distribution p(x)*p(y). Mutual information is the reduction in the uncertainty of X due to the knowledge of Y and vice versa. Since mutual information measures the deviation from independence of the variables, it has been proposed as a tool to measure the relationship between financial market segments. However, mutual information is a symmetric measure and does not contain either dynamic information or directional sense. Even time delayed mutual information does not distinguish information actually exchanged from shared information due to a common input signal or history and therefore does not quantify the actual overlap of the information content of two variables. Another information theoretic measure called transfer entropy has been introduced by Thomas Schreiber (2000) to study the relationship between dynamic systems; the concept has also been applied by some authors to study the causal structure between financial time series. In this paper, an attempt has been made to study the interaction between the stock and the forex markets in India by computing transfer entropy between daily data series of the 50 stock index of the National Stock Exchange of India Limited, viz., Nifty and the exchange rate of Indian Rupee vis- à- vis US Dollar, viz., Reserve Bank of India reference rate. The entire period–November 1995 to March 2007–selected for the study, has been divided into three sub-periods for the purpose of analysis, considering the developments that took place during these sub-periods. The results obtained reveal that: there exist only low level interactions between the stock and the forex markets of India at a time scale of a day or less, although theory suggests interactive relationship between the two markets the flow from the stock market to the forex market is more pronounced than the flow in the reverse direction.


2021 ◽  
Vol 12 (2) ◽  
pp. 269-280
Author(s):  
Neda Sanjari ◽  
◽  
Ahmad Shalbaf ◽  
Reza Shalbaf ◽  
Jamie Sleigh ◽  
...  

Introduction: Ensuring an adequate Depth of Anesthesia (DOA) during surgery is essential for anesthesiologists. Since the effect of anesthetic drugs is on the central nervous system, brain signals such as Electroencephalogram (EEG) can be used for DOA estimation. Anesthesia can interfere among brain regions, so the relationship among different areas can be a key factor in the anesthetic process. Methods: In this paper, by combining the Wiener causality concept and the conditional mutual information, a nonlinear effective connectivity measure called Transfer Entropy (TE) is presented to describe the relationship between EEG signals at frontal and temporal regions from eight volunteers in three anesthetic states (awake, unconscious and recovery). This index is also compared with Granger causality and partial directional coherence methods as common effective connectivity indexes. Results: Based on a statistical analysis of the probability predictive value and Kruskal-Wallis statistical method, TE can effectively fallow the effect-site concentration of propofol and distinguish the anesthetic states well, and perform better than the other effective connectivity indexes. This index is also better than Bispectral Index (BIS) as commercial DOA monitor because of the faster response and higher correlation with the drug concentration effect-site, less irregularity in the unconscious state and better ability to distinguish three states of anesthestesia. Conclusion: TE index is a confident indicator for designing a new monitoring system of the two EEG channels for DOA estimation.


Entropy ◽  
2020 ◽  
Vol 22 (4) ◽  
pp. 385 ◽  
Author(s):  
Ali Tehrani-Saleh ◽  
Christoph Adami

How cognitive neural systems process information is largely unknown, in part because of how difficult it is to accurately follow the flow of information from sensors via neurons to actuators. Measuring the flow of information is different from measuring correlations between firing neurons, for which several measures are available, foremost among them the Shannon information, which is an undirected measure. Several information-theoretic notions of “directed information” have been used to successfully detect the flow of information in some systems, in particular in the neuroscience community. However, recent work has shown that directed information measures such as transfer entropy can sometimes inadequately estimate information flow, or even fail to identify manifest directed influences, especially if neurons contribute in a cryptographic manner to influence the effector neuron. Because it is unclear how often such cryptic influences emerge in cognitive systems, the usefulness of transfer entropy measures to reconstruct information flow is unknown. Here, we test how often cryptographic logic emerges in an evolutionary process that generates artificial neural circuits for two fundamental cognitive tasks (motion detection and sound localization). Besides counting the frequency of problematic logic gates, we also test whether transfer entropy applied to an activity time-series recorded from behaving digital brains can infer information flow, compared to a ground-truth model of direct influence constructed from connectivity and circuit logic. Our results suggest that transfer entropy will sometimes fail to infer directed information when it exists, and sometimes suggest a causal connection when there is none. However, the extent of incorrect inference strongly depends on the cognitive task considered. These results emphasize the importance of understanding the fundamental logic processes that contribute to information flow in cognitive processing, and quantifying their relevance in any given nervous system.


Author(s):  
Dennis Joe Harmah ◽  
Cunbo Li ◽  
Fali Li ◽  
Yuanyuan Liao ◽  
Jiuju Wang ◽  
...  

1967 ◽  
Vol 31 ◽  
pp. 239-251 ◽  
Author(s):  
F. J. Kerr

A review is given of information on the galactic-centre region obtained from recent observations of the 21-cm line from neutral hydrogen, the 18-cm group of OH lines, a hydrogen recombination line at 6 cm wavelength, and the continuum emission from ionized hydrogen.Both inward and outward motions are important in this region, in addition to rotation. Several types of observation indicate the presence of material in features inclined to the galactic plane. The relationship between the H and OH concentrations is not yet clear, but a rough picture of the central region can be proposed.


Paleobiology ◽  
1980 ◽  
Vol 6 (02) ◽  
pp. 146-160 ◽  
Author(s):  
William A. Oliver

The Mesozoic-Cenozoic coral Order Scleractinia has been suggested to have originated or evolved (1) by direct descent from the Paleozoic Order Rugosa or (2) by the development of a skeleton in members of one of the anemone groups that probably have existed throughout Phanerozoic time. In spite of much work on the subject, advocates of the direct descent hypothesis have failed to find convincing evidence of this relationship. Critical points are:(1) Rugosan septal insertion is serial; Scleractinian insertion is cyclic; no intermediate stages have been demonstrated. Apparent intermediates are Scleractinia having bilateral cyclic insertion or teratological Rugosa.(2) There is convincing evidence that the skeletons of many Rugosa were calcitic and none are known to be or to have been aragonitic. In contrast, the skeletons of all living Scleractinia are aragonitic and there is evidence that fossil Scleractinia were aragonitic also. The mineralogic difference is almost certainly due to intrinsic biologic factors.(3) No early Triassic corals of either group are known. This fact is not compelling (by itself) but is important in connection with points 1 and 2, because, given direct descent, both changes took place during this only stage in the history of the two groups in which there are no known corals.


2020 ◽  
Vol 43 ◽  
Author(s):  
Thomas Parr

Abstract This commentary focuses upon the relationship between two themes in the target article: the ways in which a Markov blanket may be defined and the role of precision and salience in mediating the interactions between what is internal and external to a system. These each rest upon the different perspectives we might take while “choosing” a Markov blanket.


Sign in / Sign up

Export Citation Format

Share Document