Lesson plan
Directed information
Directed information is an information theory measure that quantifies the information flow from the random string X^n = (X_1,X_2,\dots,X_n) to the random string Y^n = (Y_1,Y_2,\dots,Y_n) . The term directed information was coined by James Massey and is defined as : I(X^n\to Y^n) \triangleq \sum_{i=1}^n I(X^i;Y_i|Y^{i-1}) where I(X^{i};Y_i|Y^{i-1}) is the conditional mutual information I(X_1,X_2,...,X_{i};Y_i|Y_1,Y_2,...,Y_{i-1}) . Directed information has applications to problems where causality plays an important role such as the capacity of channels with feedback, capacity of discrete memoryless networks, capacity of networks with in-block memory, gambling with causal side information, compression with causal side information, real-time control communication settings, and statistical physics.
Article summary
Directed information is an information theory measure that quantifies the information flow from the random string X^n = (X_1,X_2,\dots,X_n) to the random string Y^n = (Y_1,Y_2,\dots,Y_n) . The term directed information was coined by James Massey and is defined as : I(X^n\to Y^n) \triangleq \sum_{i=1}^n I(X^i;Y_i|Y^{i-1}) where I(X^{i};Y_i|Y^{i-1}) is the conditional mutual information I(X_1,X_2,...,X_{i};Y_i|Y_1,Y_2,...,Y_{i-1}) . Directed information has applications to problems where causality plays an important role such as the capacity of channels with feedback, capacity of discrete memoryless networks, capacity of networks with in-block memory, gambling with causal side information, compression with causal side information, real-time control communication settings, and statistical physics.
Key claims
No claims recorded.
Discussion questions
- Summarise the article in your own words. Which single claim would you verify first, and why?
- Which claim in this article is most likely to be revised as the sources update? How would you check its current status?
- If two sources disagreed about one of these facts, what would you need in order to trust one over the other?
Bibliography
No sources recorded.
Key claims and bibliography are generated from the same tracked claims and sources as the article page.