Knuth's up-arrow notation
In mathematics, Knuth's up-arrow notation is a method of notation for very large integers, introduced by Donald Knuth in 1976.
≈ 13 min read
Knuth's up-arrow notation. encyclopegia.org, snapshot enwiki-001378462682. /a/knuth-s-up-arrow-notation
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In mathematics, Knuth's up-arrow notation is a method of notation for very large integers, introduced by Donald Knuth in 1976. In his 1947 paper, R. L. Goodstein introduced the specific sequence of operations that are now called hyperoperations. Goodstein also suggested the Greek names tetration, pentation, etc., for the extended operations beyond exponentiation.
The sequence starts with a unary operation (the successor function with n = 0), and continues with the binary operations of addition (n = 1), multiplication (n = 2), exponentiation (n = 3), tetration (n = 4), etc. Various notations have been used to represent hyperoperations. One such notation is H_n(a,b) . Knuth's up-arrow notation \uparrow is another.
For example: the single arrow \uparrow represents exponentiation (iterated multiplication) 2 \uparrow 4 = H_3(2,4) = 2\times(2\times(2\times 2)) = 2^4 = 16 the double arrow \uparrow\uparrow represents tetration (iterated exponentiation) 2 \uparrow\uparrow 4 = H_4(2,4) = 2 \uparrow (2 \uparrow (2 \uparrow 2))= 2^{2^{2^{2}}} = 2^{16} = 65,536 the triple arrow \uparrow\uparrow\uparrow represents pentation (iterated tetration) \begin{align} 2 \uparrow\uparrow\uparrow 4 &= H_5(2,4)\\ &= 2 \uparrow\uparrow (2 \uparrow\uparrow (2 \uparrow\uparrow 2 ))\\ &= 2 \uparrow\uparrow (2 \uparrow\uparrow (2 \uparrow 2 ))\\ &= 2 \uparrow\uparrow (2 \uparrow\uparrow 4 )\\ &= \underbrace{2 \uparrow (2 \uparrow (2 \uparrow\cdots ))} \;
= \; \underbrace{ \; 2^{2^{\cdots^2}}}\\ & \;\;\;\;\; 2 \uparrow\uparrow 4 \text{ copies of } 2 \;\;\;\;\; \text{65,536 2's}\\ \end{align} The general definition of the up-arrow notation is as follows (for a \ge 0, n \ge 1, b \ge 0 ): a\uparrow^nb = H_{n+2}(a,b) = a[n+2]b. Here, \uparrow^n stands for n arrows, so for example 2 \uparrow\uparrow\uparrow\uparrow 3 = 2\uparrow^4 3, and the square brackets used in the far right hand side expression is another notation for hyperoperations.
Introduction
The hyperoperations naturally extend the arithmetic operations of addition and multiplication as follows. Addition by a natural number is defined as iterated incrementation: \begin{matrix} H_1(a,b) = a+b = & a+\underbrace{1+1+\dots+1} \\ & b\mbox{ copies of }1 \end{matrix} Multiplication by a natural number is defined as iterated addition: \begin{matrix} H_2(a,b) = a\times b = & \underbrace{a+a+\dots+a} \\ & b\mbox{ copies of }a \end{matrix} For example, \begin{matrix} 4\times 3 & = & \underbrace{4+4+4} & = & 12\\ & & 3\mbox{ copies of }4 \end{matrix} Exponentiation for a natural power b is defined as iterated multiplication, which Knuth denoted by a single up-arrow: \begin{matrix} a\uparrow b = H_3(a,b) = a^b = & \underbrace{a\times a\times\dots\times a}\\ & b\mbox{ copies of }a \end{matrix} For example, \begin{matrix} 4\uparrow 3= 4^3 = & \underbrace{4\times 4\times 4} & = & 64\\ & 3\mbox{ copies of }4 \end{matrix} Tetration is defined as iterated exponentiation, which Knuth denoted by a "double arrow": \begin{matrix} a\uparrow\uparrow b = H_4(a,b) = & \underbrace{a^{a^{{}^{.\,^{.\,^{.\,^a}}}}}} & 3\uparrow\uparrow 2=3^3=27 3\uparrow\uparrow 3=3^{3^3}=3^{27}=7,625,597,484,987 3\uparrow\uparrow 4=3^{3^{3^3}}=3^{3^{27}}=3^{7625597484987} 3\uparrow\uparrow 5=3^{3^{3^{3^3}}}=3^{3^{3^{27}}}=3^{3^{7625597484987}} etc. This already leads to some fairly large numbers, but the hyperoperator sequence does not stop here.
Pentation, defined as iterated tetration, is represented by the "triple arrow": \begin{matrix} a\uparrow\uparrow\uparrow b = H_5(a,b) = & \underbrace{a_{}\uparrow\uparrow (a\uparrow\uparrow(\cdots\uparrow\uparrow a))}\\ & b\mbox{ copies of }a \end{matrix} Hexation, defined as iterated pentation, is represented by the "quadruple arrow": \begin{matrix} a\uparrow\uparrow\uparrow\uparrow b = H_6(a,b) = & \underbrace{a_{}\uparrow\uparrow\uparrow (a\uparrow\uparrow\uparrow(\cdots\uparrow\uparrow\uparrow a))}\\ & b\mbox{ copies of }a \end{matrix} and so on. The general rule is that an n -arrow operator expands into a right-associative series of ( n - 1 )-arrow operators.
Symbolically, \begin{matrix} a\ \underbrace{\uparrow_{}\uparrow\!\!\cdots\!\!\uparrow}_{n}\ b= \underbrace{a\ \underbrace{\uparrow\!\!\cdots\!\!\uparrow}_{n-1} \ (a\ \underbrace{\uparrow_{}\!\!\cdots\!\!\uparrow}_{n-1} \ (\cdots \ \underbrace{\uparrow_{}\!\!\cdots\!\!\uparrow}_{n-1} \ a))}_{b\text{ copies of }a} \end{matrix} Examples: 3\uparrow\uparrow\uparrow2 = 3\uparrow\uparrow3 = 3^{3^3} = 3^{27}=7,625,597,484,987 \begin{align} 3\uparrow\uparrow\uparrow3 &= 3\uparrow\uparrow(3\uparrow\uparrow3) \\ &= 3\uparrow\uparrow(3\uparrow 3\uparrow3) \\ &= \begin{matrix} \underbrace{3\uparrow 3\uparrow\cdots\uparrow 3} \\ 3\uparrow3\uparrow3\mbox{ copies of } 3 \end{matrix}\\ &= \begin{matrix} \underbrace{3\uparrow 3\uparrow\cdots\uparrow 3} \\ \mbox{7,625,597,484,987 copies of 3} \end{matrix}\\ &= \begin{matrix} \underbrace{3^{3^{3^{3^{\cdot^{\cdot^{\cdot^{\cdot^{3}}}}}}}}} \\ \mbox{7,625,597,484,987 copies of 3} \end{matrix} \end{align}
Notation
In expressions such as a^b , the notation for exponentiation is usually to write the exponent b as a superscript to the base number a . But many environments — such as programming languages and plain-text e-mail — do not support superscript typesetting. People have adopted the linear notation a \uparrow b for such environments; the up-arrow suggests 'raising to the power of'.
If the character set does not contain an up arrow, the caret (^) is used instead. The superscript notation a^b doesn't lend itself well to generalization, which explains why Knuth chose to work from the inline notation a \uparrow b instead. a \uparrow^n b is a shorter alternative notation for n up arrows. Thus a \uparrow^4 b = a \uparrow \uparrow \uparrow \uparrow b .
Writing out up-arrow notation in terms of powers
Attempting to write a \uparrow \uparrow b using the familiar superscript notation gives a power tower. For example: a \uparrow \uparrow 4 = a \uparrow (a \uparrow (a \uparrow a)) = a^{a^{a^a}} If b is a variable (or is too large), the power tower might be written using dots and a note indicating the height of the tower. a \uparrow \uparrow b = {} \underbrace{a^{a^{.^{.^{.{a}}}}}}_{b} Continuing with this notation, a \uparrow \uparrow \uparrow b could be written with a stack of such power towers, each describing the size of the one above it. a \uparrow \uparrow \uparrow 4 = a \uparrow \uparrow (a \uparrow \uparrow (a \uparrow \uparrow a)) = \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{a} }} Again, if b is a variable or is too large, the stack might be written using dots and a note indicating its height. a \uparrow \uparrow \uparrow b = \left. \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{\vdots}_{a} }} \right\} b Furthermore, a \uparrow \uparrow \uparrow \uparrow b might be written using several columns of such stacks of power towers, each column describing the number of power towers in the stack to its left: a \uparrow \uparrow \uparrow \uparrow 4 = a \uparrow \uparrow \uparrow (a \uparrow \uparrow \uparrow (a \uparrow \uparrow \uparrow a)) = \left.\left.\left. \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{\vdots}_{a} }} \right\} \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{\vdots}_{a} }} \right\} \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{\vdots}_{a} }} \right\} a And more generally: a \uparrow \uparrow \uparrow \uparrow b = \underbrace{ \left.\left.\left. \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{\vdots}_{a} }} \right\} \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{a^{a^{.^{.^{.{a}}}}}}_{ \underbrace{\vdots}_{a} }} \right\} \cdots \right\} a }_{b} This might be carried out indefinitely to represent a \uparrow^n b as iterated exponentiation of iterated exponentiation for any a , n , and b (although it clearly becomes rather cumbersome).
Using tetration
The Rudy Rucker notation ^{b}a for tetration allows us to make these diagrams slightly simpler while still employing a geometric representation (we could call these tetration towers). a \uparrow \uparrow b = { }^{b}a a \uparrow \uparrow \uparrow b = \underbrace{^{^{^{^{^{a}.}.}.}a}a}_{b} a \uparrow \uparrow \uparrow \uparrow b = \left. \underbrace{^{^{^{^{^{a}.}.}.}a}a}_{ \underbrace{^{^{^{^{^{a}.}.}.}a}a}_{ \underbrace{\vdots}_{a} }} \right\} b Finally, as an example, the fourth Ackermann number 4 \uparrow^4 4 could be represented as: \underbrace{^{^{^{^{^{4}.}.}.}4}4}_{ \underbrace{^{^{^{^{^{4}.}.}.}4}4}_{ \underbrace{^{^{^{^{^{4}.}.}.}4}4}_{4} }} = \underbrace{^{^{^{^{^{4}.}.}.}4}4}_{ \underbrace{^{^{^{^{^{4}.}.}.}4}4}_{ ^{^{^{4}4}4}4 }}
Generalizations
Some numbers are so large that multiple arrows of Knuth's up-arrow notation become too cumbersome; then an n-arrow operator \uparrow^n is useful (and also for descriptions with a variable number of arrows), or equivalently, hyperoperators. Some numbers are so large that even that notation is not sufficient.
The Conway chained arrow notation can then be used: a chain of three elements is equivalent with the other notations, but a chain of four or more is even more powerful. \begin{matrix} a\uparrow^n b & = & a [n+2] b & = & a\to b\to n \\ \text{(Knuth)} & & \text{(hyperoperation)} & & \text{(Conway)} \end{matrix} 6\uparrow\uparrow4 = \underbrace{6^{6^{.^{.^{.^{6}}}}}}_4 , Since 6\uparrow\uparrow4 = 6^{6^{6^{6}}} = 6^{6^{46,656}} ,
Thus the result comes out with \underbrace{6^{6^{.^{.^{.^{6}}}}}}_4 10\uparrow(3\times10\uparrow(3\times10\uparrow15)+3) = \underbrace{100000\ldots000}_{ \underbrace{300000\ldots003}_{\underbrace{300000\ldots000}_{15} }} or 10^{3\times10^{3\times10^{15}}+3} Even faster-growing functions can be categorized using an ordinal analysis called the fast-growing hierarchy. The fast-growing hierarchy uses successive function iteration and diagonalization to systematically create faster-growing functions from some base function f(x) . For the standard fast-growing hierarchy using f_0(x) = x+1 , f_2(x) already exhibits exponential growth, f_3(x) is comparable to tetrational growth and is upper-bounded by a function involving the first four hyperoperators;.
Then, f_\omega(x) is comparable to the Ackermann function, f_{\omega + 1}(x) is already beyond the reach of indexed arrows but can be used to approximate Graham's number, and f_{\omega^2}(x) is comparable to arbitrarily-long Conway chained arrow notation. These functions are all computable.
Even faster computable functions, such as the Goodstein sequence and the TREE sequence, require the usage of large ordinals and may occur in certain combinatorical and proof-theoretic contexts. There exist functions which grow uncomputably fast, such as the Busy Beaver, which by their very nature will be completely out of reach from any up-arrow, or even any ordinal-based analysis.
Definition
Without reference to hyperoperation the up-arrow operators can be formally defined by a\uparrow^n b= \begin{cases} a^b, & \text{if }n=1; \\ 1, & \text{if }n>1\text{ and }b=0; \\ a\uparrow^{n-1}(a\uparrow^{n}(b-1)), & \text{otherwise } \end{cases} for all integers a, b, n with a \ge 0, n \ge 1, b \ge 0 . This definition uses exponentiation (a\uparrow^1 b = a\uparrow b = a^b) as the base case, and tetration (a\uparrow^2 b = a\uparrow\uparrow b) as repeated exponentiation.
This is equivalent to the hyperoperation sequence except it omits the three more basic operations of succession, addition and multiplication. One can alternatively choose multiplication (a\uparrow^0 b = a \times b) as the base case and iterate from there. Then exponentiation becomes repeated multiplication.
The formal definition would be a\uparrow^n b= \begin{cases} a\times b, & \text{if }n=0; \\ 1, & \text{if }n>0\text{ and }b=0; \\ a\uparrow^{n-1}(a\uparrow^{n}(b-1)), & \text{otherwise } \end{cases} for all integers a, b, n with a \ge 0, n \ge 0, b \ge 0 . Note, however, that Knuth did not define the "nil-arrow" ( \uparrow^0 ).
One could extend the notation to negative indices (n ≥ -2) in such a way as to agree with the entire hyperoperation sequence, except for the lag in the indexing: H_n(a, b) = a [n] b = a \uparrow^{n-2}b\text{ for } n \ge 0. The up-arrow operation is a right-associative operation, that is, a \uparrow b \uparrow c is understood to be a \uparrow (b \uparrow c) , instead of (a \uparrow b) \uparrow c . If ambiguity is not an issue parentheses are sometimes dropped.
Computing 0↑ n b
Computing 0\uparrow^n b = H_{n+2}(0,b) = 0[n+2]b results in 0, when n = 0 1, when n = 1 and b = 0 0, when n = 1 and b > 0 1, when n > 1 and b is even (including 0) 0, when n > 1 and b is odd
Computing 2↑ n b
Computing 2\uparrow^n b can be restated in terms of an infinite table. We place the numbers 2^b in the top row, and fill the left column with values 2. To determine a number in the table, take the number immediately to the left, then look up the required number in the previous row, at the position given by the number just taken. The table is the same as that of the Ackermann function, except for a shift in n and b , and an addition of 3 to all values.
Computing 3 ↑ n b
We place the numbers 3^b in the top row, and fill the left column with values 3. To determine a number in the table, take the number immediately to the left, then look up the required number in the previous row, at the position given by the number just taken.
Computing 4 ↑ n b
We place the numbers 4^b in the top row, and fill the left column with values 4. To determine a number in the table, take the number immediately to the left, then look up the required number in the previous row, at the position given by the number just taken.
Computing 10 ↑ n b
We place the numbers 10^b in the top row, and fill the left column with values 10. To determine a number in the table, take the number immediately to the left, then look up the required number in the previous row, at the position given by the number just taken.
For 2 ≤ b ≤ 9 the numerical order of the numbers 10\uparrow^n b is the lexicographical order with n as the most significant number, so for the numbers of these 8 columns the numerical order is simply line-by-line. The same applies for the numbers in the 97 columns with 3 ≤ b ≤ 99, and if we start from n = 1 even for 3 ≤ b ≤ 9,999,999,999.
See also
Primitive recursion Cutler's bar notation Steinhaus–Moser notation
External links
Robert Munafo, Large Numbers: Higher hyper operators
Text derived from https://en.wikipedia.org/w/index.php?oldid=1378462682 under CC BY-SA 4.0; modifications have been made.