chain rule

Uses your system voice; voice and rate in settings.

Q207455Snapshot

≈ 20 min read

Names in other languages

  • bsPravilo derivacije složene funkcije
  • PolskiReguła łańcuchowa
  • Englishchain rule
  • 中文链式法则
  • 简体中文链式法则
  • 繁體中文鏈式法則
  • 中文鏈式法則
  • 中文链式法则
  • 中文鏈式法則

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

In calculus, the chain rule is a formula that expresses the derivative of the composition of two differentiable functions and in terms of the derivatives of and . More precisely, if h=z\circ y is the composition such that h(x)=z(y(x)) for every , then the chain rule is, in Lagrange's notation, h'(x) = z'(y(x)) y'(x). or, equivalently, h'=(z\circ y)'=(z'\circ y)\cdot y'. The chain rule may also be expressed in Leibniz's notation. If a variable depends on the variable , which itself depends on the variable (that is, and are dependent variables), then depends on as well, via the intermediate variable . In this case, the chain rule is expressed as \frac{dz}{dx} = \frac{dz}{dy} \cdot \frac{dy}{dx}, and \left.\frac{dz}{dx}\right|_{x} = \left.\frac{dz}{dy}\right|_{y(x)} \cdot \left. \frac{dy}{dx}\right|_{x} , for indicating at which points the derivatives have to be evaluated. In integration, the counterpart to the chain rule is the substitution rule.

In calculus, the chain rule is a formula that expresses the derivative of the composition of two differentiable functions and in terms of the derivatives of and . More precisely, if h=z\circ y is the composition such that h(x)=z(y(x)) for every , then the chain rule is, in Lagrange's notation, h'(x) = z'(y(x)) y'(x). or, equivalently, h'=(z\circ y)'=(z'\circ y)\cdot y'. The chain rule may also be expressed in Leibniz's notation. If a variable depends on the variable , which itself depends on the variable (that is, and are dependent variables), then depends on as well, via the intermediate variable . In this case, the chain rule is expressed as \frac{dz}{dx} = \frac{dz}{dy} \cdot \frac{dy}{dx}, and \left.\frac{dz}{dx}\right|_{x} = \left.\frac{dz}{dy}\right|_{y(x)} \cdot \left. \frac{dy}{dx}\right|_{x} , for indicating at which points the derivatives have to be evaluated. In integration, the counterpart to the chain rule is the substitution rule.

Intuitive explanation

Intuitively, the chain rule states that knowing the instantaneous rate of change of relative to and that of relative to allows one to calculate the instantaneous rate of change of relative to as the product of the two rates of change. As put by George F. Simmons: "If a car travels twice as fast as a bicycle and the bicycle is four times as fast as a walking man, then the car travels 2 × 4 = 8 times as fast as the man." The relationship between this example and the chain rule is as follows. Let , and be the (variable) positions of the car, the bicycle, and the walking man, respectively. The rate of change of relative positions of the car and the bicycle is \frac {dz}{dy}=2. Similarly, \frac {dy}{dx}=4. So, the rate of change of the relative positions of the car and the walking man is \frac{dz}{dx}=\frac{dz}{dy}\cdot\frac{dy}{dx}=2\cdot 4=8. The rate of change of positions is the ratio of the speeds, and the speed is the derivative of the position with respect to the time; that is, \frac{dz}{dx}=\frac{\dfrac{dz}{dt}}{\dfrac{dx}{dt}}, or, equivalently, \frac{dz}{dt}=\frac{dz}{dx}\cdot \frac{dx}{dt}, which is also an application of the chain rule. (f\circ g)'(c) = f'(g(c))\cdot g'(c). The rule is sometimes abbreviated as (f\circ g)' = (f'\circ g) \cdot g'. If and , then this abbreviated form is written in Leibniz notation as: \frac{dy}{dx} = \frac{dy}{du} \cdot \frac{du}{dx}. The points where the derivatives are evaluated may also be stated explicitly: \left.\frac{dy}{dx}\right|_{x=c} = \left.\frac{dy}{du}\right|_{u = g(c)} \cdot \left.\frac{du}{dx}\right|_{x=c}. Carrying the same reasoning further, given functions f_1, \ldots, f_n\! with the composite function f_1 \circ ( f_2 \circ \cdots (f_{n-1} \circ f_n) )\! , if each function f_i\! is differentiable at its immediate input, then the composite function is also differentiable by the repeated application of the chain rule, where the derivative is (in Leibniz's notation): \frac{df_1}{dx} = \frac{df_1}{df_2}\frac{df_2}{df_3}\cdots\frac{df_n}{dx}. y = e^{\sin (x^2)}. This can be decomposed as the composite of three functions: \begin{align} y &= f(u) = e^u, \\ u &= g(v) = \sin v, \\ v &= h(x) = x^2. \end{align} So that y = f(g(h(x))) . Their derivatives are: \begin{align} \frac{dy}{du} &= f'(u) = e^u, \\ \frac{du}{dv} &= g'(v) = \cos v, \\ \frac{dv}{dx} &= h'(x) = 2x. \end{align} The chain rule states that the derivative of their composite at the point is: \begin{align} (f \circ g \circ h)'(a) & = f'((g \circ h)(a)) \cdot (g \circ h)'(a) \\ & = f'((g \circ h)(a)) \cdot g'(h(a)) \cdot h'(a) \\ & = (f' \circ g \circ h)(a) \cdot (g' \circ h)(a) \cdot h'(a). \end{align} In Leibniz's notation, this is: \frac{dy}{dx} = \left.\frac{dy}{du}\right|_{u=g(h(a))}\cdot\left.\frac{du}{dv}\right|_{v=h(a)}\cdot\left.\frac{dv}{dx}\right|_{x=a}, or for short, \frac{dy}{dx} = \frac{dy}{du}\cdot\frac{du}{dv}\cdot\frac{dv}{dx}. The derivative function is therefore: \frac{dy}{dx} = e^{\sin(x^2)}\cdot\cos(x^2)\cdot 2x. Another way of computing this derivative is to view the composite function as the composite of and h. Applying the chain rule in this manner would yield: \begin{align} (f \circ g \circ h)'(a) &= (f \circ g)'(h(a)) \cdot h'(a) \\ &= f'(g(h(a))) \cdot g'(h(a)) \cdot h'(a). \end{align} This is the same as what was computed above. This should be expected because . Sometimes, it is necessary to differentiate an arbitrarily long composition of the form f_1 \circ f_2 \circ \cdots \circ f_{n-1} \circ f_n\! . In this case, define f_{a\,.\,.\,b} = f_{a} \circ f_{a+1} \circ \cdots \circ f_{b-1} \circ f_{b} where f_{a\,.\,.\,a} = f_a and f_{a\,.\,.\,b}(x) = x when b . Then the chain rule takes the form \begin{align} Df_{1\,.\,.\,n} &= (Df_1 \circ f_{2\,.\,.\,n}) (Df_2 \circ f_{3\,.\,.\,n}) \cdots (Df_{n-1} \circ f_{n\,.\,.\,n}) Df_n \\ &= \prod_{k=1}^n \left[Df_k \circ f_{(k+1)\,.\,.\,n}\right] \end{align} or, in the Lagrange notation, \begin{align} f_{1\,.\,.\,n}'(x) &= f_1' \left( f_{2\,.\,.\,n}(x) \right) \; f_2' \left( f_{3\,.\,.\,n}(x) \right) \cdots f_{n-1}' \left(f_{n\,.\,.\,n}(x)\right) \; f_n'(x) \\[1ex] &= \prod_{k=1}^{n} f_k' \left(f_{(k+1\,.\,.\,n)}(x) \right) \end{align} \begin{align} \frac{d}{dx}\left(\frac{f(x)}{g(x)}\right) &= \frac{d}{dx}\left(f(x)\cdot\frac{1}{g(x)}\right) \\ &= f'(x)\cdot\frac{1}{g(x)} + f(x)\cdot\frac{d}{dx}\left(\frac{1}{g(x)}\right). \end{align} To compute the derivative of , notice that it is the composite of with the reciprocal function, that is, the function that sends to . The derivative of the reciprocal function is -1/x^2\! . By applying the chain rule, the last expression becomes: f'(x)\cdot\frac{1}{g(x)} + f(x)\cdot\left(-\frac{1}{g(x)^2}\cdot g'(x)\right) = \frac{f'(x) g(x) - f(x) g'(x)}{g(x)^2}, which is the usual formula for the quotient rule. f(g(x)) = x. And because the functions f(g(x)) and are equal, their derivatives must be equal. The derivative of is the constant function with value 1, and the derivative of f(g(x)) is determined by the chain rule. Therefore, we have that: f'(g(x)) g'(x) = 1. To express as a function of an independent variable , we substitute f(y) for wherever it appears. Then we can solve for . \begin{align} f'(g(f(y))) g'(f(y)) &= 1 \\ f'(y) g'(f(y)) &= 1 \\ f'(y) = \frac{1}{g'(f(y))}. \end{align} For example, consider the function . It has an inverse . Because , the above formula says that \frac{d}{dy}\ln y = \frac{1}{e^{\ln y}} = \frac{1}{y}. This formula is true whenever is differentiable and its inverse is also differentiable. This formula can fail when one of these conditions is not true. For example, consider . Its inverse is , which is not differentiable at zero. If we attempt to use the above formula to compute the derivative of at zero, then we must evaluate . Since and , we must evaluate 1/0, which is undefined. Therefore, the formula fails in this case. This is not surprising because is not differentiable at zero. \begin{align} \frac{dy}{dx} & = \frac{dy}{du} \frac{du}{dx} \\ \frac{d^2 y }{d x^2} & = \frac{d^2 y}{d u^2} \left(\frac{du}{dx}\right)^2 + \frac{dy}{du} \frac{d^2 u}{dx^2} \\ \frac{d^3 y }{d x^3} & = \frac{d^3 y}{d u^3} \left(\frac{du}{dx}\right)^3 + 3 \, \frac{d^2 y}{d u^2} \frac{du}{dx} \frac{d^2 u}{d x^2} + \frac{dy}{du} \frac{d^3 u}{d x^3} \\ \frac{d^4 y}{d x^4} & = \frac{d^4 y}{du^4} \left(\frac{du}{dx}\right)^4 + 6 \, \frac{d^3 y}{d u^3} \left(\frac{du}{dx}\right)^2 \frac{d^2 u}{d x^2} + \frac{d^2 y}{d u^2} \left( 4 \, \frac{du}{dx} \frac{d^3 u}{dx^3} + 3 \, \left(\frac{d^2 u}{dx^2}\right)^2\right) + \frac{dy}{du} \frac{d^4 u}{dx^4}. \end{align} (f \circ g)'(a) = \lim_{x \to a} \frac{f(g(x)) - f(g(a))}{x - a}. Assume for the moment that g(x)\! does not equal g(a) for any x near a . Then the previous expression is equal to the product of two factors: \lim_{x \to a} \frac{f(g(x)) - f(g(a))}{g(x) - g(a)} \cdot \frac{g(x) - g(a)}{x - a}. If g oscillates near , then it might happen that no matter how close one gets to , there is always an even closer such that . For example, this happens near for the continuous function defined by for and otherwise. Whenever this happens, the above expression is undefined because it involves division by zero. To work around this, introduce a function Q as follows: Q(y) = \begin{cases} \displaystyle\frac{f(y) - f(g(a))}{y - g(a)}, & y \neq g(a), \\ f'(g(a)), & y = g(a). \end{cases} We will show that the difference quotient for is always equal to: Q(g(x)) \cdot \frac{g(x) - g(a)}{x - a}. Whenever is not equal to , this is clear because the factors of cancel. When equals , then the difference quotient for is zero because equals , and the above product is zero because it equals times zero. So the above product is always equal to the difference quotient, and to show that the derivative of at exists and to determine its value, we need only show that the limit as goes to of the above product exists and determine its value. To do this, recall that the limit of a product exists if the limits of its factors exist. When this happens, the limit of the product of these two factors will equal the product of the limits of the factors. The two factors are and . The latter is the difference quotient for at , and because is differentiable at by assumption, its limit as tends to exists and equals . As for , notice that is defined wherever is. Furthermore, is differentiable at by assumption, so is continuous at , by definition of the derivative. The function is continuous at because it is differentiable at , and therefore is continuous at . So its limit as goes to exists and equals , which is . This shows that the limits of both factors exist and that they equal and , respectively. Therefore, the derivative of at a exists and equals . g(a + h) - g(a) = g'(a) h + \varepsilon(h) h. Here the left-hand side represents the true difference between the value of g at a and at , whereas the right-hand side represents the approximation determined by the derivative plus an error term. In the situation of the chain rule, such a function ε exists because g is assumed to be differentiable at a. Again by assumption, a similar function also exists for f at g(a). Calling this function η, we have f(g(a) + k) - f(g(a)) = f'(g(a)) k + \eta(k) k. The above definition imposes no constraints on η(0), even though it is assumed that η(k) tends to zero as k tends to zero. If we set , then η is continuous at 0. Proving the theorem requires studying the difference as h tends to zero. The first step is to substitute for using the definition of differentiability of g at a: f(g(a + h)) - f(g(a)) = f(g(a) + g'(a) h + \varepsilon(h) h) - f(g(a)). The next step is to use the definition of differentiability of f at g(a). This requires a term of the form for some k. In the above equation, the correct k varies with h. Set and the right hand side becomes . Applying the definition of the derivative gives: f(g(a) + k_h) - f(g(a)) = f'(g(a)) k_h + \eta(k_h) k_h. To study the behavior of this expression as h tends to zero, expand k h . After regrouping the terms, the right-hand side becomes: f'(g(a)) g'(a)h + [f'(g(a)) \varepsilon(h) + \eta(k_h) g'(a) + \eta(k_h) \varepsilon(h)] h. Because ε(h) and η(k h ) tend to zero as h tends to zero, the first two bracketed terms tend to zero as h tends to zero. Applying the same theorem on products of limits as in the first proof, the third bracketed term also tends zero. Because the above expression is equal to the difference , by the definition of the derivative is differentiable at a and its derivative is The role of Q in the first proof is played by η in this proof. They are related by the equation: Q(y) = f'(g(a)) + \eta(y - g(a)). The need to define Q at g(a) is analogous to the need to define η at zero. f(g(x))-f(g(a))=q(g(x))(g(x)-g(a)) and g(x)-g(a)=r(x)(x-a). Therefore, f(g(x))-f(g(a))=q(g(x))r(x)(x-a), but the function given by is continuous at , and we get, for this (f(g(a)))'=q(g(a))r(a)=f'(g(a))g'(a). A similar approach works for continuously differentiable (vector-)functions of many variables. This method of factoring also allows a unified approach to stronger forms of differentiability, when the derivative is required to be Lipschitz continuous, Hölder continuous, etc. Differentiation itself can be viewed as the polynomial remainder theorem (the little Bézout theorem, or factor theorem), generalized to an appropriate class of functions. f(g_1(x), \dots, g_k(x)), where f\colon \reals^k \to \reals , and g_i\colon\mathbb{R} \to \mathbb{R} for each i = 1, 2, \dots, k. As this case occurs often in the study of functions of a single variable, it is worth describing it separately.

Case of scalar-valued multivariate functions

Let f\colon\reals^k \to \reals , and g_i\colon\mathbb{R} \to \mathbb{R} for each i = 1, 2, \dots, k. To write the chain rule for the composition of functions x \mapsto f(g_1(x), \dots , g_k(x)), one needs the partial derivatives of with respect to its arguments. The usual notations for partial derivatives involve names for the arguments of the function. As these arguments are not named in the above formula, it is simpler and clearer to use D-Notation, and to denote by D_i f the partial derivative of with respect to its th argument, and by D_i f(z) the value of this derivative at . With this notation, the chain rule is \frac{d}{dx}f(g_1(x), \dots, g_k (x))=\sum_{i=1}^k D_i f(g_1(x), \dots, g_k (x)) \left(\frac{d}{dx}{g_i}(x)\right).

Example: arithmetic operations

If the function is addition, that is, if f(u,v)=u+v, then D_1 f = \frac{\partial f}{\partial u} = 1 and D_2 f = \frac{\partial f}{\partial v} = 1 . Thus, the chain rule gives \frac{d}{dx}(g(x)+h(x)) = \left( \frac{d}{dx}g(x) \right) D_1 f+\left( \frac{d}{dx}h(x)\right) D_2 f=\frac{d}{dx}g(x) +\frac{d}{dx}h(x). For multiplication f(u,v)=uv, the partials are D_1 f = v and D_2 f = u . Thus, \frac{d}{dx}(g(x)h(x)) = h(x) \frac{d}{dx} g(x) + g(x) \frac{d}{dx} h(x). The case of exponentiation f(u,v)=u^v is slightly more complicated, as D_1 f = vu^{v-1}, and, as u^v=e^{v\ln u}, D_2 f = u^v\ln u. It follows that \frac{d}{dx}\left(g(x)^{h(x)}\right) = h(x)g(x)^{h(x)-1} \frac{d}{dx}g(x) + g(x)^{h(x)} \ln g(x) \,\frac{d}{dx}h(x). D_{\mathbf{a}}(f \circ g) = D_{g(\mathbf{a})}f \circ D_{\mathbf{a}}g, or for short, D(f \circ g) = Df \circ Dg. The higher-dimensional chain rule can be proved using a technique similar to the second proof given above. Because the total derivative is a linear transformation, the functions appearing in the formula can be rewritten as matrices. The matrix corresponding to a total derivative is called a Jacobian matrix, and the composite of two derivatives corresponds to the product of their Jacobian matrices. From this perspective the chain rule therefore says: J_{f \circ g}(\mathbf{a}) = J_{f}(g(\mathbf{a})) J_{g}(\mathbf{a}), or for short, J_{f \circ g} = (J_f \circ g)J_g. That is, the Jacobian of a composite function is the product of the Jacobians of the composed functions (evaluated at the appropriate points). The higher-dimensional chain rule is a generalization of the one-dimensional chain rule. If , , and are 1, so that and , then the Jacobian matrices of and are . Specifically, they are: \begin{align} J_g(a) &= \begin{pmatrix} g'(a) \end{pmatrix}, \\ J_{f}(g(a)) &= \begin{pmatrix} f'(g(a)) \end{pmatrix}. \end{align} The Jacobian of is the product of these matrices, so it is , as expected from the one-dimensional chain rule. In the language of linear transformations, is the function which scales a vector by a factor of and is the function which scales a vector by a factor of . The chain rule says that the composite of these two linear transformations is the linear transformation , and therefore it is the function that scales a vector by . Another way of writing the chain rule is used when f and g are expressed in terms of their components as and . In this case, the above rule for Jacobian matrices is usually written as: \frac{\partial(y_1, \ldots, y_k)}{\partial(x_1, \ldots, x_n)} = \frac{\partial(y_1, \ldots, y_k)}{\partial(u_1, \ldots, u_m)} \frac{\partial(u_1, \ldots, u_m)}{\partial(x_1, \ldots, x_n)}. The chain rule for total derivatives implies a chain rule for partial derivatives. Recall that when the total derivative exists, the partial derivative in the -th coordinate direction is found by multiplying the Jacobian matrix by the -th basis vector. By doing this to the formula above, we find: \frac{\partial(y_1, \ldots, y_k)}{\partial x_i} = \frac{\partial(y_1, \ldots, y_k)}{\partial(u_1, \ldots, u_m)} \frac{\partial(u_1, \ldots, u_m)}{\partial x_i}. Since the entries of the Jacobian matrix are partial derivatives, we may simplify the above formula to get: \frac{\partial(y_1, \ldots, y_k)}{\partial x_i} = \sum_{\ell = 1}^m \frac{\partial(y_1, \ldots, y_k)}{\partial u_\ell} \frac{\partial u_\ell}{\partial x_i}. More conceptually, this rule expresses the fact that a change in the direction may change all of through , and any of these changes may affect . In the special case where , so that is a real-valued function, then this formula simplifies even further: \frac{\partial y}{\partial x_i} = \sum_{\ell = 1}^m \frac{\partial y}{\partial u_\ell} \frac{\partial u_\ell}{\partial x_i}. This can be rewritten as a dot product. Recalling that , the partial derivative is also a vector, and the chain rule says that: \frac{\partial y}{\partial x_i} = \nabla y \cdot \frac{\partial \mathbf{u}}{\partial x_i}. \frac{\partial u}{\partial r}=\frac{\partial u}{\partial x} \frac{\partial x}{\partial r}+\frac{\partial u}{\partial y} \frac{\partial y}{\partial r} = (2x)(\sin(t)) + (2)(0) = 2r \sin^2(t), and \begin{align} \frac{\partial u}{\partial t} &= \frac{\partial u}{\partial x} \frac{\partial x}{\partial t}+\frac{\partial u}{\partial y} \frac{\partial y}{\partial t} \\ &= (2x)(r\cos(t)) + (2)(2\sin(t)\cos(t)) \\ &= (2r\sin(t))(r\cos(t)) + 4\sin(t)\cos(t) \\ &= 2(r^2 + 2) \sin(t)\cos(t) \\ &= (r^2 + 2) \sin(2t). \end{align} \frac{\partial^2 y}{\partial x_i \partial x_j} = \sum_k \left(\frac{\partial y}{\partial u_k}\frac{\partial^2 u_k}{\partial x_i \partial x_j}\right) + \sum_{k, \ell} \left(\frac{\partial^2 y}{\partial u_k \partial u_\ell}\frac{\partial u_k}{\partial x_i}\frac{\partial u_\ell}{\partial x_j}\right).

See also

− a computational method that makes heavy use of the chain rule to compute exact numerical derivatives.

External links

Text derived from https://en.wikipedia.org/w/index.php?oldid=1376551040 under CC BY-SA 4.0; modifications have been made.

Sources cited in this revision

No external citation was extracted for this revision. That is a statement about the source, not a claim that none exists.