Subderivative
≈ 4 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In mathematics, the subderivative (or subgradient) generalizes the derivative to convex functions which are not necessarily differentiable. The set of subderivatives at a point is called the subdifferential at that point. Subderivatives arise in convex analysis, the study of convex functions, often in connection to convex optimization. Let f:I \to \mathbb{R} be a real-valued convex function defined on an open interval of the real line. Such a function need not be differentiable at all points: For example, the absolute value function f(x)=|x| is non-differentiable when x=0 . However, as seen in the graph on the right (where f(x) in blue has non-differentiable kinks similar to the absolute value function), for any x_0 in the domain of the function one can draw a line which goes through the point (x_0,f(x_0)) and which is everywhere either touching or below the graph of f. The slope of such a line is called a subderivative.
In mathematics, the subderivative (or subgradient) generalizes the derivative to convex functions which are not necessarily differentiable. The set of subderivatives at a point is called the subdifferential at that point. Subderivatives arise in convex analysis, the study of convex functions, often in connection to convex optimization. Let f:I \to \mathbb{R} be a real-valued convex function defined on an open interval of the real line. Such a function need not be differentiable at all points: For example, the absolute value function f(x)=|x| is non-differentiable when x=0 . However, as seen in the graph on the right (where f(x) in blue has non-differentiable kinks similar to the absolute value function), for any x_0 in the domain of the function one can draw a line which goes through the point (x_0,f(x_0)) and which is everywhere either touching or below the graph of f. The slope of such a line is called a subderivative. Rigorously, a subderivative of a convex function f:I \to \mathbb{R} at a point x_0 in the open interval I is a real number c such that f(x)-f(x_0)\ge c(x-x_0) for all x\in I . By the converse of the mean value theorem, the set of subderivatives at x_0 for a convex function is a nonempty closed interval [a,b] , where a and b are the one-sided limits a=\lim_{x\to x_0^-} \frac{f(x)-f(x_0)}{x-x_0}, b=\lim_{x\to x_0^+} \frac{f(x)-f(x_0)}{x-x_0}. The interval [a,b] of all subderivatives is called the subdifferential of the function f at x_0 , denoted by \partial f(x_0) . If f is convex, then its subdifferential at any point is non-empty. Moreover, if its subdifferential at x_0 contains exactly one subderivative, then f is differentiable at x_0 and \partial f(x_0)=\{f'(x_0)\} . Consider the function f(x)=|x| which is convex. Then, the subdifferential at the origin is the interval [-1,1] . The subdifferential at any point x_0 is the singleton set \{-1\} , while the subdifferential at any point x_0>0 is the singleton set \{1\} . This is similar to the sign function, but is not single-valued at 0 , instead including all possible subderivatives. More generally, if f(x)=\|x\| is a norm on a normed space X , then for x\neq 0 , \partial f(x)=\{x^*\in X^*: \langle x^*,x\rangle=\|x\|,\ \|x^*\|_*=1\}, while \partial f(0)=\{x^*\in X^*: \|x^*\|_*\leq 1\}. If f and g are convex functions with subdifferentials \partial f(x) and \partial g(x) with x being the interior point of one of the functions, then the subdifferential of f + g is \partial(f + g)(x) = \partial f(x) + \partial g(x) (where the addition operator denotes the Minkowski sum). This reads as "the subdifferential of a sum is the sum of the subdifferentials." f(x)+f^*(x^*)=\langle x^*,x\rangle. Equivalently, \partial f(x)=\{x^*\in X^*: \langle x^*,x\rangle-f(x)=f^*(x^*)\}. Geometrically, this says that the affine function z\mapsto \langle x^*,z\rangle-f^*(x^*) supports f from below at x .
Text derived from https://en.wikipedia.org/w/index.php?oldid=1353624604 under CC BY-SA 4.0; modifications have been made.