Griewank function
≈ 4 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
In mathematics, the Griewank test function is a smooth multidimensional mathematical function used in unconstrained optimization. It is commonly employed to evaluate the performance of global optimization algorithms. The function is defined as : f(x) = 1 + \frac{1}{4000}\sum_{i=1}^n x_i^2 - \prod_{i=1}^n P_i(x_i), where x = (x_1,\dots,x_n) \in \R^n and P_i(x_i)=\cos(x_i/\sqrt{i}) . The non-linear and non-convex function is characterized by its unique multimodal structure, featuring multiple local minima and maxima around its single global minimum at x^\ast = 0 , where the function has minimal value f(x^\ast) = 0 . The number of stationary points increases as the dimensionality n grows. For instance, the one-dimensional Griewank function f(x_1) = 1+(1/4000)\cdot x_1^2-\cos(x_1) has 6365 critical points in the interval [-10000,10000] , where the first derivative vanishes. These points satisfy the equation : \nabla f(x_1) = \frac{1}{2000} \cdot x_1 + \sin(x_1) = 0 . The multimodal structure of the Griewank function presents a challenge for many deterministic optimization algorithms, which may become trapped in one of the numerous local minima. This is particularly problematic for gradient-based methods. The Griewank function is commonly used to benchmark global optimization algorithms, such as genetic algorithms or particle swarm optimization.…
In mathematics, the Griewank test function is a smooth multidimensional mathematical function used in unconstrained optimization. It is commonly employed to evaluate the performance of global optimization algorithms. The function is defined as f(x) = 1 + \frac{1}{4000}\sum_{i=1}^n x_i^2 - \prod_{i=1}^n P_i(x_i), where x = (x_1,\dots,x_n) \in \R^n and P_i(x_i)=\cos(x_i/\sqrt{i}) . The non-linear and non-convex function is characterized by its unique multimodal structure, featuring multiple local minima and maxima around its single global minimum at x^\ast = 0 , where the function has minimal value f(x^\ast) = 0 . The number of stationary points increases as the dimensionality n grows. For instance, the one-dimensional Griewank function f(x_1) = 1+(1/4000)\cdot x_1^2-\cos(x_1) has 6365 critical points in the interval [-10000,10000] , where the first derivative vanishes. These points satisfy the equation \nabla f(x_1) = \frac{1}{2000} \cdot x_1 + \sin(x_1) = 0 . The multimodal structure of the Griewank function presents a challenge for many deterministic optimization algorithms, which may become trapped in one of the numerous local minima. This is particularly problematic for gradient-based methods. The Griewank function is commonly used to benchmark global optimization algorithms, such as genetic algorithms or particle swarm optimization. In addition to the original version, there are several variants of the Griewank function specifically designed to test algorithms in high-dimensional optimization scenarios. f(x) = 1 + \frac{1}{4000} \sum_{i=1}^n x_i^2 - \prod_{i=1}^n P_i(x_i) \text{ with } P_i(x_i)=\left| \cos\left(\frac{x_i}{2\sqrt{i}}\right) \right| - \left| \sin\left(\frac{x_i}{2\sqrt{i}}\right) \right|. By incorporating non-smooth elements, such as absolute values in the cosine and sine terms, this function mimics the irregularities present in many ML loss landscapes. It offers a robust benchmark for evaluating optimization algorithms, especially those designed to handle the challenges of non-convex, non-smooth, or high-dimensional problems, including sub-gradient, hybrid, and evolutionary methods. The function's resemblance to practical ML objective functions makes it particularly valuable for testing the robustness and efficiency of algorithms in tasks such as hyperparameter tuning, neural network training, and constrained optimization.
References
Text derived from https://en.wikipedia.org/w/index.php?oldid=1378639420 under CC BY-SA 4.0; modifications have been made.