Complexity
≈ 5 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Complexity characterizes the behavior of a system or model whose components interact in multiple ways and follow local rules, leading to non-linearity, randomness, collective dynamics, hierarchy, and emergence. The term is generally used to characterize something with many parts where those parts interact with each other in multiple ways, culminating in a higher order of emergence greater than the sum of its parts. The study of these complex linkages at various scales is the main goal of complex systems theory.
The intuitive criterion of complexity can be formulated as follows: a system would be more complex if more parts could be distinguished, and if more connections between them existed. , a number of approaches to characterizing complexity have been used in science; Zayed et al. reflect many of these.
Neil Johnson states that "even among scientists, there is no unique definition of complexity – and the scientific notion has traditionally been conveyed using particular examples..." Ultimately Johnson adopts the definition of "complexity science" as "the study of the phenomena which emerge from a collection of interacting objects".
Complexity characterizes the behavior of a system or model whose components interact in multiple ways and follow local rules, leading to non-linearity, randomness, collective dynamics, hierarchy, and emergence. The term is generally used to characterize something with many parts where those parts interact with each other in multiple ways, culminating in a higher order of emergence greater than the sum of its parts. The study of these complex linkages at various scales is the main goal of complex systems theory.
The intuitive criterion of complexity can be formulated as follows: a system would be more complex if more parts could be distinguished, and if more connections between them existed. , a number of approaches to characterizing complexity have been used in science; Zayed et al. reflect many of these.
Neil Johnson states that "even among scientists, there is no unique definition of complexity – and the scientific notion has traditionally been conveyed using particular examples..." Ultimately Johnson adopts the definition of "complexity science" as "the study of the phenomena which emerge from a collection of interacting objects".
In binary number, Abstract Complexity Definition (ACD) formalizes complexity as the complexity of a binary structure, expressed by the formula: C = N² / n, where N is the number of detectable regularities (contrasts), and n is the number of basic elements (0 and 1). These regularities are identified with contrasts—tensions arising from interactions of common and differentiating features—and with structural information (as opposed to Shannon’s telecommunication information).
The formula incorporates two factors:• the N/n ratio, representing information compression/density, and the number of regularities N, introduced to account for the difficulty of compressing longer structures. This definition applies both analogically and directly wherever a system can be expressed in binary form, e.g., in music. Differences from classical structural complexity definitions: Traditional definitions focus on the number of elements and relations without specifying the nature of these relations.
In ACD, relations are explicitly defined as tensions (contrasts) resulting from interactions of common and differentiating features of system elements, with a defined dynamics. This makes the definition constructive and operational—allowing formal calculation of complexity.Intuitive criterion of complexity:Complexity is the number of distinguishable elements and the number of connections between them. In relation to contrast: differentiating features correspond to distinguishable elements, common features correspond to connections between those elements.
The more such features exist and the stronger their interactions, the greater the contrast, and thus the higher the complexity.
Other fields introduce less precisely defined notions of complexity: A complex adaptive system has some or all of the following attributes: The number of parts (and types of parts) in the system and the number of relations between the parts is non-trivial – however, there is no general rule to separate "trivial" from "non-trivial"; The system has memory or includes feedback; The system can adapt itself according to its history or feedback; The relations between the system and its environment are non-trivial or non-linear; The system can be influenced by, or can adapt itself to, its environment; The system is highly sensitive to initial conditions.
Peak complexity is the concept that human societies address problems by adding social and economic complexity, but that process is subject to diminishing marginal returns
Classification Problems
There has also been interest in measuring the complexity of classification problems in supervised machine learning. This can be useful in meta-learning to determine for which data sets filtering (or removing suspected noisy instances from the training set) is the most beneficial and could be expanded to other areas. For binary classification, such measures can consider the overlaps in feature values from differing classes, the separability of the classes, and measures of geometry, topology, and density of manifolds.
For non-binary classification problems, instance hardness is a bottom-up approach that first seeks to identify instances that are likely to be misclassified (assumed to be the most complex). The characteristics of such instances are then measured using supervised measures such as the number of disagreeing neighbors or the likelihood of the assigned class label given the input features.
Text derived from https://en.wikipedia.org/w/index.php?oldid=1378382268 under CC BY-SA 4.0; modifications have been made.