Ethical regulator theorem
Mick Ashby's ethical regulator theorem builds upon the Conant-Ashby good regulator theorem, which is ambiguous because being good at regulating does not imply being good ethically.
≈ 2 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Mick Ashby's ethical regulator theorem builds upon the Conant-Ashby good regulator theorem, which is ambiguous because being good at regulating does not imply being good ethically.
Theorem
The ethical regulator theorem claims that the following nine requisites are necessary and sufficient for a cybernetic regulator to be both effective and ethical: Purpose expressed as unambiguously prioritized goals. Truth about the past and present. Variety of possible actions.
Predictability of the future effects of actions. Intelligence to choose the best actions. Influence on the regulated system.
Ethics expressed as unambiguously prioritized rules. Integrity of all subsystems. Transparency of ethical behavior.
Of these requisites, only the first six are necessary for a regulator to be effective. The three requisites of ethics, integrity, and transparency are optional if a system only needs to be effective. This gives rise to the Law of Inevitable Ethical Inadequacy, which states "If you do not specify that you require a secure ethical system, what you get is an insecure unethical system."
The reason is that unless ethical adequacy is a requirement, a system design will tend to optimize for effectiveness, and therefore maximally ignore the optional ethical, integrity, and transparency dimensions, which inevitably results in a design and subsequent implementation that is ethically inadequate and vulnerable to manipulation.
Effectiveness of a regulator
The ethical regulator theorem shows that the effectiveness of a cybernetic regulator depends on seven requisites. The effectiveness of a regulator, R, can be expressed as the function: Effectiveness R = Purpose R x Truth R x (Variety R - Ethics R ) x Predictability R x Intelligence R x Influence R If two systems, A and B, are competing for control of a third system, C, and Effectiveness A "is greater than Effectiveness B , then A is more likely than B to win control of C". The effectiveness function reflects how the variety of actions that are available to an ethical regulator is reduced by all actions that are considered unethical, which puts an ethical regulator at a disadvantage when competing against an unethical competitor.
Text derived from https://en.wikipedia.org/w/index.php?oldid=1268749540 under CC BY-SA 4.0; modifications have been made.