Action model learning

Uses your system voice; voice and rate in settings.

Snapshot

≈ 3 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

Action model learning (sometimes abbreviated action learning) is an area of machine learning concerned with the creation and modification of a software agent's knowledge about the effects and preconditions of the actions that can be executed within its environment. This knowledge is usually represented in a logic-based action description language and used as input for automated planners. Learning action models is important when goals change. When an agent acted for a while, it can use its accumulated knowledge about actions in the domain to make better decisions. Thus, learning action models differs from reinforcement learning. It enables reasoning about actions instead of expensive trials in the world. Action model learning is a form of inductive reasoning, where new knowledge is generated based on the agent's observations. The usual motivation for action model learning is the fact that manual specification of action models for planners is often a difficult, time-consuming, and error-prone task (especially in complex environments).

Action model learning (sometimes abbreviated action learning) is an area of machine learning concerned with the creation and modification of a software agent's knowledge about the effects and preconditions of the actions that can be executed within its environment. This knowledge is usually represented in a logic-based action description language and used as input for automated planners. Learning action models is important when goals change. When an agent acted for a while, it can use its accumulated knowledge about actions in the domain to make better decisions. Thus, learning action models differs from reinforcement learning. It enables reasoning about actions instead of expensive trials in the world. Action model learning is a form of inductive reasoning, where new knowledge is generated based on the agent's observations. The usual motivation for action model learning is the fact that manual specification of action models for planners is often a difficult, time-consuming, and error-prone task (especially in complex environments). Given a training set E consisting of examples e = (s,a,s') , where s,s' are observations of a world state from two consecutive time steps t, t' and a is an action instance observed in time step t , the goal of action model learning in general is to construct an action model \langle D,P \rangle , where D is a description of domain dynamics in action description formalism like STRIPS, ADL or PDDL and P is a probability function defined over the elements of D . However, many state of the art action learning methods assume determinism and do not induce P . In addition to determinism, individual methods differ in how they deal with other attributes of domain (e.g. partial observability or sensoric noise).

See also

Machine learning Automated planning and scheduling Action language PDDL Architecture description language Inductive reasoning Computational logic Knowledge representation

Text derived from https://en.wikipedia.org/w/index.php?oldid=1377202734 under CC BY-SA 4.0; modifications have been made.

Provenance

snapshot enwiki-001377202734 · captured 1790575033.0 · version history

Cite this page as: encyclopegia.org, “Action model learning”, snapshot enwiki-001377202734. https://encyclopegia.org/a/action-model-learning

Sources cited in this revision

7 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.