DisCoCat
DisCoCat (Categorical Compositional Distributional) is a mathematical framework for natural language processing which uses category theory to unify distributional semantics with the principle of compositionality.
≈ 2 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
DisCoCat (Categorical Compositional Distributional) is a mathematical framework for natural language processing which uses category theory to unify distributional semantics with the principle of compositionality. The grammatical derivations in a categorial grammar (usually a pregroup grammar) are interpreted as linear maps acting on the tensor product of word vectors to produce the meaning of a sentence or a piece of text.
String diagrams are used to visualise information flow and reason about natural language semantics. With this definition of pregroup grammars as free rigid categories, DisCoCat models can be defined as strong monoidal functors F : \mathbf{G} \to \mathbf{FinVect} .
Spelling things out in detail, they assign a finite dimensional vector space F(x) to each basic type x and a vector F(w) \in F(t) = F(t_1) \otimes \dots \otimes F(t_n) in the appropriate tensor product space to each dictionary entry w \to t where t = t_1 \dots t_n (objects for words are sent to the monoidal unit, i.e. F(w) = 1 ). The meaning of a sentence f: w_1 \dots w_n \to s is then given by a vector F(f) \in F(s) which can be computed as the contraction of a tensor network.
The reason behind the choice of \mathbf{FinVect} as the category of semantics is that vector spaces are the usual setting of distributional reading in computational linguistics and natural language processing. The underlying idea of distributional hypothesis "A word is characterized by the company it keeps" is particularly relevant when assigning meaning to words like adjectives or verbs, whose semantic connotation is strongly dependent on context.
Text derived from https://en.wikipedia.org/w/index.php?oldid=1309488793 under CC BY-SA 4.0; modifications have been made.