FastText
fastText is an open-source library developed by Facebook AI Research (FAIR) for learning word representations and performing text classification.
≈ 5 min read
FastText. encyclopegia.org, snapshot enwiki-001373667698. /a/fasttext
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
fastText is an open-source library developed by Facebook AI Research (FAIR) for learning word representations and performing text classification. It was publicly released in 2016.[3]
For word representation, fastText incorporates subword information using character n-grams, which enables it to construct representations for words not encountered during training.[4] The library also provides supervised methods designed for efficient text classification.[5]
The GitHub repository was archived on March 19, 2024.
Word representations
edit edit sourcefastText builds on the skip-gram model used in word2vec, but also takes the internal structure of words into account. Instead of learning a representation for each word only as a whole, it represents words using character n-grams. Words that share character sequences can therefore share some of the same learned information.[6]
This use of subword information is particularly useful for rare words and languages with complex word formation, and also allows fastText to construct representations for words that were not seen during training.[6] Facebook AI Research later released pretrained fastText vectors for many languages, including a collection for 157 languages trained on Common Crawl and Wikipedia.[7]
Text classification
edit edit sourcefastText can also be used for supervised text classification. It combines information from the words and word n-grams in a text to predict a class label. The method was designed to be computationally efficient and, in its original evaluation, achieved accuracy comparable to several contemporary deep-learning models while training and making predictions much faster.[8]
See also
edit edit source- Word2vec
- GloVe
- Neural network (machine learning)
- Natural language processing
- Comparison of machine learning software
References
edit edit source- ^ Mannes, John. "Facebook's fastText library is now optimized for mobile". TechCrunch. Retrieved 12 January 2018. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ Onur Çelebi (2020-04-28). "facebookresearch/fastText/releases/tag/v0.9.2". Facebook. Retrieved 2020-11-21. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ "Releasing fastText". fastText. 18 August 2016. Retrieved 16 August 2026. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ Bojanowski, Piotr; Grave, Edouard; Joulin, Armand; Mikolov, Tomas (2017). "Enriching Word Vectors with Subword Information". Transactions of the Association for Computational Linguistics. 5: 135–146. doi:10.1162/tacl_a_00051. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ Joulin, Armand; Grave, Edouard; Bojanowski, Piotr; Mikolov, Tomas (2017). "Bag of Tricks for Efficient Text Classification". Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. Association for Computational Linguistics. pp. 427–431. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ a b Bojanowski, Piotr; Grave, Edouard; Joulin, Armand; Mikolov, Tomas (2017). "Enriching Word Vectors with Subword Information". Transactions of the Association for Computational Linguistics. 5: 135–146. doi:10.1162/tacl_a_00051. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ Grave, Edouard; Bojanowski, Piotr; Gupta, Prakhar; Joulin, Armand; Mikolov, Tomas (2018). "Learning Word Vectors for 157 Languages". Proceedings of the Eleventh International Conference on Language Resources and Evaluation (LREC 2018). European Language Resources Association. Wikipedia revision 1373667698, retrieved 2026-11-18
- ^ Joulin, Armand; Grave, Edouard; Bojanowski, Piotr; Mikolov, Tomas (2017). "Bag of Tricks for Efficient Text Classification". Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 2, Short Papers. Association for Computational Linguistics. pp. 427–431. Wikipedia revision 1373667698, retrieved 2026-11-18
External links
edit edit source- fastText
- "FastText - Facebook Research Downloads". Archived from the original on 2020-11-03.
- Argument mining
- Collocation extraction
- Concept mining
- Coreference resolution
- Deep linguistic processing
- Distant reading
- Information extraction
- Knowledge extraction
- Logic translation
- Named-entity recognition
- Ontology learning
- Parsing
- Part-of-speech tagging
- Semantic analysis
- Semantic role labeling
- Semantic decomposition
- Semantic similarity
- Sentiment analysis
- Stance detection
- Stylometry
- Terminology extraction
- Text mining
- Textual entailment
- Truecasing
- Word-sense disambiguation
- Word-sense induction
datasets and corpora
and data capture
reviewing
user interface
Text derived from https://en.wikipedia.org/w/index.php?oldid=1373667698 under CC BY-SA 4.0; modifications have been made.
References
- ↩Wikipedia “FastText” release date (×1) · confidence 0.95 revision URL