Noisy text

Uses your system voice; voice and rate in settings.

Snapshot

≈ 3 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

Noisy text is text with differences between the surface form of a coded representation of the text and the intended, correct, or original text. The noise may be due to typographic errors or colloquialisms always present in natural language and usually lowers the data quality in a way that makes the text less accessible to automated processing by computers, including natural language processing. The noise may also have been introduced through an extraction process (e.g., transcription or OCR) from media other than original electronic texts. Language usage over computer mediated discourses, like chats, emails and SMS texts, significantly differs from the standard form of the language. An urge towards shorter message length facilitating faster typing and the need for semantic clarity, shape the structure of this text used in such discourses. Various business analysts estimate that unstructured data constitutes around 80% of the whole enterprise data. A great proportion of this data comprises chat transcripts, emails and other informal and semi-formal internal and external communications. Usually such text is meant for human consumption, but—given the amount of data—manual processing and evaluation of those resources is not practically feasible anymore. This raises the need for robust text mining methods.

Noisy text is text with differences between the surface form of a coded representation of the text and the intended, correct, or original text. The noise may be due to typographic errors or colloquialisms always present in natural language and usually lowers the data quality in a way that makes the text less accessible to automated processing by computers, including natural language processing. The noise may also have been introduced through an extraction process (e.g., transcription or OCR) from media other than original electronic texts. Language usage over computer mediated discourses, like chats, emails and SMS texts, significantly differs from the standard form of the language. An urge towards shorter message length facilitating faster typing and the need for semantic clarity, shape the structure of this text used in such discourses. Various business analysts estimate that unstructured data constitutes around 80% of the whole enterprise data. A great proportion of this data comprises chat transcripts, emails and other informal and semi-formal internal and external communications. Usually such text is meant for human consumption, but—given the amount of data—manual processing and evaluation of those resources is not practically feasible anymore. This raises the need for robust text mining methods.

Techniques for noise reduction

The use of spell checkers and grammar checkers can reduce the amount of noise in typed text. Many word processors include this in the editing tool. Online, Google Search includes a search term suggestion engine to guide users when they make mistakes with their queries.

See also

Data corruption Jargon Leet speak Natural language understanding Noisy channel

References

Text derived from https://en.wikipedia.org/w/index.php?oldid=1313374289 under CC BY-SA 4.0; modifications have been made.

Provenance

snapshot enwiki-001313374289 · captured 1758828572.0 · version history

Cite this page as: encyclopegia.org, “Noisy text”, snapshot enwiki-001313374289. https://encyclopegia.org/a/noisy-text

Sources cited in this revision

2 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.