Scale AI

Uses your system voice; voice and rate in settings.

Snapshot

≈ 3 min read

Names in other languages

No names in other languages are held for this entry yet.

Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.

Scale AI, Inc. is an American artificial intelligence infrastructure and software company based in San Francisco, California. Originally focused on data annotation, the company also offers RLHF services, large language model (LLM) evaluation, and enterprise software suites to build and deploy AI applications. The company’s research arm, the Safety, Evaluation and Alignment Lab, focuses on evaluating and aligning LLMs. It also co-created the benchmark Humanity's Last Exam. Scale AI outsources data labeling through its subsidiaries, Remotasks, which focuses on computer vision and autonomous vehicles, and Outlier, which focuses on annotating data for LLMs. Scale AI operates an LLM Red Team that conducts human adversarial testing to identify vulnerabilities, biases, and safety risks in AI models. The team has worked with OpenAI, Google DeepMind and national AI Safety Institutes to evaluate systems against complex threats, including cybersecurity vulnerabilities, jailbreaks, and agentic AI behaviors. Scale AI's customers in the commercial sector have included Google, Microsoft, Meta, General Motors, OpenAI, and Time. The company also directly works with world governments, including the United States on military-related projects, and with Qatar to improve the efficiency of its social programs.…

Scale AI, Inc. is an American artificial intelligence infrastructure and software company based in San Francisco, California. Originally focused on data annotation, the company also offers RLHF services, large language model (LLM) evaluation, and enterprise software suites to build and deploy AI applications. The company’s research arm, the Safety, Evaluation and Alignment Lab, focuses on evaluating and aligning LLMs. It also co-created the benchmark Humanity's Last Exam. Scale AI outsources data labeling through its subsidiaries, Remotasks, which focuses on computer vision and autonomous vehicles, and Outlier, which focuses on annotating data for LLMs. Scale AI operates an LLM Red Team that conducts human adversarial testing to identify vulnerabilities, biases, and safety risks in AI models. The team has worked with OpenAI, Google DeepMind and national AI Safety Institutes to evaluate systems against complex threats, including cybersecurity vulnerabilities, jailbreaks, and agentic AI behaviors. Scale AI's customers in the commercial sector have included Google, Microsoft, Meta, General Motors, OpenAI, and Time. The company also directly works with world governments, including the United States on military-related projects, and with Qatar to improve the efficiency of its social programs. In June 2025, Meta Platforms spent more than $14 billion to acquire a 49% non-voting stake in Scale AI. CEO Alexandr Wang left Scale AI to join Meta and was replaced by Jason Droege.

Outlier

Outlier is a separate contributor platform operated by Scale AI, designed for generative AI data work, particularly in the development and fine-tuning of LLMs. Contributors on Outlier typically include professionals with advanced degrees, industry expertise, and native fluency in various languages. Outlier tasks involve content evaluation and reinforcement learning from human feedback (RLHF).

References

Text derived from https://en.wikipedia.org/w/index.php?oldid=1378164690 under CC BY-SA 4.0; modifications have been made.

Sources cited in this revision

25 named source(s) extracted from the cited revision. A source with no author is shown by its publication; nothing is invented.