Scale AI
≈ 3 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
Scale AI, Inc. is an American artificial intelligence infrastructure and software company based in San Francisco, California. Originally focused on data annotation, the company also offers RLHF services, large language model (LLM) evaluation, and enterprise software suites to build and deploy AI applications. The company’s research arm, the Safety, Evaluation and Alignment Lab, focuses on evaluating and aligning LLMs. It also co-created the benchmark Humanity's Last Exam. Scale AI outsources data labeling through its subsidiaries, Remotasks, which focuses on computer vision and autonomous vehicles, and Outlier, which focuses on annotating data for LLMs. Scale AI operates an LLM Red Team that conducts human adversarial testing to identify vulnerabilities, biases, and safety risks in AI models. The team has worked with OpenAI, Google DeepMind and national AI Safety Institutes to evaluate systems against complex threats, including cybersecurity vulnerabilities, jailbreaks, and agentic AI behaviors. Scale AI's customers in the commercial sector have included Google, Microsoft, Meta, General Motors, OpenAI, and Time. The company also directly works with world governments, including the United States on military-related projects, and with Qatar to improve the efficiency of its social programs.…
Scale AI, Inc. is an American artificial intelligence infrastructure and software company based in San Francisco, California. Originally focused on data annotation, the company also offers RLHF services, large language model (LLM) evaluation, and enterprise software suites to build and deploy AI applications. The company’s research arm, the Safety, Evaluation and Alignment Lab, focuses on evaluating and aligning LLMs. It also co-created the benchmark Humanity's Last Exam. Scale AI outsources data labeling through its subsidiaries, Remotasks, which focuses on computer vision and autonomous vehicles, and Outlier, which focuses on annotating data for LLMs. Scale AI operates an LLM Red Team that conducts human adversarial testing to identify vulnerabilities, biases, and safety risks in AI models. The team has worked with OpenAI, Google DeepMind and national AI Safety Institutes to evaluate systems against complex threats, including cybersecurity vulnerabilities, jailbreaks, and agentic AI behaviors. Scale AI's customers in the commercial sector have included Google, Microsoft, Meta, General Motors, OpenAI, and Time. The company also directly works with world governments, including the United States on military-related projects, and with Qatar to improve the efficiency of its social programs. In June 2025, Meta Platforms spent more than $14 billion to acquire a 49% non-voting stake in Scale AI. CEO Alexandr Wang left Scale AI to join Meta and was replaced by Jason Droege.
Outlier
Outlier is a separate contributor platform operated by Scale AI, designed for generative AI data work, particularly in the development and fine-tuning of LLMs. Contributors on Outlier typically include professionals with advanced degrees, industry expertise, and native fluency in various languages. Outlier tasks involve content evaluation and reinforcement learning from human feedback (RLHF).
References
Text derived from https://en.wikipedia.org/w/index.php?oldid=1378164690 under CC BY-SA 4.0; modifications have been made.