What is a Outcome Reward Model?
Outcome Reward Model
An Outcome Reward Model (ORM) is a feedback mechanism that scores only the final response generated by a model, without evaluating the correctness of intermediate reasoning steps. It is simpler to train but less granular than step-by-step reward models.
Why It Matters for AI Builders
Helps AI builders design and scale robust architectures; mastering the implementation of Outcome Reward Model improves latency, accuracy, and operational efficiency for basic classification, text summarization, and simple question-answering validation.
Detailed Deep Dive
Outcome Reward Models (ORMs) are feedback systems that score only the final correctness or quality of a model's complete response. While ORMs are easy to configure and require less annotation effort than process-based models, they provide less guidance during multi-step reasoning. Without step-level feedback, ORMs can inadvertently reward model outputs that reach correct conclusions through incorrect or hallucinated logical steps.
Frequently Asked Questions
Q:Why would you use an ORM instead of a PRM?
ORMs are much easier and cheaper to train because labeling only the final correctness of a response is faster than labeling every reasoning step.
Q:What is the risk of using only an ORM for reasoning models?
It can reward "logical alignment by coincidence" where a model arrives at the correct answer through flawed logic or guessing.
Quick Facts
- CategoryModel Training
- Key ApplicationBasic classification, text summarization, and simple question-answering validation
Coverage Trend12 Weeks
Related AI Terms
Cite This Term
Reference this definition in your articles, research, or documentation to credit this source:
Outcome Reward Model Media Coverage & Intelligence
No Direct Outcome Reward Model News Today
We currently have no direct coverage articles matching "Outcome Reward Model". Explore trending global AI topics below instead.
Trending AI Stories
How Scottish Water Made Its Capital Investment Data Conversational With Databricks Genie
Across Scottish Water's Capital Investment (CI) programme, teams need fast answers...
Databricks raises $5B more after annualized revenue tops $7B
Databricks Inc. today announced that it has raised $5 billion in funding at a $190 billion valuation. The round was led by Coatue, Blackstone, MGX, T. Rowe Price and Sixth Street Growth. The funds were joined by more than a half-dozen other backers, most of which are returning investors. The...
Databricks wanted to raise $1B, investors wanted $15B. It settled on $5B at a $190B valuation.
AI is expensive, Ali Ghodsi tells TechCrunch. With so many investors wanting into his latest round, he said yes to more than planned.
Google's Gemini 3.7 Flash targets coding and agents with a 50% introductory price cut
Google is rolling out Gemini 3.7 Flash , a new version of its workhorse AI model that puts coding, agentic workflows and knowledge work at the center of the...