A scorecard for the AI age
OpenAI CFO Sarah Friar introduces a practical AI scorecard to measure return on investment through useful work, cost per successful task, dependability, and return on compute. The framework moves past traditional software adoption metrics and simple token costs to evaluate the full economic value of AI-completed tasks.
The Core Development
The question I hear from CFOs everywhere is simple: how do we get more value from our AI spend?
For years, the market measured the success of software through adoption: seats purchased, users active, licenses renewed. Understanding the value of AI demands a more powerful measure: work accomplished.
The basic economic question facing CFOs and other business leaders is whether the value of the work AI completes grows faster than the cost of producing it.
Real-World Use Cases & Applications
The best place to begin is with one workflow. Define what “done” means and measure that outcome in the system where the work happens.
AI tasks vary widely. A quick answer may require little compute. A coding, research, or financial workflow may involve deeper reasoning, tool use, and many actions. Those more complex tasks can require more compute, but they can create much more value.
These tiers provide useful starting points. The economics of the full task should ultimately determine the right model. A customer might use Luna for a fast, high-volume workflow, Terra for work requiring greater depth, or Sol when stronger reasoning delivers the best result with fewer attempts.
Deployment & Availability
For a support team, “done” might mean a customer issue resolved. For an engineering team, it might mean a code change that passes its tests. For a legal team, it might mean a contract reviewed accurately and on time.
Compute powers research and every task that AI completes. It shapes product quality, speed, dependability, availability, and cost. Training compute builds future capability. Inference compute delivers useful work today. Both should translate into better outcomes for customers.
Strategic Perspective & Ecosystem Impact
Answering that question requires looking more deeply than a metric such as cost per token. A lower-cost model may have cheaper tokens, but getting great results may require more attempts, more time, or more human review. A more capable model may have more expensive tokens, but complete the same task in one pass. What matters is the full cost of producing a successful outcome, measured against the value that outcome creates.
The ultimate scorecard for the age of AI could be looked at as “Useful Intelligence per Dollar.” This metric answers four key questions:
How many customer issues did AI help resolve? How many code changes did it help ship? How many contracts did it review? How much time did it give back to people? How many decisions improved because the right context was available at the right moment?
Why it matters
As businesses question their software spend, moving from traditional adoption metrics to a work-accomplished framework helps organizations measure the true economic value and dependability of artificial intelligence.