The ROI of AI: From Efficiency to Capacity
The panel distinguished between the immediate benefits of AI and its ultimate value.
At the moment, AI is delivering on efficiency, productivity, and capacity. Yet the most profound benefit is capacity—freeing up finance talent to do different work, transitioning them out of “building the data and analysis” and into developing insights.
However, this transition involves a profound risk, known as the pricing conundrum. If a business like Medidata uses AI to solve a customer’s problem, such as accelerating clinical trials, it runs the risk of commoditization and shrinking revenue if it doesn’t fundamentally change its pricing model and value metric to reflect the outcome achieved by AI, rather than the effort expended.
Strategic outcomes become an important component of measuring ROI of AI investments.
Schwartz noted that the goal at Medidata is to enable people to do “different work, not more work,” by using AI to allow teams to focus on higher-value activities. “Right now the reality is most of the AI that we see in our internal uses is capacity, efficiency, and productivity,” he added.
Schwartz's vision of empowering teams to focus on higher-value activities through AI manifests in several key areas, including:
Shifting the role of finance: The finance team’s job isn’t just to report the news, Schwartz said, but to “change the outcome before it happens.” In practice, Schreiber added, that means asking strategic questions like, “What should the margin profile for product X be?” rather than just pulling data.
Driving top-line growth: The ultimate ROI is tied to improving the business. This includes getting new products to market faster and, in Medidata’s case, allowing customers to run fewer, smarter clinical trials because AI helps them predict the outcome.
Schreiber also highlighted the current inadequacy of traditional metrics as a key challenge to measuring returns.
“Traditional KPIs or traditional metrics are very focused on cycle time, error rate, number of transactions, or invoices processed per FTE,” she said. “The problem right now is: The benchmarks don’t have enough use of AI in them to actually have a comparison.”
However, Schreiber noted, the focus is shifting toward measuring improvements in quality, accuracy, and the ability to grow revenue without a proportional increase in headcount.
“We’ll learn more as the technology continues to change, and those KPIs will change,” Schreiber said.