Skip to content

97% Deploy AI Agents. 29% See ROI. The Evaluation Step Everyone Skips.

A 2,400-person survey shows a 68-point gap between AI agent deployment and returns. Five questions separate the 29% seeing ROI from everyone else.

· 7 min read

Nearly every company in America has deployed AI agents. Ask the executives what those agents actually do, and three-quarters of them will tell you, off the record, that the whole thing is mostly for show. 1 Source 1 Writer 2026 AI Adoption in the Enterprise Survey, 2,400 respondents (1,200 C-suite + 1,200 employees), conducted with Workplace Intelligence. April 2026.

That’s the headline finding from Writer’s 2026 AI Adoption survey: 97% of executives say their company deployed AI agents in the past year. Only 29% report seeing significant ROI. And 75% admit their AI strategy exists more as a signal to boards and investors than as actual internal guidance.

A 68-point gap between deployment and returns. At $1M+ annual AI spend for 59% of these companies, that’s not a rounding error. It’s a capital allocation failure at scale. 2 Source 2 Same survey: 59% investing $1M+ annually. 79% face adoption challenges, a double-digit increase from 2025.

The question is why. And the answer, once you look at it structurally, is straightforward.

Why are most AI agent deployments failing to deliver ROI?

Not because the AI is bad, and not because employees need more training.

Companies skipped the evaluation step entirely. They never tested whether their vendor’s AI could do anything beyond the demo.

When your CRM vendor announces an AI upgrade, the default move is to turn it on. Maybe run a pilot. Assign a task force. Then report to the board that you’ve “deployed AI agents.” Check the box, collect the press coverage, move on.

48% of C-suite executives call AI adoption a “massive disappointment” (Writer, 2026). The number makes more sense when you realize what they actually bought. They bought a feature announcement, not a capability. The AI their vendor shipped sits inside a platform designed before AI existed, constrained by the same data silos and rigid workflows that constrained everything else. It can see a narrow slice of your data. It can’t modify real processes or operate across the other systems in your stack.

Over 40% of agentic AI projects will fail by 2027, and the root cause isn’t the AI. It’s legacy architecture: systems built without modern APIs or modular design (Deloitte, 2026). 3 Source 3 Deloitte 2026 Tech Trends, drawing on Gartner data. Bolt new capabilities onto old foundations and you get a demo that works in the sales pitch and stalls the moment it touches production data.

48% of C-suite executives call AI adoption a “massive disappointment.” They didn’t buy bad AI. They bought a feature announcement.

This is the pattern we watched play out across 2,000+ engagements over 16 years inside the SaaS ecosystem. A vendor ships a feature, customers adopt it because it’s included, nobody evaluates whether the underlying architecture can support it, and two years later the same customers are paying more for capabilities they never actually received.

The AI version of this pattern is just more expensive and more visible.

The 29% who see returns did one thing differently

The Writer survey contains a buried signal that explains the gap.

Companies seeing real ROI didn’t just deploy AI and measure results. They picked specific use cases, assigned executive owners, and tracked KPIs against benchmarks before turning anything on. Not after. Super-users (roughly 40% of non-technical employees in marketing, sales, and support) save 4.5 times more time than their peers. 87% of leaders confirm these super-users are at least five times more productive. 4 Source 4 Writer 2026 CMO analysis. 11% of super-users built their own AI agents and workflows without waiting for IT.

What separates the 29% isn’t enthusiasm or budget. It’s that they asked what the AI could actually access before writing the check. The 71% who report disappointment took the vendor’s word for it.

Eleven percent of super-users went further and built their own AI agents and workflows. They didn’t wait for their vendor to ship a feature. They built what they needed using tools that could touch their actual data. That 11% is the sharp end of the evaluation instinct: if your vendor’s AI can’t do the job, build one that can.

How do you evaluate whether your vendor’s AI is real?

There’s a gap in the market between McKinsey-level abstractions and LinkedIn hot takes. No practical framework exists for a mid-market executive to walk into a vendor meeting and distinguish between AI that builds organizational capability and AI that’s a retention gimmick dressed in a feature flag.

These five questions fill that gap. They extend the lock-in diagnostic into AI-specific evaluation. You can ask them in a two-minute vendor call.

1. Does the AI access your actual data layer?

Not a walled-off copy. Not a curated sample the vendor assembled for the demo. Your production data, in real time. If the answer is “we sync a subset,” the AI is operating on a fraction of what it needs to be useful.

2. Can it modify workflows, not just observe them?

Most vendor AI can tell you things. It can summarize a deal pipeline or surface a recommendation. Very little of it can change how work gets done: reroute a lead based on behavior, adjust pricing rules based on conversion patterns. If the AI is read-only, you’re paying for a dashboard with a chatbot attached.

3. Is it priced per value delivered, not per seat?

When AI is bundled into your existing per-seat licensing, the vendor has no incentive to make it work. They already have your money. Per-value pricing means the vendor only gets paid when the AI produces results. Look at your last invoice: is there a line item for AI, or is it “included”?

4. Does it work across your systems or only inside the vendor’s product?

Your customer journey doesn’t live inside one platform. If the AI can only operate within your CRM, or only within your CMS, it can only optimize a fragment of the picture. Cross-system capability is the difference between AI that handles a task and AI that handles a process.

5. Can you replace the AI component without rebuilding everything?

This is the portability test. If swapping out the AI layer means rebuilding your entire workflow, you haven’t adopted AI. You’ve deepened your vendor dependency. The AI should be a layer you can upgrade, replace, or remove without taking the rest of your infrastructure with it.

Three or more “no” answers, and you’re looking at bolt-on AI: a capability that exists on the feature comparison chart but not in your operations. The architectural constraints that create vendor lock-in are the same constraints that prevent vendor AI from working. The Five Locks that keep you trapped also keep the AI caged.

The evaluation step vendors skip on purpose

54% of C-suite executives say AI adoption is “tearing their company apart.” 39% lack any formal plan to drive revenue from AI tools. These aren’t symptoms of a technology problem. They’re symptoms of an evaluation problem that compounds the longer you ignore it.

Your vendor doesn’t want you to ask these five questions because the honest answers reveal what their AI can’t do. And in most cases, it can’t do much. The platform was built in an era when the data layer was designed for reporting, not for AI to act on.

The 29% understood this. They evaluated architecture before writing checks. Some of them replaced their SaaS tools entirely when the evaluation revealed the foundation couldn’t support what they needed. 35% of enterprises have already replaced at least one SaaS tool with custom-built software (Retool, 2026). 5 Source 5 Retool 2026 Build vs. Buy Report, 817 respondents. That number will climb as more companies run the evaluation and discover what the 71% discovered too late: you can’t get AI ROI from architecture that was never designed for it.

Bring these five questions to your next vendor meeting. The answers will tell you more about your AI investment than any quarterly business review ever has.

Notes & Sources

1Source: Writer 2026 AI Adoption in the Enterprise Survey, conducted with Workplace Intelligence. 2,400 respondents (1,200 C-suite executives + 1,200 non-technical employees). Published April 7, 2026.
2Source: Writer 2026 Survey: 59% of companies investing $1M+ annually in AI. 79% face adoption challenges, a double-digit increase from 2025.
3Source: Deloitte 2026 Tech Trends, drawing on Gartner data: Over 40% of agentic AI projects expected to fail by 2027 due to legacy enterprise systems.
4Source: Writer 2026 Survey, CMO analysis by Diego Lomanto (April 14, 2026): 87% of leaders confirm super-users are at least 5X more productive. 11% of super-users built their own AI agents.
5Source: Retool 2026 Build vs. Buy Report: 35% of enterprises (817 respondents) have replaced at least one SaaS tool with custom-built software.

Frequently asked questions

Most AI agent deployments fail to deliver ROI because companies accepted vendor feature announcements as proof of capability without evaluating the underlying architecture. A 2026 Writer survey of 2,400 executives found that 97% deployed AI agents but only 29% see significant returns. The root cause, according to Deloitte, is that over 40% of agentic AI projects are layered onto legacy systems lacking modern APIs and modular architecture, guaranteeing they'll fail by 2027.
Ask five questions: Does the AI access your actual data layer or a walled-off copy? Can it modify workflows or only observe them? Is it priced per value delivered or per seat? Does it work across your systems or only inside the vendor's product? Can you replace the AI component without rebuilding everything? If the answer to most of these is no, you're paying for a feature flag, not a capability.
Bolt-on AI layers machine learning features onto platforms designed before AI existed, constraining what the AI can access, modify, and integrate with. AI-native architecture builds the AI into the data and workflow layer from the ground up, giving it direct access to your information and the ability to modify real processes. Deloitte projects over 40% of bolt-on agentic AI projects will fail by 2027 due to these legacy architecture constraints.

Stay Informed

New insights, delivered.

Strategic analysis and insider perspective on the shift from legacy SaaS to AI-native infrastructure.

Not sure if your vendor's AI is real or a retention gimmick?

Get an Honest Assessment of Your Stack

Our free AI assessment scans your current site and infrastructure, then shows you where your vendor's AI claims hold up and where they don't.