Your AI Multiplier Is Dying in the Silo

Hoard it — that’s the simple mandate that chief data officers lived by for decades. Build a bigger digital basement. Build a “lake” out of the petabytes of transaction logs, customer emails, and sensor pings and hope a monster of insight eventually crawls out of the brackish water.

But the lake is now stagnant. In the age of generative AI, the old strategy of “collect now, figure it out later” has hit a wall of pure physics and brutal economics.

“When I speak with executive leaders, the disconnect isn’t about belief in data — it’s about operational readiness,” says Chip Schenck, IBM’s principal for Generative AI and data strategy.

Schenck, a man who navigates the friction between silicon dreams and boardroom reality, points to a jarring “value gap” revealed in the 2025 IBM Institute for Business Value CDO Study. While 72% of CEOs view proprietary data as the ultimate fuel for the AI engine, a staggering reality remains: only 26% of CDOs are confident their data capabilities can actually support new AI-enabled revenue streams.

The AI “multiplier effect,” the promised explosion of productivity and revenue, is being stifled by the very infrastructure meant to enable it.

The architecture of inertia

For the modern enterprise, data is rarely “decision-ready”. It’s trapped in functional fortresses: Finance has its stack, HR has its, and Marketing operates on a different planet. There is no common taxonomy and no shared standards — just a digital Tower of (Data) Babel.

When a CDO tries to drop a Large Language Model (LLM) into this mess, the project doesn’t launch; it sinks into a six-to-twelve-month “data cleansing” quagmire. Teams spend more time hunting for and aligning data than generating meaningful insights.

To bridge this gap, leading organizations are tripling their data-strategy budgets, moving from 4% of IT spend in 2023 to 13% today. But this is not buying more digital plumbing. These enterprises are pivoting to a new paradigm: Bringing AI to the data, rather than hauling the data to the AI.

The gravity shift that is hybrid-by-design

In the old pre-Cambrian AI era, “integration” meant moving everything into a central warehouse. It’s slow, expensive, and a nightmare for security. In today’s AI-first world, 81% of CDOs are adopting a “hybrid-by-design” approach, creating a fundamental shift in data gravity.

By processing data where it lives — on-premises, in the private cloud, or at the edge — enterprises can bypass the latency and risk of mass migration. It’s the difference between sending a thousand students to a single library or giving every student a tablet connected to the world’s information.

Schenck notes that “good enough” platforms are no longer sufficient. To unlock agentic AI, which is software systems that go beyond chatting and actually act autonomously, you need a data fabric that provides a unified, intelligent layer across disparate environments.

The governance paradox, talent drought and trust gap

As AI agents begin to circulate through the enterprise, a new fear emerges: entropy. An AI agent with unfettered access to sensitive data is a liability waiting to happen. The solution? The AI Agent Marketplace.

Leading CDOs are building centralized hubs where employees can access pre-vetted, “secure-by-design” agents. These agents operate under data contracts, which are strict, programmatic agreements that define exactly how data can be used, for how long, and for what purpose.

“The most effective approach balances access with accountability,” Schenck says. It’s about moving from “data ownership” to “data stewardship,” making information accessible exactly where and when decisions are made.

But there’s friction: humans. Even with the perfect architecture, the human element is failing. The study shows a precipitous drop in talent confidence: only 53% of CDOs say their recruiting efforts are delivering the skills they need to achieve objectives, down from 75% just a year ago. We are hiring for generative AI roles that didn’t exist eighteen months ago, and 77% of CDOs say they are struggling to fill them.

Then there is the issue of sovereignty. As legal boundaries define where data can be stored and processed, 82% of CDOs now view data sovereignty as a critical risk management strategy. The “unbreakable” data pipeline must now also be a “geofenced” one.

Proactive strategy: Align or get sidelined

If you are a CDO waiting for the “perfect” infrastructure to be built before you scale, you have already lost. The AI multiplier effect isn’t a gift of technology but a result of alignment. The IBM study advises that for the next 12 months:

• Focus on the mission: Don’t just collect data; deploy it on a specific, high-value business objective.
• Productize everything: Treat data as a product experience, designed to attract users and deliver intuitive value.
• Measure the lift: Only 29% of CDOs have clear measures for data value. If you can’t prove the ROI to the C-suite, your budget is just a target for the next round of cuts.

“AI success is not architecture-led,” Schenck concludes. “It is alignment-led.” The enterprises that crack this code, those that turn their data into a circulating intelligence rather than a stagnant hoard, won’t just have better AI. They will have a fundamentally different operating model going forward.

Image credit: iStockphoto/Alexander Sikov