Home/Decision Frameworks/Business Case Data Guide
Decision Framework

Legacy Modernization: The Definitive Business Case Data Guide

The data every decision-maker needs to build and defend a legacy modernization business case — ROI benchmarks, failure rates, AI tools, and industry breakdowns.

Last updated April 9, 2026·Sphere Research Team·18 min read
TL;DR

The average global enterprise wastes more than $370 million annually on legacy inefficiency — yet the modernization failure rate sits at 70–88%, almost always due to organizational issues, not technology. Organizations that execute well report 228–362% ROI within three years and 30–50% operational cost reductions. AI-powered tooling has fundamentally changed the cost equation, with real deployments showing 50–80% reductions in timelines. The window to modernize on favorable terms is narrowing: technical debt compounds at ~20% annually, and 92% of COBOL developers will have retired by 2030.

What you'll learn
  • What legacy systems actually cost — including the 3.4× hidden multiplier most organizations miss
  • ROI benchmarks and payback periods from Forrester, Kyndryl, Nucleus Research, and IBM
  • The mounting risks of inaction: security, downtime, talent, and competitive exposure
  • How boards and PE sponsors evaluate modernization investments — and what they need to see
  • Why 88% of transformation initiatives fail, and the proven patterns that beat those odds
  • How AI tools are cutting modernization costs by 50–80% in production deployments
Legacy modernizationis the structured process of replacing or re-architecting outdated software systems, infrastructure, and codebases to reduce technical debt, lower operational costs, and restore an organization's ability to adopt modern capabilities — including AI.
$370M+
Avg annual legacy waste per enterprise
88%
Transformation failure rate (Bain, 2024)
362%
ROI for off-mainframe migration (Kyndryl)
20%
Annual compounding of technical debt

What Do Legacy Systems Actually Cost? (Most Estimates Are 3.4× Too Low)

Most organizations dramatically underestimate what their legacy systems cost. A Deloitte Banking Survey (2024) found that actual legacy TCO runs 3.4× higher than initial estimates — a mid-sized European bank budgeting €2 million per year for core system costs discovered the true figure was €6.8 million once compliance overhead, integration friction, and innovation drag were included.

At the macro level, enterprises allocate 60–80% of IT budgets to maintaining existing systems, leaving only 20–40% for innovation. Gartner predicted that by 2025, companies would spend 40% of IT budgets on technical debt alone. The U.S. federal government remains the starkest example: approximately 80% of its $100 billion IT/cybersecurity budget goes to operating and maintaining legacy infrastructure.

Industry% of IT Budget on Legacy Maintenance
HealthcareUp to 75%
Financial Services70–78%
U.S. Federal Government~80%
Average Enterprise60–80%

The Pega/Savanta study of 500+ IT decision-makers (October 2025) quantified enterprise waste with striking granularity:

~$134M
lost per year on legacy transformation delays
$58M
on failed transformation initiatives
$56M
on ongoing maintenance and integration

At the national level, CISQ estimates $2.41 trillion annuallyin U.S. costs from poor software quality, with accumulated technical debt principal reaching $1.52 trillion. Oliver Wyman's analysis shows global technical debt roughly doubled from 2012 to 2023, growing by approximately $6 trillion.

Technical debt compounds at roughly 20% annually if left unaddressed.Each year of delay increases eventual modernization costs by 20–25%. Legacy hardware maintenance costs climb 10–15% annually after warranty expiration, with premium support for end-of-life systems costing 50–200% more than standard support. McKinsey estimates that tech debt amounts to 20–40% of the value of an enterprise's entire technology estate before depreciation.

What Does Modernization Cost — and What Does It Return?

The application modernization services market was valued at $15–22 billion in 2024 and is growing at a 15–20% CAGR, with projections reaching $40–55 billion by 2030. Cloud migration services represent an even larger market at roughly $300 billion in 2025, projected to exceed $1 trillion by 2030.

ROI Benchmarks

ROI data from multiple authoritative sources paints a consistently positive picture for organizations that execute well:

SourceApproachReported ROI
Kyndryl (2026, 500 senior leaders)Modernize on mainframe288%
Kyndryl (2026)Integrate with cloud297%
Kyndryl (2026)Move off mainframe362%
Forrester TEI / MicrosoftAzure PaaS (3-year)228%
Nucleus ResearchCloud migration (per dollar)$3.86 return

The Forrester Total Economic Impact study commissioned by Microsoft documented $43.17 million in benefits versus $13.15 million in costs over three years. Average modernization cost dropped from $9.1 million in 2024 to $7.2 million in 2025 due to AI-powered automation.

Payback Periods

Payback periods cluster around 6–24 months depending on scope and approach:

Azure PaaS modernization
~15 months to payback
Large French bank (mainframe doc migration)
6 months
Microsoft Dynamics 365
Under 6 months (some configs)
Enterprise-scale modernization median
18 months (Forrester TEI)

Outcome Benchmarks Across Dozens of Case Studies

Notable public-sector case studies: U.S. HUD saving $8 million annually from mainframe-to-cloud migration; DHS saving $30 million annually; the Census Bureau saving $1.9 billion via online modernization; a global bank achieving 90% cost savings on mainframe processing through offloading.
McKinsey's Caution

89% of large companies have digital/AI transformation underway, but have captured only 31% of expected revenue lift and 25% of expected cost savings. The gap between potential and realized value is substantial — and top performers dramatically outperform the average.

The Mounting Risks of Doing Nothing

The cost of not modernizing extends well beyond maintenance spending into security, compliance, talent, and competitive positioning.

Security & Compliance Exposure
$4.88M
Avg global breach cost (IBM, 2024)

Outdated systems have 3× more security vulnerabilities than modern counterparts. U.S. breach costs hit $10.22M in 2025. Healthcare breaches average $9.77M; financial services $6.08M. Companies on legacy systems are 40% more likely to experience compliance failures.

Downtime Costs
$14,056
Avg cost per minute of unplanned downtime

Over 90% of mid-size and large enterprises report hourly downtime costs exceeding $300,000 (ITIC 2024), with 41% putting costs at $1–5M per hour. IDC reports enterprises on legacy spend 42% more on operational overhead and experience 4× more downtime.

The Talent Crisis
92%
COBOL developers retired by 2030

The avg COBOL developer is 58.3 years old. Fewer than 2,000 graduated worldwide in 2024; 47% of organizations already cannot fill COBOL roles. Salaries rising 25% per year. 42% of critical business knowledge sits with 1–2 people who understand legacy systems.

AI Adoption Blocked
68%
Of IT leaders say legacy blocks AI

Nearly 60% of AI leaders view legacy-system integration as the primary barrier to agentic AI adoption. Companies with fragmented legacy systems are 30% more likely to experience AI implementation delays.

How Boards and PE Sponsors Evaluate Modernization

The most effective modernization business cases are built around a three-horizon framework rather than a single ROI number projected 3–5 years out. PwC research confirms that programs with ROI horizons stretching beyond three years without interim proof points lose executive patience and get cancelled.

The Three-Horizon Framework

Horizon 1
0–6 months
Early wins
Deployment frequency, cycle time reductions, modules migrated, documentation coverage
Horizon 2
18–24 months
Break-even
Cumulative savings vs. investment, maintenance cost reduction, licensing consolidation
Horizon 3
24–36 months
Profitability
Sustained cost reduction, time-to-market acceleration, AI readiness, new capability enablement

Acknowledging the J-Curve

Any credible business case must acknowledge the J-curve. McKinsey found organizations overspend by approximately 14% annually during migration transitions due to dual-run costs. A projection showing a clean downward cost curve from day one will destroy credibility with finance audiences.

The business case should quantify three ROI categories separately:

  1. Hard cost savings — infrastructure, licensing, maintenance labor
  2. Revenue enablement — cycle time, feature velocity, AI readiness
  3. Risk avoidance — breach exposure, compliance gaps, talent dependency

What CFOs Are Looking For

NPV at a 10% discount rate over 3–5 years
IRR compared against competing investments
Payback — must be visible in the first 30 seconds
TCO with a comprehensive 3–5 year analysis

The CapEx-to-OpEx shift from cloud modernization is strategically attractive — converting large, unpredictable capital expenditures into manageable operating expense streams.

How PE Sponsors Think About This

PE sponsors increasingly view technology as the primary value creation lever. Simon-Kucher's 2025 study found 33% of deal teams now rank operational improvements as their primary equity story driver — nearly double buy-and-build strategies. Harvard Business School research (2024) confirmed that PE-backed companies significantly increase digital investments post-acquisition, with those increases correlating to stronger sales growth and higher productivity.

Companies actively investing in digital transformation are 3× more likely to achieve premium valuationsin M&A processes. The median PE hold period now sits at 6 years, giving more runway for modernization payback — but also creating pressure to demonstrate results within the investment horizon.

The "cost of inaction" argument is consistently the most powerful persuasion tool with non-technical stakeholders.Gartner's framework for building board-level business cases emphasizes four elements: a clear problem statement with cost-benefit analysis rooted in business value; direct correlation between the transition and resulting benefits; a prioritized multi-stage program design; and a "do nothing" option demonstrating technical debt costs.

How AI Is Fundamentally Changing the Cost Equation

The emergence of AI-powered modernization tools represents the most significant shift in the modernization landscape since cloud computing. Gartner predicts that by 2027, GenAI tools will reduce legacy modernization costs by 70% by explaining legacy applications and creating replacements. Real-world results are already validating this trajectory.

What Production Deployments Are Showing

AWS Transform
Analyzed ~1.1B lines of code
Saved 810,000+ hours of manual effort (~648 developer years)
Toyota Motor North America
Modernized 40M+ lines of COBOL to Java
50% faster modernization
Thomson Reuters
Ongoing migration at scale
1.5M lines/month, 30% lower costs, 50% less tech debt
Egypt's NOSI (IBM watsonx)
COBOL comprehension
79% reduction in time to understand complex applications
Salesforce (internal)
AI-assisted refactoring of 275 Apex classes
Estimated 2-year effort completed in 4 months
Unnamed logistics company
COBOL-to-Java transformation
60% productivity increase
Unnamed client
Migration cost reduction
From €1.2M to €360K (70% reduction)

IBM watsonx Code Assistant for Z uses a 20-billion-parameter LLM trained on COBOL-Java pairs and was named a Leader in the 2025–2026 IDC MarketScape for AI Coding Assistants. COBOL-to-Java automated conversion reliability has reached 70–85% in 2025, up from 40% in 2020.

Why AI Is Non-Optional

With 220 billion lines of COBOL still in active use globally, processing $3+ trillion in daily commerce, and over 85% of universities having dropped COBOL from their curricula, the workforce to maintain these systems is literally disappearing. 80% of banks now plan to modernize existing COBOL code through AI-assisted refactoring — not because it's the preferred approach, but because manual alternatives will soon be unavailable. AI-enabled mainframe workloads are expected to rise from 3% in 2024 to 25% by 2026 — an 8× increase in two years.

Why Most Modernization Projects Fail — and How to Beat the Odds

The failure statistics are sobering. Bain & Company's 2024 study of 24,000+ transformation initiatives found 88% fail to achieve their original ambitions. BCG reports only 35% of digital transformations meet value targets. McKinsey's study with Oxford of 5,400+ IT projects found that large projects (>$15 million) run 45% over budget and deliver 56% less value than predicted, with 17% going so badly they threaten the company's existence.

The Root Causes Are Organizational, Not Technical

McKinsey consistently identifies organizational culture as the dominant obstacle — organizations investing heavily in culture change see 5.3× higher success rates than technology-only approaches. Bain identified three critical mistakes:

  1. Failure to identify and protect mission-critical roles
  2. Relying on too shallow a talent pool (overloading star performers)
  3. Poor preparation for future capability needs

Only 16% of executives feel comfortable with available tech talent, and 83% of organizations lack employees with necessary change management skills.

What Actually Works: The Strangler Fig Pattern

The most effective de-risking strategy is the Strangler Fig pattern: gradually replacing legacy functionality with modern services while maintaining full business continuity. This converts high-risk big-bang events into manageable incremental delivery, contains the blast radius of any failure, and delivers business value in weeks rather than years.

Gartner explicitly recommends continuous modernization over rip-and-replace. McKinsey's research on P&C insurers found core replacement projects routinely run 50%+ over budget.

Proven Risk Mitigation Approaches

Which Industries Face the Highest Modernization Stakes?

Financial Services
$93.6M
avg annual loss per institution from legacy limits

COBOL powers 43% of all banking systems and 95% of ATM transactions. Banks spend 70–78% of IT budgets on legacy maintenance. Regulatory mandates (PSD3, DORA, FedNow) require real-time APIs that legacy cannot provide. JPMorgan Chase committed $17B in 2024 — moving 80% of apps off legacy data centers.

Insurance
$132.86B
U.S. insurer spend on modernization in 2024

Only 10% of large insurance providers have modernized more than half their systems. BCG projects insurers will spend ~$17B across EMEA and North America on core IT modernization from 2024–2026.

Healthcare
73%
of orgs still run legacy systems

The VA EHR modernization ballooned from $10B to $37B lifecycle cost, with only 6 of 171 medical centers deployed after ~$5B in spending. The positive case: modern systems deliver 50% fewer errors, 40% faster processing, and 45% better care outcomes.

Manufacturing
$3.5M
avg annual legacy cost per plant

68% of U.S. manufacturers rely on applications over 15 years old. A Midwest automotive supplier lost $10M in 2024 from a single legacy system failure during just-in-time delivery. ERP market reached $23B in 2025, growing at 8% CAGR.

The Bottom Line

The business case for legacy modernization in 2025–2026 is defined by converging pressures that make inaction increasingly untenable.

The strategic posture the data supports: modernize incrementally with AI acceleration, present the business case through a three-horizon framework with quantified cost-of-inaction scenarios, and invest at least as heavily in organizational change as in technology.

Building a Modernization Business Case?

Sphere helps engineering and finance leaders build defensible modernization business cases — grounded in real benchmarks, J-curve realism, and the cost-of-inaction data boards require.

Talk to Sphere →

Frequently Asked Questions

About the Sphere Research Team

The Sphere Research Team is the editorial and research arm of Sphere's CTO Accelerator. Our analysis draws on 20+ years of enterprise delivery across AI, cloud, data, and modernization — spanning 230+ projects in financial services, healthcare, insurance, manufacturing, and private equity. Every framework, benchmark, and cost range published here is grounded in real project data and reviewed by Sphere's senior engineering leadership.