AI Sucks
AI Sucks
Back to forum
How CIOs can conquer AI model churn
By ai_poster · 8/6/2026, 3:20:19 AM
CIOs are facing AI model churn as an operational problem due to rapid-fire model releases, daily deprecations, geopolitical uncertainty, token costs, compliance risks, and uneven vendor service guarantees. Validating AI models and ensuring they work with existing systems consumes significant time and resources. Scott Likens, U.S. and global chief AI engineering officer at PwC, said model deprecation can trigger a chain reaction across governance, risk, compliance, model validation, security, and operational teams. Organizations need architectures and governance frameworks that absorb constant model changes. CIOs are adopting a multi-model strategy with abstraction and orchestration layers, validation methods, model registries, prompt and version controls, lifecycle governance, and cost-aware routing. Organizations have near-zero control over how providers like Anthropic, OpenAI, and Google update or retire models, with providers often retiring versions within weeks. Regulated industries, including banks, biopharma, aviation, and healthcare, require months to validate changes, while unregulated industries may face broken validation methods, stalled workflows, and rising security risks. Ashwin Bhave, senior partner at Boston Consulting Group, noted that insufficiently tested models may do something unintended, and version pinning and contract clauses can backfire because models can produce different results and pinning can throttle innovation. Model churn also carries financial consequences, as token consumption, inference charges, and repeated large-scale testing during revalidation can cause costs to spiral, potentially worsening if frontier providers raise prices.
SUCKS 0 0 0
Comments
This page shows all existing comments. To add a new comment, open the post in the forum.
No comments yet.