EngineeringOwn InfrastructureMedium complexity

Model Retirement & Provider Exit Plan

Model providers retire versions at short notice and change prices and terms, and applications tuned to one model break when it goes.

How we approach it

Route every model call through one internal interface. Keep an evaluation set for each use case, so a replacement model can be tested quickly instead of the application being rebuilt. Keep a tested fallback, a second provider or an EU-hosted open-weight model, and track providers' deprecation notices and terms changes.

Business value

A model retirement becomes a planned test, not an outage

Technology stack

  • LLM gateway
  • evaluation suite
  • open-weight fallback
  • vendor terms monitoring

Related service

Infrastructure & MLOps

Further reading

Related use cases