Model Drift (or model decay) is the degradation of an AI model's predictive performance in production over time, caused by changes in the statistical properties of real-world input data relative to the training data.
Helps AI builders design and scale robust architectures; mastering the implementation of Model Drift improves latency, accuracy, and operational efficiency for mlops model tracking, prediction monitoring, and automated retraining pipelines.
Model drift is the degradation of a model's predictive performance in production over time due to changes in real-world data distributions (data drift) or the underlying relationships between inputs and targets (concept drift). Mitigating model drift requires continuous monitoring, anomaly alerts, and periodic retraining on fresh datasets.
Data drift (covariate shift) is when input distributions change (e.g. users search for new terms). Concept drift is when the relationship between inputs and targets changes (e.g. consumer preferences shift, making old classification rules obsolete).
By continuous monitoring in MLOps, setting up anomaly alerts on input distributions, and automatically triggers retraining pipelines on fresh production data.
Runway spent weeks trying to engineer its way out of a stubborn bug: AI-generated avatars would drift off-center during real-time video generation.