Skip to main content

MLOps: why models fail after the notebook, and what to do about it

Training a model is the part that gets taught. Getting it to work reliably for years, on data that keeps changing, in a system other people depend on, is the part that decides whether any of it mattered.

What this course sets out to do: show you where machine learning projects actually fail, which is almost never in the modelling, and what practices address each failure.

What this course does not do: set up pipelines. The premium catalogue covers MLflow, Docker, CI/CD for models, feature stores and monitoring hands-on.


What you are about to discover​


Course contents​

#LessonMain goalTime
1Why models never shipThe real failure causes, none of them accuracy8 min
2ReproducibilityVersioning data, models and experiments9 min
3Deployment patternsBatch, real-time, edge, and releasing safely9 min
4MonitoringData quality, drift, delayed labels, retraining9 min
5Teams, cost and governanceWho owns what, what it costs, what to document8 min
6Recap and FAQSynthesis, a maturity checklist, and 12 questions6 min
7Quiz and attestationValidate what you learned with 5 corrected questions3 min

Is this course for you?​

  • You have a model working in a notebook and no idea what happens next.
  • You are a software engineer asked to deploy something a data scientist built.
  • You manage a team and want to know why the pilot never became a product.
  • You keep hearing "drift", "feature store" and "model registry" and want them precise.

Recommended first: Machine Learning.


What you will be able to do at the end​

  • Name the real reasons projects fail and check for them before starting.
  • Say what must be versioned for a result to be reproducible six months later.
  • Choose between batch, real-time and edge serving on evidence.
  • Release a model without betting the process on it, using shadow and canary patterns.
  • Design monitoring that catches degradation before users report it.
  • Explain training-serving skew and why it silently ruins good models.

Estimated time​

Around 45 to 55 minutes of reading.


Prerequisites and next steps​

Prerequisites: Machine Learning. Any experience of shipping software helps.

Natural continuation:


Frequent questions, answered in one line​

Is MLOps just DevOps for machine learning?

It borrows heavily and adds a genuine difference: in ordinary software, behaviour changes when someone edits code, whereas a model's behaviour changes when the world changes, with no commit and no deployment. That single difference is why data versioning, drift monitoring and retraining pipelines exist as distinct concerns.

Do I need a platform, or can I do this with scripts?

Scripts and a scheduler take you a remarkably long way, and many production models run exactly that way. Platforms earn their cost when you have many models, many people, or compliance requirements — and adopting one to run a single model is a common way to spend six months building infrastructure instead of value.

Who is supposed to do this work?

In small teams, whoever built the model, which is why it often does not get done. In larger ones the responsibilities split between data scientists, machine learning engineers and platform engineers. The failure mode to avoid is a model handed over with nobody owning it afterwards.

How much does running a model cost?

Less than people fear for batch prediction, and more than they expect for real-time serving at scale, where you pay for capacity you are not always using. The larger hidden cost is usually human: monitoring, investigation and retraining.


Want to build these pipelines rather than read about them?

The premium catalogue covers MLflow, Docker, CI/CD for models, feature stores and production monitoring, with a verifiable certificate after a 40-question examination. Included in every paid plan.


Ready? Start with lesson 1 →