← All learning paths

Prove it works

Measure what your AI system changed, find out where it fails, and decide whether to keep it.

5 lessons1h 1m

Who it's for

You've built something, or you're about to, and someone will ask whether it was worth it.

What you'll be able to do

You have a before number, a test set you can rerun, and a clear rule for when to expand or stop.

Lessons

  1. 1Get your before numberHave something to compare with. You can't recover this later.11 min
  2. 2Work out the cost per taskTurn a vague benefit into one number.13 min
  3. 3Build a test setBe able to tell whether a change made things better.15 min
  4. 4Read the results properlyLook past the average to the failures that matter.11 min
  5. 5Improve it, or stopMake the decision on evidence.11 min