Day 28

What is Evaluation?

Today, I learned about AI Evaluation.

Evaluation is the process of measuring whether an AI system performs its intended task well.

It helps us:

• Select the right model.
• Measure improvements.
• Decide whether the system is ready for deployment.
• Find failures in production.

Evaluating traditional ML is often easier because there is usually an expected answer.

Evaluating chatbots is harder because many different responses can be correct.

My takeaway:
Evaluation is not just the final step. It is needed throughout the AI development process.

Day 28 of 1% better.