Stop Retraining. Start Diagnosing.
“In enterprise AI the model is rarely the problem. The system around it almost always is.”
A customer rep promised a discount. It was the right discount. The model said so. The problem — the policy had changed three days earlier. The model didn’t know.
The customer was already engaged. The promise was already made. The rep couldn’t honor it. The customer was furious.
When I was brought in, the team’s instinct was to retrain the model. Expensive. Time-consuming. And in this case — completely wrong diagnosis.