I’ve been spending a lot of time exploring AI agents, harness reliability, and verification with Atlas.
I’m a senior engineer by trade, not a software developer, so a lot of this has been learning through experiments, mistakes, and conversations with people who know more than I do.
One thing keeps coming up: An AI agent can give you the right answer for the wrong reasons.
It might:
- Skip a required step.
- Claim a tool succeeded when it didn’t.
- Use information it wasn’t supposed to access.
- Pass a test because the test itself has a flaw.
That last one really caught my attention.
We’ve been exploring how to verify not just the agent’s answer, but the evidence behind the answer.
The distinction I’m working with now:
🔍 Outcome: Did it get the right answer?
🛠️ Process: Did it follow the intended steps?
🧪 Verification: Did the test actually prove what we think it proved?
I’m not claiming we’ve solved this. Some of our tests are still isolated, and getting them into a reliable live system is a different challenge.
But that’s part of the fun. Question for the builders here:
Have you ever had an AI agent pass a test, only to discover later that the test wasn’t checking what you thought it was?
I’d love to hear how you caught it.
— Bill | Atlas