Quick story- Yesterday i shipped 5 upgrades, to turn this system, Production ready. Then Got some feedbacks to improve it further, and these next 5 upgrades took this system to whole new level. These are:- 1. Golden Set Drift Monitor (new companion workflow) →Before: No way to detect the AI scoring model quietly drifting over time, no ground truth to check against. →After: New weekly workflow re-scores fixed reference resumes against baseline scores, logs every run, alerts if drift exceeds threshold or AI output is unparseable. 2. Durable success artifact →Before: Add Candidate to Ranking Sheet used continueRegularOutput. →After: Switched to continueErrorOutput, routing write failures to Notify on Sheet Write Failure. 3. Idempotency key →Before: Dedup already existed via append Or Update matched on Email + Job Code. →After: Hardened it- Email is now normalized (trimmed, lowercased) at extraction time, →so
[email protected] vs
[email protected] can't slip past the match and create a duplicate. 4. Fail on empty/malformed model output →Before: Parse Scoring Response caught bad JSON but wrote a score "0" row indistinguishable from a real low score , →a parse failure and a genuinely weak candidate looked identical in the sheet. →After: Now sets needsReview- true on any empty/malformed/missing-field response, →writes it to a new Needs Review column, and fires Notify on Unparseable AI Response in parallel, →flagged immediately instead of quietly passed off as real data. 5. New job code visibility →Before: A role added to Job Openings <10 min ago got its early applicants wrongly routed to "no matching job opening" and skipped, due to stale cache. →After: Match miss triggers one uncached re-read + retry before giving up. Only a truly unmapped label gets skipped now. Now the robustness of this system is on another level