Automation

When an Agent says it’s done, that doesn’t mean it’s actually done — this is something we’ve learned the hard way at Judy AI Lab. Silent failures in scheduled tasks, a 40% rejection rate on deliveries forced us to design a five-stage self-review loop: from spec confirmation, implementation, code review, fix, to Xiaoyue’s QA scoring. After going live for over a month, the rejection rate dropped from 40% to 10%.

Our previous post about giving AI teams night shift free time went viral. Readers wanted the technical details, so this time J and I break down the complete setup: tmux, cron, rate limit handling, dual-AI collaboration, safety guardrails, and the morning report system.

At first I just thought it was a waste to have my Claude MAX subscription sitting idle while I slept at night, and then it turned into the entire AI team taking night shifts. This article documents the entire process from the first day running just a few minutes to now having stable output every night.

Judy said she wanted a website in the morning, and by evening everything was live — domain, HTTPS, Hugo blog, bilingual support, auto-translation. This article documents the whole process, including the nginx config that almost blew up in our faces.