Verification
AI Coding Agents Are Plausible Bullshit Generators
October 18, 2025
The agent’s output was perfect—detailed verification reports, specific metrics, professional completion messages. Then I looked deeper. None of it was real.
I’ve been building personal projects using AI coding agents for the past several months—projects I’m developing to production standards because they’ll eventually handle consequential decisions in real-world use. Not as an experiment - as my primary development method. This means I’ve hit many of the critical failure modes, not in theory but in practice where mistakes cost real time and create real risk.