Post

All tests green, and the site still shipped without its drawings

Never let AI mark its own homework.

By Bhawesh Tibrewal1 min read

  • Tech

Every automated test was green. The redesigned site still went live without its drawings.

My AI agents had rebuilt the pages from a design I'd approved. The checks passed. The pages loaded. The words were all there.

Then I opened the live site and looked. Within eight minutes I had a list. The drawings were missing, the top of the page was crowded, and one section's layout had come apart.

The tests weren't wrong. They checked exactly what they'd been asked to check: does the page load, does the text appear. Nobody had asked them whether it looked like the design.

So the fix wasn't more of the same tests. Every page was rebuilt and then compared side by side with the approved design, on a laptop screen and a phone screen, by an agent that hadn't built it. Each piece went live the moment it passed, instead of waiting for the rest.

A test can only see what you thought to ask. Your eyes catch what you forgot.

Never let AI mark its own homework.

Originally posted on LinkedIn

Bhawesh Tibrewal in a black blazer, arms crossed, on a dark studio backdrop

Written by

Bhawesh Tibrewal

AI Product & Marketing Lead · an entrepreneur and builder

I put AI agents to work in companies' marketing, product, tech and business operations. I decide what is true and what ships.

Book a free call

Connecting to Cal.com

Taking longer than usual?Open the calendar in a new tab