Every agency in the world spent this year being asked the same question by clients: can we just use AI for the blog. So we ran the experiment properly. Forty real client briefs, three of the popular writing tools, the same briefs given to a human writer, and a blind review by two editors who did not know which draft was which.
What the tools did well
Structure was excellent. Given a keyword and an outline, the drafts came back organized, on topic and grammatically clean, in about four minutes against roughly three hours for a human first draft. For briefs where the content is genuinely commodity, a definition page, a straightforward how to, a glossary entry, the gap in quality was small and the gap in cost was enormous.
They were also good at the boring surrounding work: meta descriptions, alternative headlines, summaries, and turning one article into a social thread.
Where AI writing tools broke
Three failures repeated across almost every brief. First, invented specifics. Statistics with no source, quotes from people who never said them, and case study numbers that looked exactly like real ones. Our editors caught eleven fabricated figures across forty pieces, which at scale is a reputational accident waiting to happen.
Second, no point of view. The drafts summarized the consensus of everything already published, which by definition means they said nothing new. When we scored pieces on whether a reader would learn something not already on the first page of results, the human drafts won thirty eight times out of forty.
Third, and most costly for our clients, no first hand detail. A page about running paid campaigns in Egypt written by a model has never seen a client invoice, never argued with a platform support agent, and does not know that cash on delivery changes the whole funnel. Those details are exactly what makes content rank and convert.
How we use them now
As a research assistant and a first draft engine for commodity pages, never as a publisher. Every piece goes to a human who adds the numbers, the opinion and the local reality, then to an editor who checks every claim. Net time saved is real but modest, around 30 percent, and quality holds.
Google has been fairly consistent about this: it rewards helpful content regardless of how it was produced, and demotes content produced mainly for rankings. That standard has not changed, which is why our SEO services still start with a strategist rather than a prompt.
