We will tell you the truth.
Even when it costs us the account.
← Home / / 3 min read / Blog

How to Read SEO Case Studies

Case studies are marketing documents by design. Here's what to actually check for, and what questions to ask that a case study will never answer.

Case studies are marketing documents by design, curated to show an agency’s best work in its best light. That doesn’t make them worthless, but it does mean reading them literally, taking the headline number at face value, misses most of what actually matters.

Check what the percentage is actually a percentage of

“300% traffic increase” sounds impressive until you realize it could mean going from 10 monthly visitors to 40. A case study that leads with a percentage but never states the actual starting and ending numbers is choosing not to show you the scale, which is usually because the scale wouldn’t sound as impressive as the percentage does.

Look for a timeframe, and be suspicious of its absence

A results claim with no stated timeframe could describe 3 months or 3 years. Vague time windows let an agency imply speed without committing to a specific, checkable claim. A credible case study states the engagement length plainly: “over 14 months,” not just “since working together.”

Ask whether the metric shown is actually the metric that mattered

Traffic and ranking improvements are the easiest numbers to show, and also the easiest to show without connecting them to any real business outcome. A genuinely strong case study connects the SEO metric to leads, revenue, or another concrete business result. One that stops at traffic or rankings alone may be hiding that the business impact wasn’t actually significant, or was never measured at all.

Notice whether it names the client and industry specifically

Confidentiality agreements are real and legitimate, so an anonymized case study isn’t automatically suspicious. But a case study vague about industry, size, and specifics, while still making bold numeric claims, is harder to sanity-check against what’s realistic for a business like yours. Weigh anonymized case studies a bit more cautiously, not as automatically false.

Ask what didn’t work, directly, in the sales conversation

A case study will never show you the campaigns that underperformed, that’s not what case studies are for. But you can ask directly in a sales call, much like the direct answers a real discovery call should already be surfacing: “tell me about an engagement that didn’t go as planned, and why.” A confident, specific answer is a good sign of genuine self-awareness. A deflection to “we don’t really have those” is worth noting, since every agency doing real work has had at least one engagement that underdelivered.

Ask if you can talk to that specific client

A case study is a static document. A short call with the actual client, even 15 minutes, gives you texture no written summary will: what the relationship actually felt like day to day, not just the final number. Reasonable confidentiality constraints sometimes prevent this, but a flat refusal with no explanation is worth factoring in.

The actual skill here

Reading a case study well isn’t about assuming it’s fake. It’s about noticing what’s missing, actual numbers behind a percentage, a stated timeframe, a connection to real business outcomes, the same kind of scrutiny worth applying to a reporting dashboard once you’re actually a client, and asking directly for what the document conveniently leaves out. A good agency won’t be bothered by these questions. An agency that gets defensive when asked to fill in the gaps is telling you something the case study itself never could.

Still here

Want this run on your actual traffic drop?

Send the domain and what you have been told. You get a straight answer. Including the one where we say do not hire us.