How to Tell If Your Marketing Agency Is Actually Working

You’re paying a retainer every month, you get a report or a call, and everyone sounds confident. But you can’t quite tell if the confidence is backed by anything. If that’s a familiar feeling, it’s worth a direct look at what your agency is actually producing versus what it’s reporting.

The gap between busy and effective

Agencies rarely stop working outright. They keep posting, keep sending reports, keep billing. What quietly disappears is the connection between that activity and your business results. A team can be genuinely busy — publishing content, running ads, tweaking pages — while the number of leads or sales coming from any of it stays flat or slips.

The problem isn’t usually laziness. It’s that activity is easy to produce and easy to report, while results take strategy, iteration, and a willingness to say “that didn’t work, here’s what we’re changing.” Busywork is the path of least resistance for both sides, because it always looks fine on a slide.

Vanity metrics vs. metrics that matter

If your monthly update leans on these, be skeptical:

• Impressions, reach, or “engagement” with no tie to inquiries
• Follower growth
• Website traffic with no mention of what that traffic did
• Rankings for keywords nobody searches with intent to buy
• Hours logged or number of posts/emails sent

These aren’t meaningless in isolation, but on their own they tell you activity happened, not that it worked. A report full of them, and nothing else, is a report designed to look busy.

What should replace them, or at least sit above them:

• Leads — form fills, calls, booked appointments, quote requests, tied to a source
• Cost per lead, tracked over time, by channel
• Close rate on those leads, if your sales process can supply it
• Revenue or pipeline value attributable to marketing, even roughly
• Trend direction — is cost per lead improving, is lead volume growing, quarter over quarter

The shift is from “what did we do” to “what did it produce.” A good agency can answer both. A struggling one can only answer the first.

Questions to ask your agency

You don’t need to become a marketing analyst to have this conversation. A few direct questions will surface the answer quickly.

”How many leads did we get from this, and what did they cost?”

If the answer is a shrug, a pivot to reach numbers, or “brand awareness takes time” without a plan attached, that’s a signal. A legitimate answer includes a number, even an imperfect one, and how it compares to last month or last quarter.

”What changed this month based on last month’s results?”

Marketing that’s working evolves — an ad gets paused because it underperforms, a landing page gets rewritten because the form conversion is weak, a keyword gets dropped because it never converts. If nothing has changed in months, nobody is actually looking at the results and acting on them.

”What would you do differently with more budget, and why?”

This tests whether they have a model of what’s working and what’s capped by spend, versus just wanting more budget to run more of the same.

”Can I see this in my own numbers, not just yours?”

Ask to see the leads in your CRM, the calls in your call log, or bookings tied to a promo code or tracked number — not just a screenshot from the ad platform. If the agency’s reporting and your actual pipeline don’t line up, or they resist connecting the two, that’s worth pressing on.

”What’s the one thing you’d cut if the budget got tighter?”

A team that knows what’s working can answer this in one sentence. A team padding a retainer will hedge.

The honest caveat: not every channel converts fast

Some of this takes time to show up. Brand and content work, SEO, and awareness campaigns can take months to compound into leads. A new agency relationship, or a new channel, deserves a fair runway before you judge it on close rates. The point isn’t to demand instant ROI on everything — it’s to make sure someone can articulate the plan, the timeline, and the metric they’re aiming at, instead of hiding behind “these things take time” indefinitely.

What good looks like

A working agency relationship tends to have a few consistent traits:

• Reports lead with numbers tied to your business, not the platform’s vanity metrics
• Someone can explain what changed and why, month over month
• You can trace at least some leads back to a specific campaign or page
• The agency brings you bad news as readily as good news
• There’s a stated plan for the next month, not just a recap of the last one

If your current reports don’t have most of these, it’s a fair conversation to start, not an accusation to make. Ask the questions above and see what comes back.

This is the standard we hold our own Growth Retainer to — leads and revenue reported plainly, with a stated plan every month. If you want a second opinion on what your current numbers actually show, book a call.