Who Grades the Homework?
An agency's report isn't the truth. That includes ours.

I'm looking at two numbers that aren't telling the same story.
One is what an ad agency says its campaigns produced last month. The other is how much the brand's online sales actually grew that same month. Attributed sales and sales growth measure different things, so the gap alone doesn't prove either number is wrong. The agency's number is a lot bigger... not rounding error bigger, more like you have to read it twice bigger.
And the brand is running TV at the same time. So we need to find out how much credit overlaps with the TV activity. TV can move people who later buy online, but the discrepancy alone doesn't tell us which channel caused the sale.
I've been on more than one call like this this fall. Different brands, same shape. A company spending real money across TV and digital, a stack of vendor reports that each say they're winning, and an owner who can't make the math add up to what's actually in the bank. One of them did the only rational thing you can do with numbers you don't trust. They paused nearly everything.
I. Nobody had to lie for this to happen
I don't think anybody sat in a room and decided to fake a report. That's usually not how it goes.
What usually happens is worse, honestly, because it's normal. Each ad platform counts conversions its own way. The agency reports what the platform says. Nobody tags the campaigns well enough for the brand to check anything on its own. And nobody on the agency side has a reason to go looking for the version of the story where they matter less.
Every channel in the mix is happy to say it helped. Add all those claims up and you can end up with more credit than sales. The owner is the only person in the room who has to live with the real number.
II. We're in some of those reports too
Here's the part that's uncomfortable for us. On at least one of these accounts we run campaigns too. Our ads have done real numbers, and they reach a lot of the same people the TV reaches.
So if I'm going to get on a call and say somebody else's numbers don't hold up, I'd better be willing to put ours through the same test. Same overlap, same question.
That's the whole reason we keep pushing for one reporting hub that pulls every vendor into the same place and flags where the claims don't add up, including the claims with our name on them. It's also why we're vetting outside attribution tools instead of building a prettier version of our own self-report. If the grader works for the student, it's not a grade.
III. The fix is boring, and that's the point
There's no magic in it, and tagging or matching timelines won't isolate cause by themselves. Tag everything so the owner can check it without asking us. Line digital up against the TV schedule so you can actually see what happens when a spot airs. Plan a controlled comparison where practical, instead of treating a pause and a change in sales as proof of cause. Put the brand's own sales number at the top of the report and make every vendor explain themselves against it.
None of that makes for an exciting pitch deck. It makes the next budget decision honest.
And I think honest is turning into a real competitive advantage. Owners are tired. A lot of dashboards have told them everything's working while the bank account said something else. The agency willing to shrink its own credit to get to the truth is going to keep clients a lot longer than the one with the best-looking report.
I'd rather be trusted than impressive. Over enough years those end up being the same thing anyway.
Nobody should grade their own homework. Including us.