Quality & Research

    Research isn't broken; bad research is

    The choice was never research versus no research. It is rigorous research versus costly mistakes.

    A recurring myth says customer research is flawed or not worth the money. Look closely and the failures behind the headlines are almost always execution failures: wrong participants, leading questions, findings nobody acts on. The method works; sloppy practice does not.

    Every year or so, a headline declares research dead: surveys lie, users cannot tell you what they want, testing is theater. The body text usually carries the nuance, pointing at poorly run studies with bad recruitment or leading questions. But readers keep the headline and skip the nuance, and teams hunting for budget cuts find a convenient conclusion: research can be safely skipped. The actual failure is bad research, not research. The distinction sounds pedantic until you price what replaces the discipline once it is gone.

    Why it matters to the business

    The evidence points at execution, not the discipline. Forrester's State of VoC research found only 12% of CX professionals rate their program's maturity as high, and 71% say theirs is not fully or mostly effective at driving action. McKinsey found just 6% of firms are confident their CX measurement informs decisions. Those are fixable practice failures, and they are what the headlines are really describing.

    Skipping research does not remove the risk; it hides it. Bain's classic study found 80% of companies believed they delivered a superior experience while only 8% of customers agreed. That is what deciding without evidence looks like. The alternative to rigorous research is not speed; it is the loudest opinion in the room.

    How to use it

    • When a study fails, audit the execution first: recruitment quality, question bias, task realism.
    • Triangulate self-report with behavioral data before acting; attitudes mislead more often than transactions do.
    • Run cheap iterative testing: Nielsen Norman Group research shows 5 users surface about 85% of usability problems, so three small rounds beat one big study.
    • Keep a running log of decisions research changed and mistakes it prevented; that log defends next year's budget.
    • Frame the budget conversation as rigor versus rework, never research versus speed.

    Where teams get it wrong

    Teams read one debunking article and cancel the discipline, then replace evidence with opinion and hierarchy. Six months later the same team pays for the skipped study several times over in rework, missed launches, and features nobody uses. The myth saved a five-figure study and bought a seven-figure mistake.

    Ask your team

    • The last time research did not work here, was the method wrong or the execution?
    • What decision would we have gotten wrong this year without customer research?
    • Who audits our studies for recruitment quality and question bias?

    The choice was never research versus no research. It is rigorous research versus costly mistakes.

    Apply this

    Reading about research isn't broken; bad research is is one thing. Seeing where it applies in your journey is the useful part.

    Related signals