Research validity
Why production-real stimuli change the result.
A research study is only as honest as the thing you put in a shopper’s hand. A production-matched comp gives a clean read. A slightly-off mock gives confident, wrong answers.
You commission the study, recruit the shoppers, design the questions, and then hand people a stimulus that’s “close enough.” That last decision quietly decides whether the whole study tells you the truth. It is the least visible line in the plan and the one that determines what every other line is worth.
A production-matched comp gives you a clean read. A crude or slightly-off mock gives you confident, wrong answers, and it charges you for them after launch, when the shelf disagrees with the deck.
The fork
Same study, same shoppers, two different truths.
One object separates a decision you can trust from a launch that fails at shelf. The stimulus is the study.
Why close-enough corrupts the data
Clean-looking data, pointed the wrong way.
Shoppers respond to the whole object, color, finish, weight, structure, not just the artwork. A mock that’s off on finish or color changes how the pack feels, which changes how people react, which changes your result.
And here’s the trap. You don’t get obviously noisy data that you’d know to distrust. You get clean-looking data pointed in the wrong direction, which is worse, because you’ll trust it and act on it. A study that looks like it ran perfectly can be measuring a pack that will never exist.
The trap
Change the physical thing, even a little, and you’ve changed the answer without changing a single question.
The reaction you’re paying to capture is a reaction to a physical thing. Noisy data warns you. Clean data that measures the wrong object does not. It gives a green light that should never have been green.
In-context research lives or dies on what you put in a shopper’s hand.Luke Cahill
The expensive version of this mistake
The stimulus is the least expensive line, and the one that invalidates the study.
A study run on a not-quite-real stimulus reads positive. The launch goes ahead. The shelf disagrees, because shoppers were reacting to a pack that never shipped. The most expensive mistake looks like a success: the study measured a ghost.
Trimming the stimulus to save a few hundred dollars is how a six-figure decision gets corrupted, and the corruption is invisible until the product is on the shelf and the numbers don’t match the research. By then the study has already done its damage. It gave a green light that shouldn’t have been green.
What production-real means, and when you need it
The more the decision depends on the answer, the more the stimulus has to be real.
Production-real means matched on the things a shopper actually responds to, color, substrate, finish, and structure, at the fidelity the decision requires. Not every study needs a full production match. A quick directional read can run on less.
When the stimulus has to be real
Any study whose result will move a decision needs a production-real stimulus.
Go or no-go on shipping the pack.
Commit to a new look on shelf.
Willingness to pay against the object.
Production runs behind the result.
You wouldn’t test a product formula you didn’t plan to ship. Don’t test a pack you didn’t either. The stimulus is the study, and if it isn’t real, neither is the result.
A close-enough mock guesses.A production-real comp decides.
The stimulus is the one line in a research budget that decides whether the study is valid. 3D Color builds production-real research stimuli matched on color, substrate, finish, and structure, so shoppers react to the pack that ships, not one that never will.
If a study is about to move a launch, a greenlight, a price, or an inventory commitment, the stimulus is the line to get right first.
Reach Bob directly · bob.jennings@3dcolor.com
Test the pack that ships
Make the stimulus real before the study decides anything.
3D Color produces production-real research stimuli, comps, prototypes, and sales samples for CPG brands. When a study is going to move a launch or a greenlight, we match color, substrate, finish, and structure so shoppers react to the pack that will actually reach the shelf, not one that never ships.
Bob Jennings, CEO of 3D Color
Bob Jennings is the CEO of 3D Color, where comps, prototypes, and sales samples are 100 percent of the business. If a study is about to move a launch and the stimulus isn’t production-real yet, he’s the person to reach.
Reach Bob directly