Survivorship Bias in Customer Reviews

What survivorship bias looks like on a product page

The term comes from a simple trap: you study the ones that made it through and forget the ones that did not. In shopping, the people who bought a supplement and felt nothing, forgot about it or quietly gave up rarely write anything. The ones who did write are often the keenest.

So a wall of enthusiastic comments can feel like a verdict, when it is closer to a highlights reel. The missing voices are the largest part of the picture, and you cannot see them.

Who actually writes a review?

People tend to post when they feel strongly, when they were asked to, or when they gain something by posting. Someone with a mild, unremarkable experience has little reason to bother. Others may be rewarded by a seller, a reseller or a referral scheme without it being obvious.

None of this makes every reviewer dishonest. It simply means the group writing is not a random slice of buyers, so their enthusiasm cannot be treated as an average.

• Very happy customers who want to share
• Very unhappy customers who want to warn others
• People prompted by an email or a reward
• Paid or incentivised writers
• People who simply liked the idea of the product

How a seller's page filters what you see

On a page the seller controls, the seller decides what appears. Comments can be selected, trimmed, reordered or simply never published if they are lukewarm. A page that shows only warm words has probably been curated, even if every single line is genuine.

That is why a seller's own testimonials are better treated as marketing than as evidence. When reading what the seller says about ProDentim, remember that its pages describe a chewable oral probiotic as the seller sells it, and that the seller's statements about it are claims that have not been verified.

Why oral probiotics make this problem sharper

Mouth health changes slowly and for many reasons at once: brushing, diet, smoking, dental work and ordinary variation. Someone who starts a supplement and also tidies up their routine may credit the supplement for what the routine achieved.

Research on oral probiotics is still developing and the evidence is limited or mixed, and effects are specific to particular strains. A reviewer's contentment therefore cannot show whether the product caused anything, and survivorship bias reviews only widen that gap.

A checklist for reading reviews more fairly

Start by asking who is speaking and who is missing. Look for detail rather than adjectives, for any mention of downsides, and for signs that comments were prompted. Treat a page with no criticism at all as a warning, not as a reassurance.

Then ask what the review could not possibly tell you. It cannot tell you about your gums, your medicines or your history. Write down what remains uncertain and take that list to your dental team, who can look in your mouth.

• Is any negative or neutral feedback shown?
• Do comments contain checkable detail?
• Could the writer have been rewarded?
• Does the praise credit the product or just the routine?
• What would this person not know about me?

Questions readers ask