Your reviews are not one pool. Treating them like one costs conversions.
Reviews for several different models were pooled into a single feed. The rating looked excellent and the content was useless to the buyer reading it, which is the worst of both worlds: it looks like proof and works like noise.
Reviews are the most persuasive content on a product page and the least examined. Most brands measure how many they have and what the average rating is. Almost nobody measures whether the reviews on a given page are about the product on that page.
What we found
We ran test buyers against a kitchen appliance brand's product pages ahead of peak season. Reviews for several blender models were pooled into one shared feed.
So a buyer evaluating the compact model read reviews written by people who bought the professional model, for a different job, with different expectations. The rating was strong. The reviews were about something else.
Test buyers noticed and said so. Several described scrolling for something relevant, not finding it, and losing confidence rather than gaining it. One effect of pooled reviews is that a shopper cannot tell whether the product in front of them is any good, and now also cannot tell whether the brand is being straight with them.
A five star average built from the wrong product is not social proof. It is a rating you cannot use.
What the research says the reviews are doing
Reviews carry more conversion weight than almost anything else on the page. Northwestern University's Spiegel Research Center, analyzing around 57,000 products, found that adding the first review lifts conversion by roughly 65% on average, rising to about 190% for products over $100 and around 45% for products under $25.
The same research found the highest converting star ratings are not perfect ones. The sweet spot sits between 4.2 and 4.5 stars, and ratings above 4.7 convert slightly worse, because near-perfect scores read as filtered.
Both findings point at the same mechanism. Reviews work when they look like evidence from someone in the buyer's situation. They stop working when they look like marketing.
Pooling breaks the mechanism in three ways
- Fit questions go unanswered. For anything sized, specified, or capacity-bound, the buyer's question is not is this good. It is is this right for my kitchen, my batch size, my counter. A pooled feed cannot answer that, because the answer depends on which model the reviewer bought.
- The rating stops meaning anything. An average across models measures the portfolio, not the item. A weak product hides behind a strong one, which is good for exactly one quarter and bad afterwards, when returns arrive.
- Careful buyers detect it. The buyers most likely to read reviews closely are the ones most likely to notice a review describing a different product. What they learn is not about the blender.
What to do instead
- Scope reviews to the model by default. Give the buyer the option to widen to the family, clearly labelled, rather than defaulting to a merged feed.
- Show which product the reviewer bought. If any pooling remains, label every review with its model. A small piece of metadata restores most of the lost trust.
- Let buyers filter by their situation. Use case, household size, frequency. Relevance beats volume once a product has enough reviews to be credible at all.
- Check the anchors. While you are in there, verify that every link labelled Reviews actually goes to the reviews. We have found one that went to the FAQ.
The season argument
Peak season traffic contains an unusually high share of first-time buyers and gift buyers, and both lean harder on reviews than a returning customer does. They have no experience with your brand to fall back on, so reviews do the entire job of establishing whether this specific product is the right one.
A pooled feed underperforms all year. In November it underperforms on the traffic you paid the most for.
eLLMo runs test buyers matched to your real customers against your page and reports what they went looking for and did not find. Review relevance surfaces constantly, because buyers narrate the search. See a live run before your peak traffic starts reading.
*Related Links: 50 Cart Abandonment Rate Statistics (Baymard Institute). Review conversion findings are from Northwestern University's Spiegel Research Center analysis of approximately 57,000 products.*
See this in action on your page
eLLMo runs test buyers against your product page and returns a ranked list of what stops people from buying.
More from the blog