Does Reddit actually get brands recommended by AI?

Everyone is billing brands to “do Reddit” for AI visibility. Nobody has shown whether Reddit being read actually changes what the AI recommends. In this data: Reddit was in the room only 4% of the time, and where it was, the brands the AI recommended barely changed. Paying to “do Reddit” is buying a lever this data can’t find.

Citations aren’t recommendations

The public datasets that count citations don’t test whether a brand gets recommended. They count when a source URL appears in an AI answer — a different thing from whether the AI names your brand.

Suganthan read ChatGPT’s network traffic directly (one logged-in account, roughly 1,240 records — directional, not a population) and found that fetching, citing, and mentioning are three separate things you can win or lose independently. Reddit was fetched 278 times but cited only 11 times; YouTube was fetched 201 times and cited zero times. The mechanical reason: a citation binds to text the model pulled, and a Reddit thread is full text while a YouTube search result is only metadata.

Ahrefs analyzed 1.4 million ChatGPT prompts and reported per-channel citation rates: search 88.46%, news 12.01%, reddit 1.93%, youtube 0.51%, academia 0.40%. These are rates per channel, not a share — they don’t sum to 100%. There were roughly 16.57 cited URLs per prompt, and 67.8% of URLs that were fetched but never cited were Reddit.

The step the public datasets don’t test: does Reddit being read turn into being recommended?

Never tested until now: read versus recommended

Before analysis ran, we registered one number: the difference in brand-recommendation rate between AI calls where Reddit was in what the system read and calls where it wasn’t. The scope was skincare, OpenAI and Anthropic, day-0 of the study. A preview of the logs had checked fetch rates before this registration, but it did not lock the estimate. The unit of analysis is a call-by-brand opportunity — for each AI call, each real brand that could be recommended counts as one opportunity, so a single call can contain several.

Whether Reddit was read was not randomly assigned; retrieval is driven by the query and session, not by us. Comparing calls within the same category, phrasing variant, and study run removes those structural differences. It does not remove differences the query itself drives within each group.

Reddit fetched 4% of the time, recommendations barely moved

Reddit pages were in what the AI read before answering in 4.04% of calls. The registered difference in brand-recommendation rate between calls with Reddit read and calls without was +0.0024 (full precision 0.002365) — near zero, with an illustrative 95% interval from −0.075 to +0.079 that straddles zero. This interval is not a calibrated coverage statement; it is illustrative for two reasons explained below. At 4.04% presence and a +0.0024 shift, Reddit barely shows up — and where it does, it moves recommendations by essentially nothing.

At 4%, scarcity is the finding

By the criterion of having enough cases to estimate — 8 comparison groups, 264 brand opportunities where Reddit was read versus 3,000 where it wasn’t, 130 recommended events versus 1,314 — the data was analyzable. But a rule we registered before analysis said that when Reddit shows up in fewer than 5% of calls, the scarcity itself is the finding, because a re-run cannot manufacture retrieval that doesn’t happen. At 4.04%, that rule applied, and the result publishes as “barely present.”

All 264 brand opportunities where Reddit was read came from OpenAI — 8.09% of OpenAI’s calls. Anthropic fetched zero reddit.com pages on day-0. The direction of the difference split six negative, two positive across the 8 comparison groups, ranging from −0.0925 to +0.1361.

Skincare, one day: a narrow slice

This is one category (skincare), one day, two study runs, with Reddit variation coming entirely from OpenAI. Gemini was excluded because its API hides which URLs it fetched, and this analysis compares recommendations conditional on observed retrieval. Thirty-eight calls where nothing was fetched were counted as not-Reddit-fetched in the denominator.

The interval is illustrative, not a calibrated coverage statement, for two reasons. First, within a single call, up to 8 brand opportunities are correlated — they share the same query and context — so the effective sample is closer to the call count than to the 264-versus-3,000 opportunity split, which makes the interval too tight. Second, between comparison groups, the same brands recur, and each brand’s fixed tendency to be recommended correlates the group-level differences. Neither correlation biases the central estimate of +0.0024; both make the spread around it too narrow.

We did not switch to a more conservative method for estimating that spread — a cluster-adjusted or resampling-based approach — because both would break the no-resampling, no-random-seed rule the entire research program runs under.

This is an association, not a cause. An estimate this close to zero with a sample this thin means we could not detect a signal — not that there is no signal.

Reddit isn’t the recommendation lever it’s sold as

On this evidence, a skincare brand should not buy “do Reddit” as a recommendation lever for AI visibility. The recommendation-level signal isn’t here to optimize. The move: find where retrieval actually happens in your category and spend there.

Pre-registered re-analysis, zero new measurement spend

This is a re-analysis of an earlier skincare study’s call logs, pre-registered at commit cfb1956 before analysis ran. The unit is a call-by-real-brand opportunity. Within each comparison group — defined by category, phrasing variant, and study run — we differenced the recommendation rate between calls where Reddit was read and calls where it wasn’t, then pooled across 8 groups. The spread around that pooled estimate was 0.039253, computed by a standard formula rather than by resampling.

Invented control brands ran alongside the real ones; they were never recommended and never fetched. Zero new measurement spend.

Deviations

Deviations: the rule about publishing as “barely present” below 5% fetch rate was added after a diagnostic preview of the logs (which showed a 4.04% rate, 8 groups, 264 versus 3,000 opportunities) but before the pre-registration commit and before analysis — the preview did not lock the estimate. Anthropic’s zero Reddit fetches were unanticipated; the pooled estimate still combines both study runs. The Ahrefs figure was reworded once to match the source (per-channel rate, not a share) and re-verified.