Marketing

Content personalization

Changing the page per visitor. Fine for apps. Risky if the crawler sees a different, empty, or bait page.

Cloaking for bots is a good way to disappear. Give crawlers the honest default.

Logged-in prices that bots never see will not get quoted.

Examples

  • A geo-IP page shows US pricing to Googlebot and nothing useful to PerplexityBot from another ASN. Citations go generic.

Related terms

AI web crawlers

Bots from model labs and answer engines that fetch pages for training, retrieval, or user-initiated reading.
JavaScript rendering for AI crawlers

Whether a bot executes JS. Many AI crawlers are worse at this than Googlebot. If the article is empty without JS, you are invisible.
Page experience

Google’s bundle of vitals, HTTPS, mobile, intrusive ads. Agents hate intrusive ads even more than Google does.

FAQ

Personalize at all? +

Yes behind the login. Public marketing pages should have a complete default HTML.

Track this in Reddex

See Reddit threads and AI answers for your brand in one place. Start with a free analysis.

Get started