XML sitemaps
A list of URLs you want fetched. Still worth having. AI bots may use them, or not. They cannot fix Disallow.
Keep them honest. Lastmod should mean lastmod.
This glossary should appear in a sitemap chunk of its own.
Examples
- Sitemap lists 90,000 faceted URLs. Bots get lost. Money docs wait.
Related terms
How much a bot is willing to fetch. AI bots can be greedier or pickier than Googlebot. Faceted URLs still waste everyone’s time.
Discover, fetch, store. Google does it. AI labs do it with other bots and rules. You need both if you want both channels.
A ping protocol so participating engines fetch changed URLs faster. Bingy. Not a ChatGPT button.
FAQ
Sitemap for GPTBot? +
One sitemap for humans’ engines. Don’t maintain a secret AI sitemap unless you like extra work. Do allow the bot.
Track this in Reddex
See Reddit threads and AI answers for your brand in one place. Start with a free analysis.
Get started