# --------------------------------------------------------------------------- # Default rule for all crawlers: keep account/cart/checkout flows and # duplicate filtered-URL parameters out of the index, allow everything else. # --------------------------------------------------------------------------- User-agent: * Disallow: /cart Disallow: /checkout Disallow: /account Disallow: /login Disallow: /forgot-password Disallow: /wishlist Disallow: /order-history Allow: / # --------------------------------------------------------------------------- # AI search / answer engines — explicitly allowed. These fetch pages to # answer user questions in-product (e.g. ChatGPT search, Perplexity, # Google AI Overviews) rather than only building a training corpus. # --------------------------------------------------------------------------- User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / User-agent: Amazonbot Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / # --------------------------------------------------------------------------- # General-purpose AI training crawlers. Left open here since the goal is # broader AI visibility, but review this block if you'd rather your content # not be used for third-party model training specifically (as opposed to # live answer-engine lookups) — change the corresponding "Allow: /" to # "Disallow: /" for any agent below. # --------------------------------------------------------------------------- User-agent: CCBot Allow: / User-agent: Diffbot Allow: / User-agent: Bytespider Allow: / User-agent: cohere-ai Allow: / User-agent: Timpibot Allow: / # --------------------------------------------------------------------------- # Pointers for crawlers and LLMs # --------------------------------------------------------------------------- Sitemap: https://aluminatelife.com/sitemap.xml Sitemap: https://aluminatelife.com/product-sitemap.xml Sitemap: https://aluminatelife.com/blog-sitemap.xml Sitemap: https://aluminatelife.com/page-sitemap.xml Sitemap: https://aluminatelife.com/ebook-sitemap.xml