User-agent: * Allow: / # Tracking parameters create duplicate URLs with no unique content. Disallow: /*?*fbclid= Disallow: /*?*gclid= Disallow: /*?*utm_ # AI assistants and AI-powered search are explicitly allowed to read the site. # These crawlers already fall under "User-agent: *" above; naming them records # the decision so nobody later assumes they were meant to be blocked. # Allowing them is what makes the site eligible to be read and cited. It does # not make an assistant recommend CTD - see the handover notes on that. User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / Sitemap: https://www.ctdscotland.com/sitemap.xml