User-agent: Yandex Allow: / Crawl-delay: 10 # AI Search Crawlers — allow for AI Overview / ChatGPT / Perplexity visibility User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / # Block training-data crawlers (content protection) User-agent: CCBot Disallow: / User-agent: anthropic-ai Disallow: / User-agent: * Disallow: /admin Disallow: /admin/ Disallow: /dashboard Disallow: /profile Disallow: /marketing-materials/ Disallow: /certification-exams/ Disallow: /teacher-information/ Disallow: /team/presentation-outline/ Crawl-delay: 2 Sitemap: https://www.barralinstitute.com/sitemap.xml