# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: / Allow: /buscar Disallow: /cas/ #Permitir GPTBot (OpenAI) User-agent: GPTBot Allow: / Allow: /noticias/* Disallow: /cas/ # Permitir otras IA User-agent: CCBot Allow: / Allow: /noticias/* Disallow: /cas/ User-agent: ClaudeBot Allow: / Allow: /noticias/* Disallow: /cas/ User-agent: Google-Extended Allow: / Allow: /noticias/* Disallow: /cas/ Sitemap: https://www.carroya.com/sitemap.xml