# Robots.txt optimizado para Ruby on Rails # Dominio: visitmataro.cat # 1. BOTS DE IA User-agent: GPTBot Disallow: User-agent: ChatGPT-User Disallow: User-agent: Google-Extended Disallow: User-agent: Claude-Web Disallow: User-agent: PerplexityBot Disallow: # 2. BUSCADORES PRINCIPALES (SEO) User-agent: Googlebot Disallow: User-agent: Bingbot Disallow: User-agent: DuckDuckBot Disallow: # 3. REGLA GENERAL Y SEGURIDAD User-agent: * Allow: / # Bloquear rutas comunes de gestión y sistema Disallow: /admin/ Disallow: /login Disallow: /signup Disallow: /password/ Disallow: /rails/active_storage/ Disallow: /rails/info/ Disallow: /rails/mailers/ # Sitemap Sitemap: https://visitmataro.cat/sitemap.xml