# AI training crawlers: no access. User-agent: GPTBot User-agent: ClaudeBot User-agent: CCBot User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: meta-externalagent User-agent: Amazonbot User-agent: PetalBot User-agent: DataForSeoBot User-agent: SemrushBot User-agent: KeenableBot User-agent: AhrefsBot User-agent: DotBot Disallow: / # Everyone else: skip filtered, searched and printable variants of the catalogue. # Canonical catalogue URLs carry no query string; filtered ones are already noindex. User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php Disallow: /catalogo/*? Disallow: /en/catalogo/*? Disallow: /fr/catalogo/*? Disallow: /productos/*? Disallow: /en/productos/*? Disallow: /fr/productos/*? Disallow: /productos/null Disallow: /*?s= Disallow: /*&s= Crawl-delay: 5 Sitemap: https://prestoiberica.com/wp-sitemap.xml