# Bloquear bots que no nos interesan User-agent: ShopWiki User-agent: Accelobot User-agent: SapphireWebCrawler User-agent: dotbot User-agent: Charlotte User-agent: kalooga User-agent: HTTrack User-agent: Linguee User-agent: ltx71 User-agent: Megaindex User-agent: BLEXBot User-agent: sogou spider User-agent: proximic User-agent: domaincrawler User-agent: MJ12bot Disallow: / # Limitar bingbot (1-Slow ... 10-Extremely Slow) User-agent: bingbot Crawl-delay: 5 # Limitar Yandex (0.5 seconds ... X seconds, etc.) User-agent: Yandex Crawl-delay: 2 # Bloquear path específicos para el resto de bots User-agent: * Allow: / Disallow: */search_results.php* Disallow: */geotest.php Disallow: */obra.php* Disallow: */*-precio-* Disallow: */clases/ Disallow: */code/ Disallow: */newsletter/ Disallow: */templates/ Disallow: */locales/ Disallow: */inicio/ Disallow: */autor-seguido-por* Disallow: */imgdownload.php* Disallow: */coleccion/ Disallow: */colecciones/ Disallow: */autor-seguidores/ Disallow: */menu_* Disallow: */obra-favorita/ Disallow: */critica.php* Disallow: */contacto.php* Disallow: */tags* Disallow: */artwork-followers* Disallow: */followers* Disallow: */favorite* Disallow: */calendar* Disallow: */*-price-* Disallow: */s/ Disallow: */votar.php* Disallow: */agenda* Disallow: */grandes-maestros/catalogo/* Disallow: */great-masters/catalogue/* Disallow: */landings/ Disallow: */1004183/