lentillasbaratas.es
robots.txt

Robots Exclusion Standard data for lentillasbaratas.es

Resource Scan

Scan Details

Site Domain lentillasbaratas.es
Base Domain lentillasbaratas.es
Scan Status Ok
Last Scan2024-05-16T21:02:03+00:00
Next Scan 2024-06-15T21:02:03+00:00

Last Scan

Scanned2024-05-16T21:02:03+00:00
URL https://www.lentillasbaratas.es/robots.txt
Domain IPs 13.226.2.29, 13.226.2.42, 13.226.2.52, 13.226.2.61, 2600:9000:265c:1000:b:4416:fa00:93a1, 2600:9000:265c:2400:b:4416:fa00:93a1, 2600:9000:265c:2c00:b:4416:fa00:93a1, 2600:9000:265c:6a00:b:4416:fa00:93a1, 2600:9000:265c:7e00:b:4416:fa00:93a1, 2600:9000:265c:800:b:4416:fa00:93a1, 2600:9000:265c:f800:b:4416:fa00:93a1, 2600:9000:265c:fe00:b:4416:fa00:93a1
Response IP 18.165.171.99
Found Yes
Hash f1c024a62e4aff3af3d5ae01a75909a7aa556b8ce0a372bac19a964c62e8021c
SimHash 200ce8008303

Groups

nutch

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

spiderbot/nutch-1.7

Rule Path
Disallow /

nutch-1.4

Rule Path
Disallow /

exabot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /product.php*
Disallow /client/*
Disallow /checkout/*
Disallow /conseils-sante/wp-json/*
Disallow /shoppingcart.php*
Disallow *?noredirect
Disallow /lentilles-de-contact/pure-vision.html
Disallow /faq.php
Disallow *?type*
Disallow /lentes-de-contacto/optix.html
Disallow /partners/ciba_finder/finder/frage1.php
Disallow *?setMobileVersion*

Other Records

Field Value
sitemap https://www.lentillasbaratas.es/sitemap.xml