lentillesmoinscheres.com
robots.txt

Robots Exclusion Standard data for lentillesmoinscheres.com

Resource Scan

Scan Details

Site Domain lentillesmoinscheres.com
Base Domain lentillesmoinscheres.com
Scan Status Ok
Last Scan2024-05-24T01:27:14+00:00
Next Scan 2024-06-23T01:27:14+00:00

Last Scan

Scanned2024-05-24T01:27:14+00:00
URL https://lentillesmoinscheres.com/robots.txt
Redirect https://www.lentillesmoinscheres.com/robots.txt
Redirect Domain www.lentillesmoinscheres.com
Redirect Base lentillesmoinscheres.com
Domain IPs 217.70.184.55
Redirect IPs 13.226.2.27, 13.226.2.4, 13.226.2.66, 13.226.2.97, 2600:9000:2163:1e00:1:df6f:f740:93a1, 2600:9000:2163:200:1:df6f:f740:93a1, 2600:9000:2163:2400:1:df6f:f740:93a1, 2600:9000:2163:2600:1:df6f:f740:93a1, 2600:9000:2163:4800:1:df6f:f740:93a1, 2600:9000:2163:5200:1:df6f:f740:93a1, 2600:9000:2163:c800:1:df6f:f740:93a1, 2600:9000:2163:e800:1:df6f:f740:93a1
Response IP 108.157.60.34
Found Yes
Hash 856680d49974a72ac6df580ef6c1e1f57750bb8c80e7a1f1d1a66f636dd1db80
SimHash 108cea008313

Groups

nutch

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

spiderbot/nutch-1.7

Rule Path
Disallow /

nutch-1.4

Rule Path
Disallow /

exabot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

*

Rule Path
Disallow /product.php*
Disallow /client/*
Disallow /checkout/*
Disallow /conseils-sante/wp-json/*
Disallow /shoppingcart.php*
Disallow *?noredirect
Disallow /lentilles-de-contact/pure-vision.html
Disallow /faq.php
Disallow *?type*
Disallow /lentes-de-contacto/optix.html
Disallow /partners/ciba_finder/finder/frage1.php
Disallow *?setMobileVersion*

Other Records

Field Value
sitemap https://www.lentillesmoinscheres.com/sitemap.xml