saveriodiriccistore.com
robots.txt

Robots Exclusion Standard data for saveriodiriccistore.com

Resource Scan

Scan Details

Site Domain saveriodiriccistore.com
Base Domain saveriodiriccistore.com
Scan Status Ok
Last Scan2024-09-09T15:49:47+00:00
Next Scan 2024-10-09T15:49:47+00:00

Last Scan

Scanned2024-09-09T15:49:47+00:00
URL https://saveriodiriccistore.com/robots.txt
Redirect https://www.saveriodiriccistore.com/robots.txt
Redirect Domain www.saveriodiriccistore.com
Redirect Base saveriodiriccistore.com
Domain IPs 104.21.7.232, 172.67.188.21, 2606:4700:3032::ac43:bc15, 2606:4700:3035::6815:7e8
Redirect IPs 104.21.7.232, 172.67.188.21, 2606:4700:3032::ac43:bc15, 2606:4700:3035::6815:7e8
Response IP 172.67.188.21
Found Yes
Hash ba93efec546e95eed0ec50cab1c0fce69bd751395e34a26e8fe4a8906fc55561
SimHash 6861f91506b5

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler

Rule Path
Disallow /WebSite/ScriptResource.axd
Disallow /WebSite/WebResource.axd
Disallow /CustomErrorPages/NoPage.aspx
Disallow /CustomErrorPages/404.aspx
Disallow /CustomErrorPages/500.aspx
Disallow /busqueda/
Disallow /store/
Disallow /mi-cuenta/cerrar-sesion
Disallow /hombres/mi-cuenta/cerrar-sesion
Disallow /mujeres/mi-cuenta/cerrar-sesion
Disallow /ninos/mi-cuenta/cerrar-sesion

Other Records

Field Value
sitemap /sitemap

Comments

  • disallow all
  • but allow only important bots
  • Files
  • Rutes