bizarrostore.com
robots.txt

Robots Exclusion Standard data for bizarrostore.com

Resource Scan

Scan Details

Site Domain bizarrostore.com
Base Domain bizarrostore.com
Scan Status Ok
Last Scan2024-06-02T02:06:43+00:00
Next Scan 2024-07-02T02:06:43+00:00

Last Scan

Scanned2024-06-02T02:06:43+00:00
URL https://bizarrostore.com/robots.txt
Redirect https://www.bizarrostore.com/robots.txt
Redirect Domain www.bizarrostore.com
Redirect Base bizarrostore.com
Domain IPs 104.21.53.54, 172.67.209.35, 2606:4700:3032::ac43:d123, 2606:4700:3037::6815:3536
Redirect IPs 104.21.53.54, 172.67.209.35, 2606:4700:3032::ac43:d123, 2606:4700:3037::6815:3536
Response IP 104.21.53.54
Found Yes
Hash ba93efec546e95eed0ec50cab1c0fce69bd751395e34a26e8fe4a8906fc55561
SimHash 6861f91506b5

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 600

googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
slurp
yahoo-blogs
yahoo-mmcrawler

Rule Path
Disallow /WebSite/ScriptResource.axd
Disallow /WebSite/WebResource.axd
Disallow /CustomErrorPages/NoPage.aspx
Disallow /CustomErrorPages/404.aspx
Disallow /CustomErrorPages/500.aspx
Disallow /busqueda/
Disallow /store/
Disallow /mi-cuenta/cerrar-sesion
Disallow /hombres/mi-cuenta/cerrar-sesion
Disallow /mujeres/mi-cuenta/cerrar-sesion
Disallow /ninos/mi-cuenta/cerrar-sesion

Other Records

Field Value
sitemap /sitemap

Comments

  • disallow all
  • but allow only important bots
  • Files
  • Rutes