shredshop.com
robots.txt

Robots Exclusion Standard data for shredshop.com

Resource Scan

Scan Details

Site Domain shredshop.com
Base Domain shredshop.com
Scan Status Ok
Last Scan2024-09-17T04:06:44+00:00
Next Scan 2024-10-17T04:06:44+00:00

Last Scan

Scanned2024-09-17T04:06:44+00:00
URL https://shredshop.com/robots.txt
Redirect https://www.shredshop.com/robots.txt
Redirect Domain www.shredshop.com
Redirect Base shredshop.com
Domain IPs 89.106.200.1
Redirect IPs 13.227.254.24, 13.227.254.44, 13.227.254.51, 13.227.254.62, 2600:9000:200a:5e00:1d:63:3dc0:93a1, 2600:9000:200a:7c00:1d:63:3dc0:93a1, 2600:9000:200a:8600:1d:63:3dc0:93a1, 2600:9000:200a:9200:1d:63:3dc0:93a1, 2600:9000:200a:be00:1d:63:3dc0:93a1, 2600:9000:200a:e600:1d:63:3dc0:93a1, 2600:9000:200a:ee00:1d:63:3dc0:93a1, 2600:9000:200a:fa00:1d:63:3dc0:93a1
Response IP 13.227.254.51
Found Yes
Hash 02813dd01ccb4a5680692869e272df529d23adfbfc6d027ab5428d9bcdff7094
SimHash e718ed474d95

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /Sistema/*
Disallow /checkout/*
Disallow /*checkout?*
Disallow /*checkout/cart/add?*
Disallow /busca/*
Disallow /*busca?*
Disallow /buscapagina/*
Disallow /quick-view/*
Disallow /espiar/*
Disallow /search?_query=*

Other Records

Field Value
sitemap http://janus-edge.vtex.com.br/sitemap.xml?an=shredshop

Comments

  • Disallow all crawlers access to certain pages.