dunkshoes.net.br
robots.txt

Robots Exclusion Standard data for dunkshoes.net.br

Resource Scan

Scan Details

Site Domain dunkshoes.net.br
Base Domain dunkshoes.net.br
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-19T02:26:30+00:00
Next Scan 2024-11-17T02:26:30+00:00

Last Successful Scan

Scanned2023-04-04T18:08:34+00:00
URL https://www.dunkshoes.net.br/robots.txt
Domain IPs 18.155.68.100, 18.155.68.37, 18.155.68.55, 18.155.68.69
Response IP 18.155.68.69
Found Yes
Hash 0d153db7b7c08d84802097b8d3c5a2091ebdb261fc443112bb0a5b0301c428fb
SimHash 6a0cc002e2b0

Groups

*

Rule Path
Disallow /central/*
Disallow /carrinho/*
Disallow /checkout/*

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Allow /

*

Rule Path
Disallow /cdn/assets/