fazer-hispania.com
robots.txt

Robots Exclusion Standard data for fazer-hispania.com

Resource Scan

Scan Details

Site Domain fazer-hispania.com
Base Domain fazer-hispania.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-24T11:48:17+00:00
Next Scan 2024-10-01T11:48:17+00:00

Last Successful Scan

Scanned2024-09-16T11:44:50+00:00
URL https://fazer-hispania.com/robots.txt
Redirect https://www.fazer-hispania.com/robots.txt
Redirect Domain www.fazer-hispania.com
Redirect Base fazer-hispania.com
Domain IPs 82.223.29.84
Redirect IPs 82.223.29.84
Response IP 82.223.29.84
Found Yes
Hash c0299933d7c516eff1e5ebaae858b4eed7b40ce7b84b21a823d87782c790cce3
SimHash 125ed2226032

Groups

aspiegelbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

wijubot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /