granit-parts.cz
robots.txt

Robots Exclusion Standard data for granit-parts.cz

Resource Scan

Scan Details

Site Domain granit-parts.cz
Base Domain granit-parts.cz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-01T13:01:08+00:00
Next Scan 2024-10-15T13:01:08+00:00

Last Successful Scan

Scanned2024-04-22T10:54:38+00:00
URL https://granit-parts.cz/robots.txt
Redirect https://www.granit-parts.cz/robots.txt
Redirect Domain www.granit-parts.cz
Redirect Base granit-parts.cz
Domain IPs 104.18.34.21, 172.64.153.235, 2606:4700:4400::6812:2215, 2606:4700:4400::ac40:99eb
Redirect IPs 104.18.34.21, 172.64.153.235, 2606:4700:4400::6812:2215, 2606:4700:4400::ac40:99eb
Response IP 104.18.34.21
Found Yes
Hash 4e99fd625ebf1aa9743e26d1304ff646829a715d34a68c116d06afdd9185ddb7
SimHash ca7edc20e618

Groups

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10