granit-parts.com
robots.txt

Robots Exclusion Standard data for granit-parts.com

Resource Scan

Scan Details

Site Domain granit-parts.com
Base Domain granit-parts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-07T02:43:29+00:00
Next Scan 2024-06-21T02:43:29+00:00

Last Successful Scan

Scanned2024-05-02T01:31:49+00:00
URL https://granit-parts.com/robots.txt
Redirect https://www.granit-parts.com/robots.txt
Redirect Domain www.granit-parts.com
Redirect Base granit-parts.com
Domain IPs 104.18.36.85, 172.64.151.171, 2606:4700:4400::6812:2455, 2606:4700:4400::ac40:97ab
Redirect IPs 104.18.36.85, 172.64.151.171, 2606:4700:4400::6812:2455, 2606:4700:4400::ac40:97ab
Response IP 172.64.151.171
Found Yes
Hash 4e99fd625ebf1aa9743e26d1304ff646829a715d34a68c116d06afdd9185ddb7
SimHash ca7edc20e618

Groups

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10