hedman.com
robots.txt

Robots Exclusion Standard data for hedman.com

Resource Scan

Scan Details

Site Domain hedman.com
Base Domain hedman.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-17T21:10:28+00:00
Next Scan 2024-06-16T21:10:28+00:00

Last Successful Scan

Scanned2024-01-25T21:09:15+00:00
URL https://hedman.com/robots.txt
Redirect https://www.hedman.com/robots.txt
Redirect Domain www.hedman.com
Redirect Base hedman.com
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 151.101.194.132
Found Yes
Hash a8854a176ff1ba500076e17f8e3589c9e85c824d68e481f3e4f7c44b1aab12eb
SimHash 625d9881d093

Groups

*

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

ahrefsbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.hedman.com/sitemap.xml