livernoismotorsports.com
robots.txt

Robots Exclusion Standard data for livernoismotorsports.com

Resource Scan

Scan Details

Site Domain livernoismotorsports.com
Base Domain livernoismotorsports.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-29T12:31:09+00:00
Next Scan 2024-12-28T12:31:09+00:00

Last Successful Scan

Scanned2023-11-20T08:47:14+00:00
URL https://livernoismotorsports.com/robots.txt
Redirect https://www.livernoismotorsports.com/robots.txt
Redirect Domain www.livernoismotorsports.com
Redirect Base livernoismotorsports.com
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Response IP 199.232.46.132
Found Yes
Hash 22ca1c11412204fece5e725d59747f6036be44e0e361506a0d1a609d6801e0a3
SimHash 6219d891d293

Groups

*

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

adsbot-google

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

googlebot-image

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

googlebot-mobile

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

bingbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

yahoo! slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

ahrefsbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 15

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.livernoismotorsports.com/sitemap.xml