johnelwaycadillac.com
robots.txt

Robots Exclusion Standard data for johnelwaycadillac.com

Resource Scan

Scan Details

Site Domain johnelwaycadillac.com
Base Domain johnelwaycadillac.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-31T01:26:26+00:00
Next Scan 2024-09-30T01:26:26+00:00

Last Successful Scan

Scanned2024-07-10T01:25:33+00:00
URL https://johnelwaycadillac.com/robots.txt
Redirect https://www.johnelwaycadillac.com/robots.txt
Redirect Domain www.johnelwaycadillac.com
Redirect Base johnelwaycadillac.com
Domain IPs 216.241.213.55
Redirect IPs 18.155.68.106, 18.155.68.115, 18.155.68.78, 18.155.68.9
Response IP 18.155.68.9
Found Yes
Hash 6d02ddc20ef65dd11802dd852dfe9282a88ff469249a9b02b66546868296f477
SimHash 3b101020c6b0

Groups

googlebot
googlebot-mobile
adsbot-google

Rule Path
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

bingbot
applebot
msnbot
adidxbot
motominerbot
mj12bot
rogerbot
ravencrawler
twitterbot
slurp
duckduckbot
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://www.johnelwaycadillac.com/sitemap.xml