grandrapidschevroletgmc.com
robots.txt

Robots Exclusion Standard data for grandrapidschevroletgmc.com

Resource Scan

Scan Details

Site Domain grandrapidschevroletgmc.com
Base Domain grandrapidschevroletgmc.com
Scan Status Ok
Last Scan2024-11-05T15:28:00+00:00
Next Scan 2024-12-05T15:28:00+00:00

Last Scan

Scanned2024-11-05T15:28:00+00:00
URL https://grandrapidschevroletgmc.com/robots.txt
Redirect https://www.grandrapidschevroletgmc.com/robots.txt
Redirect Domain www.grandrapidschevroletgmc.com
Redirect Base grandrapidschevroletgmc.com
Domain IPs 13.35.238.26, 13.35.238.5, 13.35.238.88, 13.35.238.99
Redirect IPs 13.35.238.26, 13.35.238.5, 13.35.238.88, 13.35.238.99
Response IP 13.35.238.88
Found Yes
Hash f1a2a90ea1cf85e4d61fb23cfdf43e5bedfd8c5b19835d68687ccbfee9aee3bf
SimHash 2b10d012ceb0

Groups

googlebot
googlebot-mobile
adsbot-google

Rule Path
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*
Disallow /?*currVehicleId=*
Disallow /?*saveVehicleAction=*
Disallow /?*compareVehicleId=*
Disallow /?*compareAction=*
Disallow /?*fragmentId=*
Disallow /?*indices=*

bingbot
msnbot
adidxbot
motominerbot
mj12bot
rogerbot
ravencrawler
twitterbot
slurp
duckduckbot
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*
Disallow /?*currVehicleId=*
Disallow /?*saveVehicleAction=*
Disallow /?*compareVehicleId=*
Disallow /?*compareAction=*
Disallow /?*fragmentId=*
Disallow /?*indices=*

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.grandrapidsgm.com/