grandrapidschevroletgmc.com
robots.txt

Robots Exclusion Standard data for grandrapidschevroletgmc.com

Resource Scan

Scan Details

Site Domain grandrapidschevroletgmc.com
Base Domain grandrapidschevroletgmc.com
Scan Status Ok
Last Scan2024-09-06T15:27:53+00:00
Next Scan 2024-10-06T15:27:53+00:00

Last Scan

Scanned2024-09-06T15:27:53+00:00
URL https://grandrapidschevroletgmc.com/robots.txt
Redirect https://www.grandrapidschevroletgmc.com/robots.txt
Redirect Domain www.grandrapidschevroletgmc.com
Redirect Base grandrapidschevroletgmc.com
Domain IPs 52.84.229.30, 52.84.229.31, 52.84.229.58, 52.84.229.82
Redirect IPs 18.65.207.112, 18.65.207.53, 18.65.207.67, 18.65.207.83
Response IP 52.84.229.31
Found Yes
Hash f1a2a90ea1cf85e4d61fb23cfdf43e5bedfd8c5b19835d68687ccbfee9aee3bf
SimHash 2b10d012ceb0

Groups

googlebot
googlebot-mobile
adsbot-google

Rule Path
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*
Disallow /?*currVehicleId=*
Disallow /?*saveVehicleAction=*
Disallow /?*compareVehicleId=*
Disallow /?*compareAction=*
Disallow /?*fragmentId=*
Disallow /?*indices=*

bingbot
msnbot
adidxbot
motominerbot
mj12bot
rogerbot
ravencrawler
twitterbot
slurp
duckduckbot
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*
Disallow /?*currVehicleId=*
Disallow /?*saveVehicleAction=*
Disallow /?*compareVehicleId=*
Disallow /?*compareAction=*
Disallow /?*fragmentId=*
Disallow /?*indices=*

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.grandrapidsgm.com/