bomninchevrolet.com
robots.txt

Robots Exclusion Standard data for bomninchevrolet.com

Resource Scan

Scan Details

Site Domain bomninchevrolet.com
Base Domain bomninchevrolet.com
Scan Status Ok
Last Scan2025-03-29T19:42:55+00:00
Next Scan 2025-04-28T19:42:55+00:00

Last Scan

Scanned2025-03-29T19:42:55+00:00
URL https://bomninchevrolet.com/robots.txt
Redirect https://www.bomninchevrolet.com/robots.txt
Redirect Domain www.bomninchevrolet.com
Redirect Base bomninchevrolet.com
Domain IPs 216.241.213.55
Redirect IPs 3.171.198.106, 3.171.198.32, 3.171.198.77, 3.171.198.79
Response IP 3.171.198.106
Found Yes
Hash 2c12cefa8a69f2c38334e940e0e8a8fc990608856d27660cd20684bec14173a7
SimHash 2b1410b1f690

Groups

googlebot
googlebot-mobile
adsbot-google
duckduckbot
slurp
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*
Disallow /*?siteMapItemName=*

bingbot
msnbot
adidxbot
motominerbot
mj12bot

Rule Path
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*
Disallow /*?siteMapItemName=*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bomninchevrolet.com/sitemap.xml
sitemap https://www.bomninchevrolet.com/sitemap-mobile.xml
sitemap https://www.bomninchevrolet.com/VehicleSearchResults?search=preowned
sitemap https://www.bomninchevrolet.com/VehicleSearchResults?search=new
sitemap https://www.bomninchevrolet.com/VehicleSearchResults?search=certified