qualitychevybuickgmc.com
robots.txt

Robots Exclusion Standard data for qualitychevybuickgmc.com

Resource Scan

Scan Details

Site Domain qualitychevybuickgmc.com
Base Domain qualitychevybuickgmc.com
Scan Status Ok
Last Scan2024-11-06T10:12:35+00:00
Next Scan 2024-12-06T10:12:35+00:00

Last Scan

Scanned2024-11-06T10:12:35+00:00
URL https://qualitychevybuickgmc.com/robots.txt
Redirect https://www.qualitychevygmcofenglewood.com/robots.txt
Redirect Domain www.qualitychevygmcofenglewood.com
Redirect Base qualitychevygmcofenglewood.com
Domain IPs 216.241.213.55
Redirect IPs 13.225.4.124, 13.225.4.129, 13.225.4.14, 13.225.4.35
Response IP 13.225.4.124
Found Yes
Hash 4cfd827070fbf66784e1fb2118c0ea56fa73e284ac84840efa33f8ff8369af29
SimHash 2b109012e6b1

Groups

siteanalyzerbot
mozilla/5.0 (compatible; siteanalyzerbot/5.0; +https://www.site-analyzer.com/)

Rule Path
Disallow

googlebot
googlebot-mobile
adsbot-google
rsiteauditor

Rule Path
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

bingbot
msnbot
adidxbot
motominerbot
mj12bot
rogerbot
ravencrawler
twitterbot
slurp
duckduckbot
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.qualitychevybuickgmc.com/sitemap.xml