npchevy.com
robots.txt

Robots Exclusion Standard data for npchevy.com

Resource Scan

Scan Details

Site Domain npchevy.com
Base Domain npchevy.com
Scan Status Ok
Last Scan2024-11-07T05:36:47+00:00
Next Scan 2024-12-07T05:36:47+00:00

Last Scan

Scanned2024-11-07T05:36:47+00:00
URL https://npchevy.com/robots.txt
Redirect https://www.npchevy.com/robots.txt
Redirect Domain www.npchevy.com
Redirect Base npchevy.com
Domain IPs 216.241.213.55
Redirect IPs 18.155.68.106, 18.155.68.121, 18.155.68.20, 18.155.68.77
Response IP 18.155.68.106
Found Yes
Hash ae24cd7182b8e9081dfa58e4b98c22b749479167b19413dbb8232e93396e10e6
SimHash 2b149000c690

Groups

googlebot
googlebot-mobile
adsbot-google

Rule Path
Disallow /sitemap-vehicle-search-sincro.xml
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

bingbot
applebot
msnbot
adidxbot
motominerbot
mj12bot
rogerbot
ravencrawler
twitterbot
slurp
duckduckbot
semrushbot
teoma
archive.org_bot

Rule Path
Disallow /sitemap-vehicle-search-sincro.xml
Disallow /siteMap
Disallow /*.do
Disallow /*.ajax
Disallow /*.js
Disallow /*.css
Disallow /f_*

Other Records

Field Value
crawl-delay 20

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.npchevy.com/sitemap.xml