vin.com
robots.txt

Robots Exclusion Standard data for vin.com

Resource Scan

Scan Details

Site Domain vin.com
Base Domain vin.com
Scan Status Ok
Last Scan2024-10-29T05:10:26+00:00
Next Scan 2024-11-28T05:10:26+00:00

Last Scan

Scanned2024-10-29T05:10:26+00:00
URL https://vin.com/robots.txt
Redirect https://www.vin.com/robots.txt
Redirect Domain www.vin.com
Redirect Base vin.com
Domain IPs 67.159.202.3
Redirect IPs 67.159.202.3
Response IP 67.159.202.3
Found Yes
Hash 180ebc99081983d63363951b5dfe5be28d4d7b7b58ecf958a4a0806b4f88ba31
SimHash 3101830eec13

Groups

*

Rule Path
Disallow /cattledog/
Disallow /howto
Disallow /news
Disallow /members
Disallow /admin
Disallow /vinmembers/
Disallow /promo/
Disallow /apputil/image/
Disallow /apputil/data/
Allow /default.aspx
Allow /vetzinsight/
Allow /vinx/
Allow /vinx/VetTools/
Allow /vinx/PetTools/
Allow /VetzInsight/
Allow /RecallCenter/
Allow /apputil/misc/bookreview/

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Comments

  • Robots.txt file for https://www.vin.com