vettechcolleges.com
robots.txt

Robots Exclusion Standard data for vettechcolleges.com

Resource Scan

Scan Details

Site Domain vettechcolleges.com
Base Domain vettechcolleges.com
Scan Status Ok
Last Scan2024-05-23T21:08:17+00:00
Next Scan 2024-06-22T21:08:17+00:00

Last Scan

Scanned2024-05-23T21:08:17+00:00
URL https://vettechcolleges.com/robots.txt
Redirect https://www.vettechcolleges.com/robots.txt
Redirect Domain www.vettechcolleges.com
Redirect Base vettechcolleges.com
Domain IPs 141.193.213.20, 141.193.213.21
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash 1d923793878ea89aef2b65da8d401275244fbfa51133f1b10f8d8b6d33412c39
SimHash 5d36862508c2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /contributor/
Disallow /contributor-type/
Disallow /contributor-tags/
Disallow /top-professor/
Disallow /professor-type/
Disallow /professor-tags/
Disallow /professor-sources/
Disallow /colleges/
Disallow /colleges-state/
Disallow /colleges-type/
Disallow /internship-colleges/
Disallow /internship-colleges-type/
Disallow /?attachment_id=*
Disallow /home-page-html-link
Disallow /sb/