catalog.tamu.edu
robots.txt
Robots Exclusion Standard data for catalog.tamu.edu
Resource Scan
Scan Details
| Site Domain | catalog.tamu.edu |
| Base Domain | tamu.edu |
| Scan Status | Ok |
| Last Scan | 2025-03-03T10:18:50+00:00 |
| Next Scan | 2025-04-02T10:18:50+00:00 |
Last Scan
| Scanned | 2025-03-03T10:18:50+00:00 |
| URL | https://catalog.tamu.edu/robots.txt |
| Domain IPs | 12.175.6.47 |
| Response IP | 12.175.6.47 |
| Found | Yes |
| Hash | 04f5437c647092ad30690ff6b9d894e9e8b23884b7441a305fab6c521586cb97 |
| SimHash | 8d4d74e5b18b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /archives/ |
| Disallow | /admin/ |
| Disallow | /azindex/ |
| Disallow | /catalogcontents/ |
| Disallow | /cim/ |
| Disallow | /clmail/ |
| Disallow | /coreadmin/ |
| Disallow | /courseadmin/ |
| Disallow | /courseleaf/ |
| Disallow | /css/ |
| Disallow | /dbleaf/ |
| Disallow | /depts/ |
| Disallow | /fonts/ |
| Disallow | /gallery/ |
| Disallow | /images/ |
| Disallow | /js/ |
| Disallow | /mig/ |
| Disallow | /migration/ |
| Disallow | /miscadmin/ |
| Disallow | /navbar/ |
| Disallow | /pagewiz/ |
| Disallow | /pdf/ |
| Disallow | /programadmin/ |
| Disallow | /responseform/ |
| Disallow | /ribbit/ |
| Disallow | /search/ |
| Disallow | /shared/ |
| Disallow | /styles/ |
| Disallow | /tmp/ |
| Disallow | /wiztest/ |
| Disallow | /xsearch/ |
| Disallow | /communicationadmin/ |
| Disallow | /corecurradmin/ |
| Disallow | /icdcdadmin/ |
| Disallow | /writingadmin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://catalog.tamu.edu/sitemap.xml |