webster.ac.at
robots.txt
Robots Exclusion Standard data for webster.ac.at
Resource Scan
Scan Details
| Site Domain | webster.ac.at |
| Base Domain | webster.ac.at |
| Scan Status | Ok |
| Last Scan | 2025-10-04T02:55:21+00:00 |
| Next Scan | 2025-11-03T02:55:21+00:00 |
Last Scan
| Scanned | 2025-10-04T02:55:21+00:00 |
| URL | https://webster.ac.at/robots.txt |
| Domain IPs | 3.209.26.193, 34.236.193.193, 52.73.2.219 |
| Response IP | 52.73.2.219 |
| Found | Yes |
| Hash | 2ced5b03f5272ab07e67902563fce37cf65265775eb2e14bd5a4c4aa6b759cc8 |
| SimHash | a9a12f18ae90 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /404.php |
| Disallow | /_resources/ |
| Disallow | /academics/research/businessandmanagementresearch.php |
| Disallow | /academics/research/internationalrelationsresearch.php |
| Disallow | /academics/research/mediacommunicationsresearch.php |
| Disallow | /academics/research/psychology-research-archive.php |
| Disallow | /apply-now/ |
| Disallow | /blog/images/ |
| Disallow | /data-privacy/ |
| Disallow | /documents/ |
| Disallow | /images/ |
| Disallow | /library/ |
| Disallow | /media/ |
| Disallow | /study/ |
| Disallow | /studyabroad/ |
| Disallow | /wgeo/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.webster.ac.at/sitemap.xml |