uni-augsburg.de
robots.txt
Robots Exclusion Standard data for uni-augsburg.de
Resource Scan
Scan Details
| Site Domain | uni-augsburg.de |
| Base Domain | uni-augsburg.de |
| Scan Status | Ok |
| Last Scan | 2024-11-13T18:14:52+00:00 |
| Next Scan | 2024-11-27T18:14:52+00:00 |
Last Scan
| Scanned | 2024-11-13T18:14:52+00:00 |
| URL | https://uni-augsburg.de/robots.txt |
| Redirect | https://www.uni-augsburg.de/robots.txt |
| Redirect Domain | www.uni-augsburg.de |
| Redirect Base | uni-augsburg.de |
| Domain IPs | 137.250.6.130 |
| Redirect IPs | 137.250.6.130 |
| Response IP | 137.250.6.130 |
| Found | Yes |
| Hash | a320c3c87e0c2b6f615a7123c06b20078973e9fad5ef8846c7f07de53fbe7c64 |
| SimHash | 4141de724313 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /de/portal/intranet |
| Disallow | /en/portal/intranet |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://uni-augsburg.de/sitemap.xml |
Warnings
- `host` is not a known field.