uni-trier.de
robots.txt
Robots Exclusion Standard data for uni-trier.de
Resource Scan
Scan Details
| Site Domain | uni-trier.de |
| Base Domain | uni-trier.de |
| Scan Status | Ok |
| Last Scan | 2024-05-16T13:57:49+00:00 |
| Next Scan | 2024-06-15T13:57:49+00:00 |
Last Scan
| Scanned | 2024-05-16T13:57:49+00:00 |
| URL | https://www.uni-trier.de/robots.txt |
| Domain IPs | 136.199.189.15 |
| Response IP | 136.199.189.15 |
| Found | Yes |
| Hash | efc7205210cae10c3b1ed80c3ac70561aeb6815965b72b9d2a95460ad834a0c7 |
| SimHash | 611952a0ef37 |
Groups
bingbot
| Rule | Path |
|---|---|
| Disallow | /typo3/ |
| Disallow | /typo3temp/ |
| Disallow | /typo3conf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
msnbot
| Rule | Path |
|---|---|
| Disallow | /typo3/ |
| Disallow | /typo3temp/ |
| Disallow | /typo3conf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /typo3/ |
| Disallow | /typo3temp/ |
| Disallow | /typo3conf/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /typo3/ |
| Disallow | /typo3temp/ |
| Disallow | /typo3conf/ |