tudelft.nl
robots.txt
Robots Exclusion Standard data for tudelft.nl
Resource Scan
Scan Details
| Site Domain | tudelft.nl |
| Base Domain | tudelft.nl |
| Scan Status | Ok |
| Last Scan | 2024-11-05T08:18:45+00:00 |
| Next Scan | 2024-11-19T08:18:45+00:00 |
Last Scan
| Scanned | 2024-11-05T08:18:45+00:00 |
| URL | https://tudelft.nl/robots.txt |
| Redirect | https://www.tudelft.nl/robots.txt |
| Redirect Domain | www.tudelft.nl |
| Redirect Base | tudelft.nl |
| Domain IPs | 130.161.128.82, 2001:610:908:112:131:180:77:102 |
| Redirect IPs | 142.132.240.12, 2a01:4f8:c01e:7fd::1 |
| Response IP | 142.132.240.12 |
| Found | Yes |
| Hash | 79cffb3e4d080b1654003fda42fd3f00740f8ad69348db1ccd0046b52f990c64 |
| SimHash | eb014b32cff3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /typo3/ |
| Disallow | /typo3_src/ |
| Disallow | /t3lib/ |
| Disallow | /*?id= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.tudelft.nl/sitemap.xml |