tu.berlin
robots.txt
Robots Exclusion Standard data for tu.berlin
Resource Scan
Scan Details
| Site Domain | tu.berlin |
| Base Domain | tu.berlin |
| Scan Status | Ok |
| Last Scan | 2024-11-07T18:15:36+00:00 |
| Next Scan | 2024-12-07T18:15:36+00:00 |
Last Scan
| Scanned | 2024-11-07T18:15:36+00:00 |
| URL | https://tu.berlin/robots.txt |
| Redirect | https://www.tu.berlin/robots.txt |
| Redirect Domain | www.tu.berlin |
| Redirect Base | tu.berlin |
| Domain IPs | 141.23.73.70 |
| Redirect IPs | 141.23.73.70 |
| Response IP | 141.23.73.70 |
| Found | Yes |
| Hash | e5501c120138cb96ca976362e167ab5ddd91bbe2d8843b81c0099ee7a81eb73d |
| SimHash | 700033b29760 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Allow | / | - |
| Disallow | /typo3/ | - |
| Disallow | /typo3conf/ | - |
| Allow | /typo3conf/ext/ | - |
| Allow | /typo3temp/ | - |
| Disallow | /*?id=* | non speaking URLs |
| Disallow | /*%26id%3D* | non speaking URLs |
| Disallow | /*tx_solr* | search parameters |
| Disallow | /*cHash | no cHash |
| Disallow | /*tx_powermail_pi1 | no powermail thanks pages |
| Disallow | /*tx_tubdownloadlist* | Download lists |
| Disallow | /*tx_tubstudypaths_studypathlist* | Studypath filtering |
| Disallow | /*tx_tubevents_event | Events filtering |
| Disallow | /*tx_tubbasepackage_protectedpagelogin | Protected page filtering |
| Disallow | /Shibboleth.sso | - |
Comments