t3n.de
robots.txt
Robots Exclusion Standard data for t3n.de
Resource Scan
Scan Details
| Site Domain | t3n.de |
| Base Domain | t3n.de |
| Scan Status | Ok |
| Last Scan | 2024-11-16T16:35:53+00:00 |
| Next Scan | 2024-11-23T16:35:53+00:00 |
Last Scan
| Scanned | 2024-11-16T16:35:53+00:00 |
| URL | https://t3n.de/robots.txt |
| Domain IPs | 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132 |
| Response IP | 151.101.194.132 |
| Found | Yes |
| Hash | bf70a0cdade9eb5f48fb704318b9d2357d62ea2db5ccfc7a5b495fa1dc1e6b7e |
| SimHash | 4a2f5a224037 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /suche* |
| Disallow | /news/kommentar-benachrichtigungen/* |
| Disallow | /account/ |
| Disallow | /login* |
| Disallow | /app/ |
| Disallow | /fragen/ |
| Disallow | /jobs/neos/ |
| Disallow | /jobs/suche/ |
| Disallow | /magazin/media/ |
| Disallow | /magazin/wp-admin/ |
| Disallow | /neos/ |
| Disallow | /news/wp-admin/ |
| Disallow | /firmen/*tag%3D |
| Disallow | /firmen/*category%3D |
| Disallow | /firmen/*city%3D |
| Disallow | /firmen/*country%3D |
| Disallow | /firmen/*page%3D |
| Allow | /account/_Resources/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://t3n.de/sitemap-index.xml |