netzwelt.de
robots.txt
Robots Exclusion Standard data for netzwelt.de
Resource Scan
Scan Details
Site Domain | netzwelt.de |
Base Domain | netzwelt.de |
Scan Status | Ok |
Last Scan | 2024-06-01T06:48:24+00:00 |
Next Scan | 2024-06-08T06:48:24+00:00 |
Last Scan
Scanned | 2024-06-01T06:48:24+00:00 |
URL | https://netzwelt.de/robots.txt |
Redirect | https://www.netzwelt.de/robots.txt |
Redirect Domain | www.netzwelt.de |
Redirect Base | netzwelt.de |
Domain IPs | 35.198.159.3 |
Redirect IPs | 151.101.1.63, 151.101.129.63, 151.101.193.63, 151.101.65.63 |
Response IP | 199.232.45.63 |
Found | Yes |
Hash | f76d7ec203f11b5f37b65816a76b09b48d2bdcc55781453828f1b232c8c124ed |
SimHash | a230241a699b |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /partner/ |
Disallow | /contact/ |
Disallow | /rating/ |
Disallow | /spielhalle/init/ |
Comments