home.1und1.de
robots.txt
Robots Exclusion Standard data for home.1und1.de
Resource Scan
Scan Details
Site Domain | home.1und1.de |
Base Domain | 1und1.de |
Scan Status | Ok |
Last Scan | 2024-05-03T13:46:32+00:00 |
Next Scan | 2024-05-10T13:46:32+00:00 |
Last Scan
Scanned | 2024-05-03T13:46:32+00:00 |
URL | https://home.1und1.de/robots.txt |
Domain IPs | 82.165.229.10 |
Response IP | 82.165.229.10 |
Found | Yes |
Hash | 107fa4c6055491f4ab4ab7503be0c387880d9805b77393e336841e1e240ab44e |
SimHash | 795189606133 |
Groups
*
Rule | Path |
---|---|
Disallow | /test/ |
chatgpt-user
Rule | Path |
---|---|
Disallow | /magazine/ |
Allow | /magazine/in-eigener-sache/ |
Allow | /magazine/unicef/ |
Allow | /magazine/so-arbeitet-die-redaktion/ |