home.1und1.de
robots.txt
Robots Exclusion Standard data for home.1und1.de
Resource Scan
Scan Details
Site Domain | home.1und1.de |
Base Domain | 1und1.de |
Scan Status | Ok |
Last Scan | 2024-11-16T00:36:34+00:00 |
Next Scan | 2024-11-23T00:36:34+00:00 |
Last Scan
Scanned | 2024-11-16T00:36:34+00:00 |
URL | https://home.1und1.de/robots.txt |
Domain IPs | 82.165.229.10 |
Response IP | 82.165.229.10 |
Found | Yes |
Hash | ca86016f10097e688289e5284e689885d066f7ff1425a3c9c729ca6805e459b2 |
SimHash | 78118b606133 |
Groups
*
Rule | Path |
---|---|
Disallow | /test/ |
applebot
Rule | Path |
---|---|
Disallow | /magazine/ |
Allow | /magazine/in-eigener-sache/ |
Allow | /magazine/unicef/ |
Allow | /magazine/so-arbeitet-die-redaktion/ |
chatgpt-user
Rule | Path |
---|---|
Disallow | /magazine/ |
Allow | /magazine/in-eigener-sache/ |
Allow | /magazine/unicef/ |
Allow | /magazine/so-arbeitet-die-redaktion/ |