home.1und1.de
robots.txt

Robots Exclusion Standard data for home.1und1.de

Resource Scan

Scan Details

Site Domain home.1und1.de
Base Domain 1und1.de
Scan Status Ok
Last Scan2024-11-16T00:36:34+00:00
Next Scan 2024-11-23T00:36:34+00:00

Last Scan

Scanned2024-11-16T00:36:34+00:00
URL https://home.1und1.de/robots.txt
Domain IPs 82.165.229.10
Response IP 82.165.229.10
Found Yes
Hash ca86016f10097e688289e5284e689885d066f7ff1425a3c9c729ca6805e459b2
SimHash 78118b606133

Groups

*

Rule Path
Disallow /test/

applebot

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/

chatgpt-user

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/

gptbot

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/

google-extended

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/