home.1und1.de
robots.txt

Robots Exclusion Standard data for home.1und1.de

Resource Scan

Scan Details

Site Domain home.1und1.de
Base Domain 1und1.de
Scan Status Ok
Last Scan2024-05-03T13:46:32+00:00
Next Scan 2024-05-10T13:46:32+00:00

Last Scan

Scanned2024-05-03T13:46:32+00:00
URL https://home.1und1.de/robots.txt
Domain IPs 82.165.229.10
Response IP 82.165.229.10
Found Yes
Hash 107fa4c6055491f4ab4ab7503be0c387880d9805b77393e336841e1e240ab44e
SimHash 795189606133

Groups

*

Rule Path
Disallow /test/

chatgpt-user

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/

gptbot

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/

google-extended

Rule Path
Disallow /magazine/
Allow /magazine/in-eigener-sache/
Allow /magazine/unicef/
Allow /magazine/so-arbeitet-die-redaktion/