hilfe-center.1und1.de
robots.txt

Robots Exclusion Standard data for hilfe-center.1und1.de

Resource Scan

Scan Details

Site Domain hilfe-center.1und1.de
Base Domain 1und1.de
Scan Status Ok
Last Scan2024-11-03T07:58:14+00:00
Next Scan 2024-12-03T07:58:14+00:00

Last Scan

Scanned2024-11-03T07:58:14+00:00
URL https://hilfe-center.1und1.de/robots.txt
Domain IPs 2001:8d8:5ff:7::1:59, 217.160.72.100
Response IP 217.160.72.100
Found Yes
Hash 53f4b5e29e61099ef34308b45e6f26555e44dbd9427cfcaa8049e4af1bd579ab
SimHash 6a056086c5c2

Groups

*

Rule Path
Disallow /suchergebnisse
Disallow /api/

slysearch

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

superbot

Rule Path
Disallow /

supperhttp

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://hilfe-center.1und1.de/sitemap.xml

Comments

  • Sitemap
  • Disallow folders and search
  • All general disallows