1und1.de
robots.txt

Robots Exclusion Standard data for 1und1.de

Resource Scan

Scan Details

Site Domain 1und1.de
Base Domain 1und1.de
Scan Status Ok
Last Scan2024-05-10T11:21:11+00:00
Next Scan 2024-05-17T11:21:11+00:00

Last Scan

Scanned2024-05-10T11:21:11+00:00
URL https://1und1.de/robots.txt
Redirect https://www.1und1.de/robots.txt
Redirect Domain www.1und1.de
Redirect Base 1und1.de
Domain IPs 2001:8d8:5ff:7::1:3, 217.160.72.6
Redirect IPs 2001:8d8:5ff:7::1:3, 217.160.72.6
Response IP 217.160.72.6
Found Yes
Hash 76fb7f5c4e01a83bdce38eb484769adf75649d8d4342143e87a65d055d8928e5
SimHash 29039aa7659a

Groups

*

Rule Path
Disallow /.well-known/
Disallow /france/
Disallow /xml/
Disallow /static/
Disallow /suche*
Disallow /bvb-aktion/
Allow /*?ac=
Allow /*?color=
Allow /*?size=
Allow /*?chosenTariff=
Allow /*?cdpFlow=
Disallow /*?kwk=
Disallow /*?ps_id=
Disallow /*?hwid=
Disallow /*?article=
Disallow /*?actioncode=
Disallow /*?__lf=
Disallow /*?__sign=
Disallow /*?bk-special=
Disallow /*?contact.category=
Disallow /*?fbclid=
Disallow /*?hotline=
Disallow /*?ID=
Disallow /*?label=
Disallow /*?linkId=
Disallow /*?linkOrigin=
Disallow /*?mc=
Disallow /*?new_sLanguage=
Disallow /*?owner=
Disallow /*?ref=
Disallow /*?tags=
Disallow /*?ucuoId=
Disallow /*?zanpid=
Disallow /*?zxuid=
Disallow /*.php
Disallow /*?cart.action=
Disallow /*?cart.bundle=
Disallow /*?cart.prepend=
Disallow /*?__sendingdata=
Disallow /*?__forcestop=

slysearch

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

spankbot

Rule Path
Disallow /

spanner

Rule Path
Disallow /

superbot

Rule Path
Disallow /

supperhttp

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.1und1.de/sitemap.xml

Comments

  • robots.txt for https://www.1und1.de
  • 22. März, 2023
  • Sitemap
  • Disallow folders and search
  • BVB Aktion double indexing prevention
  • Parameter and Suffix indexing
  • Cart Parameter indexing
  • All general disallows