dein-polster.com
robots.txt

Robots Exclusion Standard data for dein-polster.com

Resource Scan

Scan Details

Site Domain dein-polster.com
Base Domain dein-polster.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-21T17:50:06+00:00
Next Scan 2026-02-04T17:50:06+00:00

Last Successful Scan

Scanned2025-12-14T17:48:40+00:00
URL https://dein-polster.com/robots.txt
Domain IPs 104.21.61.247, 172.67.217.61, 2606:4700:3031::6815:3df7, 2606:4700:3035::ac43:d93d
Response IP 172.67.217.61
Found Yes
Hash 9efb2dd9b8daa0e03c8b6cfee3d609b72ba30e350f51d3073807ad2e2e952f7f
SimHash e9f1d65ed515

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /321analytics/
Disallow /cart
Disallow /cart/
Disallow /cart/update
Disallow /checkout
Disallow /checkout/
Disallow /checkout/add_order
Disallow /products/add_to_cart
Disallow /payment
Disallow /payment/
Disallow /payment/order
Disallow /pdf/
Disallow /pdff/
Disallow /*.pdf$

Other Records

Field Value
sitemap https://dein-polster.com/sitemap.xml

Comments

  • robots.txt für dein-polster.com
  • Admin & System
  • Warenkorb / Checkout / Payment
  • PDFs (egal wo sie liegen)
  • Optional (nur Yandex versteht das; Google/Bing ignorieren es):
  • Host: dein-polster.com
  • Optional (nur einsetzen, wenn ihr diese Seiten GAR NICHT crawlen lassen wollt;
  • ansonsten lieber per Canonical konsolidieren):
  • Disallow: /*?*page=
  • Disallow: /*?*sort=
  • Disallow: /*?*dir=
  • Disallow: /*?*limit=