krueger-dirndl.ch
robots.txt

Robots Exclusion Standard data for krueger-dirndl.ch

Resource Scan

Scan Details

Site Domain krueger-dirndl.ch
Base Domain krueger-dirndl.ch
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-02-12T01:00:52+00:00
Next Scan 2025-05-13T01:00:52+00:00

Last Successful Scan

Scanned2024-06-25T00:34:36+00:00
URL https://krueger-dirndl.ch/robots.txt
Redirect https://www.krueger-dirndl.ch/ch/robots.txt
Redirect Domain www.krueger-dirndl.ch
Redirect Base krueger-dirndl.ch
Domain IPs 104.26.14.174, 104.26.15.174, 172.67.74.57, 2606:4700:20::681a:eae, 2606:4700:20::681a:fae, 2606:4700:20::ac43:4a39
Redirect IPs 104.26.14.174, 104.26.15.174, 172.67.74.57, 2606:4700:20::681a:eae, 2606:4700:20::681a:fae, 2606:4700:20::ac43:4a39
Response IP 104.26.15.174
Found Yes
Hash ccb36ef831c41258eb955a22ebdb834894de075ee5e36170360a45a66aac3ee4
SimHash 4d265484af83

Groups

*

Rule Path
Disallow /*/catalog/product_compare/
Disallow /*/control/
Disallow /*/customize/
Disallow /*/newsletter/
Disallow /*/poll/
Disallow /*/review/
Disallow /*/sendfriend/
Disallow /*/tag/
Disallow /*/wishlist/
Disallow /*/wishlistpanel/
Disallow /*/catalog/product/gallery/
Disallow /*/catalogsearch/
Disallow /*/catalogsearch/result/
Disallow /*/catalogsearch/result/index/

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.krueger-dirndl.de/pub/shared/sitemap_ch_categories.xml
sitemap https://www.krueger-dirndl.de/pub/shared/sitemap_ch_pages.xml
sitemap https://www.krueger-dirndl.de/pub/shared/sitemap_ch_products.xml
sitemap https://www.krueger-dirndl.ch/pub/shared/sitemap_ch_filters.xml

Comments

  • Crawlers Setup
  • Block ChatGPT-Users from accessing via browsing plugin
  • Sitemaps