krueger-dirndl.at
robots.txt

Robots Exclusion Standard data for krueger-dirndl.at

Resource Scan

Scan Details

Site Domain krueger-dirndl.at
Base Domain krueger-dirndl.at
Scan Status Ok
Last Scan2024-05-25T04:26:27+00:00
Next Scan 2024-06-24T04:26:27+00:00

Last Scan

Scanned2024-05-25T04:26:27+00:00
URL https://krueger-dirndl.at/robots.txt
Redirect https://www.krueger-dirndl.at/at/robots.txt
Redirect Domain www.krueger-dirndl.at
Redirect Base krueger-dirndl.at
Domain IPs 104.26.14.166, 104.26.15.166, 172.67.72.33, 2606:4700:20::681a:ea6, 2606:4700:20::681a:fa6, 2606:4700:20::ac43:4821
Redirect IPs 104.26.14.166, 104.26.15.166, 172.67.72.33, 2606:4700:20::681a:ea6, 2606:4700:20::681a:fa6, 2606:4700:20::ac43:4821
Response IP 104.26.14.166
Found Yes
Hash 2029b9eb133b0323de3eac3046b2df0a8821b3417a046112ce35bd70482e3500
SimHash 49245c1427d2

Groups

*

Rule Path
Disallow /*/catalog/product_compare/
Disallow /*/control/
Disallow /*/customize/
Disallow /*/newsletter/
Disallow /*/poll/
Disallow /*/review/
Disallow /*/sendfriend/
Disallow /*/tag/
Disallow /*/wishlist/
Disallow /*/wishlistpanel/
Disallow /*/catalog/product/gallery/
Disallow /*/catalogsearch/
Disallow /*/catalogsearch/result/
Disallow /*/catalogsearch/result/index/

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.krueger-dirndl.de/pub/shared/sitemap_at_categories.xml
sitemap https://www.krueger-dirndl.de/pub/shared/sitemap_at_pages.xml
sitemap https://www.krueger-dirndl.de/pub/shared/sitemap_at_products.xml
sitemap https://www.krueger-dirndl.at/pub/shared/sitemap_at_filters.xml

Comments

  • Crawlers Setup
  • Block ChatGPT-Users from accessing via browsing plugin
  • Sitemaps