kirstein.at
robots.txt

Robots Exclusion Standard data for kirstein.at

Resource Scan

Scan Details

Site Domain kirstein.at
Base Domain kirstein.at
Scan Status Ok
Last Scan2024-05-25T16:51:37+00:00
Next Scan 2024-06-24T16:51:37+00:00

Last Scan

Scanned2024-05-25T16:51:37+00:00
URL https://kirstein.at/robots.txt
Redirect https://www.kirstein.at/robots.txt
Redirect Domain www.kirstein.at
Redirect Base kirstein.at
Domain IPs 104.26.4.146, 104.26.5.146, 172.67.71.14
Redirect IPs 104.26.4.146, 104.26.5.146, 172.67.71.14
Response IP 104.26.5.146
Found Yes
Hash 550380a039ce9c5bf12fcd99cff49140de0fcc20bfeb6963b911583f442ac136
SimHash 2e11ddc249ff

Groups

*

Rule Path
Disallow /gizmo/login/
Disallow /agb.pdf
Disallow /*%7B%7Brecord.Deeplink%7D%7D
Disallow /*?filter
Disallow /*%26filter
Disallow /*?ajax=1
Disallow /*%26ajax%3D1
Disallow /admin/
Disallow /core/
Disallow /tmp/
Disallow /views/
Disallow /setup/
Disallow /log/
Disallow /agb/
Disallow /en/terms/
Disallow /warenkorb/
Disallow /en/cart/
Disallow /index.php?cl=basket
Disallow /mein-konto/
Disallow /en/my-account/
Disallow /index.php?cl=account
Disallow /mein-merkzettel/
Disallow /en/my-wishlist/
Disallow /index.php?cl=account_noticelist
Disallow /mein-wunschzettel/
Disallow /en/my-gift-registry/
Disallow /index.php?cl=account_wishlist
Disallow /konto-eroeffnen/
Disallow /en/open-account/
Disallow /index.php?cl=register
Disallow /passwort-vergessen/
Disallow /en/forgot-password/
Disallow /index.php?cl=forgotpwd
Disallow /index.php?cl=moredetails
Disallow /index.php?cl=review
Disallow /index.php?cl=search
Disallow /EXCEPTION_LOG.txt
Disallow /*?cl=newsletter
Disallow /*%26cl%3Dnewsletter
Disallow /*?cl=basket
Disallow /*%26cl%3Dbasket
Disallow /*?cl=account
Disallow /*%26cl%3Daccount
Disallow /*?cl=account_noticelist
Disallow /*%26cl%3Daccount_noticelist
Disallow /*?cl=account_wishlist
Disallow /*%26cl%3Daccount_wishlist
Disallow /*?cl=register
Disallow /*%26cl%3Dregister
Disallow /*?cl=forgotpwd
Disallow /*%26cl%3Dforgotpwd
Disallow /*?cl=moredetails
Disallow /*%26cl%3Dmoredetails
Disallow /*?cl=review
Disallow /*%26cl%3Dreview
Disallow /*?cl=search
Disallow /*%26cl%3Dsearch
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*?cur=
Disallow /*%26cur
Disallow /Lehrmaterial/
Disallow /en/Teaching-Materials/
Disallow /docs/PM_download/
Disallow /modules/sw/swFactFinder/suggest.php
Disallow /offline.html
Disallow /_blog/*
Allow /_blog/wp-content/uploads/*

msnbot

Rule Path
Disallow */filter/

Other Records

Field Value
sitemap https://www.kirstein.de/sitemap.xml

Comments

  • EGATE FILTER
  • War v. 25.09 10 uhr - 8.10 15 uhr aktiv
  • Disallow: /*/filter/
  • KIRSTEIN
  • Disallow: /newsletter
  • FACT-Finder
  • Ajax Content sollte auch nicht gecrawled werden (nicht mobil tauglich)
  • OXID
  • Disallow: /*? Keine gute Idee
  • Disallow: /newsletter/
  • Disallow: /en/newsletter/
  • Disallow: /index.php?cl=newsletter
  • wildcards at the end, because of some crawlers see it as errors
  • 2016-03-02 - MS
  • BLOG
  • Filter Restriktion für MSN Bot - 2015-05-22 Markus
  • Sitemap Eintrag - 2017-04-26 - MS