topleder.de
robots.txt

Robots Exclusion Standard data for topleder.de

Resource Scan

Scan Details

Site Domain topleder.de
Base Domain topleder.de
Scan Status Ok
Last Scan2024-04-29T05:32:03+00:00
Next Scan 2024-05-29T05:32:03+00:00

Last Scan

Scanned2024-04-29T05:32:03+00:00
URL https://topleder.de/robots.txt
Redirect https://www.topleder.de/robots.txt
Redirect Domain www.topleder.de
Redirect Base topleder.de
Domain IPs 104.26.6.85, 104.26.7.85, 172.67.72.71, 2606:4700:20::681a:655, 2606:4700:20::681a:755, 2606:4700:20::ac43:4847
Redirect IPs 104.26.6.85, 104.26.7.85, 172.67.72.71, 2606:4700:20::681a:655, 2606:4700:20::681a:755, 2606:4700:20::ac43:4847
Response IP 172.67.72.71
Found Yes
Hash f2797fac9c41eb89d369769e9f7c848cefc82f741f39bafbbb1deb82306784b3
SimHash a81e89507afc

Groups

*

Rule Path
Disallow /admin/
Disallow /core/
Disallow /tmp/
Disallow /views/
Disallow /setup/
Disallow /log/
Disallow /newsletter/
Disallow /en/newsletter/
Disallow /index.php?cl=newsletter
Disallow /agb/
Disallow /en/terms/
Disallow /warenkorb/
Disallow /en/cart/
Disallow /index.php?cl=basket
Disallow /mein-konto/
Disallow /en/my-account/
Disallow /index.php?cl=account
Disallow /mein-merkzettel/
Disallow /en/my-wishlist/
Disallow /index.php?cl=account_noticelist
Disallow /mein-wunschzettel/
Disallow /en/my-gift-registry/
Disallow /index.php?cl=account_wishlist
Disallow /konto-eroeffnen/
Disallow /en/open-account/
Disallow /index.php?cl=register
Disallow /passwort-vergessen/
Disallow /en/forgot-password/
Disallow /index.php?cl=forgotpwd
Disallow /index.php?cl=moredetails
Disallow /index.php?cl=review
Disallow /index.php?cl=search
Disallow /EXCEPTION_LOG.txt
Disallow /*?cl=newsletter
Disallow /*%26cl%3Dnewsletter
Disallow /*?cl=basket
Disallow /*%26cl%3Dbasket
Disallow /*?cl=account
Disallow /*%26cl%3Daccount
Disallow /*?cl=account_noticelist
Disallow /*%26cl%3Daccount_noticelist
Disallow /*?cl=account_wishlist
Disallow /*%26cl%3Daccount_wishlist
Disallow /*?cl=register
Disallow /*%26cl%3Dregister
Disallow /*?cl=forgotpwd
Disallow /*%26cl%3Dforgotpwd
Disallow /*?cl=moredetails
Disallow /*%26cl%3Dmoredetails
Disallow /*?cl=review
Disallow /*%26cl%3Dreview
Disallow /*?cl=search
Disallow /*%26cl%3Dsearch
Disallow /*%26fnc%3Dtobasket
Disallow /*%26fnc%3Dtocomparelist
Disallow /*%26addcompare%3D
Disallow /*/sid/
Disallow /*?sid=
Disallow /*%26sid%3D
Disallow /*?cur=
Disallow /*%26cur
Disallow /*?force_sid
Disallow /*%26force_sid
Disallow /*?ldtype
Disallow /*%26ldtype

semrushbot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

majesticseo

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.topleder.de/robots/sitemap-tpl.xml

Comments

  • wildcards at the end, because of some crawlers see it as errors

Warnings

  • 2 invalid lines.