studiumleitfaden.de
robots.txt

Robots Exclusion Standard data for studiumleitfaden.de

Resource Scan

Scan Details

Site Domain studiumleitfaden.de
Base Domain studiumleitfaden.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-21T03:57:21+00:00
Next Scan 2026-02-19T03:57:21+00:00

Last Successful Scan

Scanned2023-04-13T15:41:12+00:00
URL https://studiumleitfaden.de/robots.txt
Redirect https://www.studiumleitfaden.de/robots.txt
Redirect Domain www.studiumleitfaden.de
Redirect Base studiumleitfaden.de
Domain IPs 104.21.24.158, 172.67.219.149, 2606:4700:3034::6815:189e, 2606:4700:3037::ac43:db95
Redirect IPs 104.21.24.158, 172.67.219.149, 2606:4700:3034::6815:189e, 2606:4700:3037::ac43:db95
Response IP 104.21.24.158
Found Yes
Hash 279d9e4baae0414c3e2120c8571febb9c5cc8a2bba067da18227c26774509356
SimHash 485ce9a2c756

Groups

*

Rule Path
Disallow /*?sort
Disallow /*?route=checkout%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2F
Disallow /*?page=1
Disallow /*%26create%3D1
Disallow /*?route=information%2F*
Disallow /*?route=*
Disallow /*?route=product%2Fproduct*&manufacturer_id=
Disallow /*?route=account%2Freturn%2Fadd
Disallow /*?route=information%2Fcontact
Disallow /admin/
Disallow /system/
Disallow /.well-known/
Disallow /cgi-bin/
Disallow /privacy.html
Disallow /gv_faq.html
Disallow /shippinginfo.html
Disallow /conditions.html
Disallow /about_us.html
Disallow /about_us
Disallow /frequently_asked_questions.html
Disallow /contact_us.html
Disallow /contact
Disallow /shopping_cart.html
Disallow /account.html
Disallow /privacy-policy
Disallow /create_account.html
Disallow /discount_coupon.html
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Allow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/

googlebot-image

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Disallow /.well-known/
Disallow /cgi-bin/

Other Records

Field Value
sitemap site_map.xml

Warnings

  • 1 invalid line.