marburg.de
robots.txt

Robots Exclusion Standard data for marburg.de

Resource Scan

Scan Details

Site Domain marburg.de
Base Domain marburg.de
Scan Status Ok
Last Scan4/21/2025, 6:53:27 AM
Next Scan 5/5/2025, 6:53:27 AM

Last Scan

Scanned4/21/2025, 6:53:27 AM
URL https://marburg.de/robots.txt
Redirect https://www.marburg.de/robots.txt
Redirect Domain www.marburg.de
Redirect Base marburg.de
Domain IPs 62.67.46.163
Redirect IPs 2a07:aa00:0:12:163::1, 62.67.46.163
Response IP 62.67.46.163
Found Yes
Hash ad93214d2554a025846d2a7bc2e38ac41c9099d3f000254092ba4715dcb05581
SimHash 5c01290401d3

Groups

*

Rule Path
Disallow /barrierefreiheit/barriere_melden.html
Disallow /portal/kontakt.html
Disallow /portal/suche.html
Disallow /portal/suche2.html
Disallow /portal/weiterempfehlen.html
Disallow /allris/___tmp/

webcopier

Rule Path
Disallow /

httrack*

Rule Path
Disallow /