witten.de
robots.txt

Robots Exclusion Standard data for witten.de

Resource Scan

Scan Details

Site Domain witten.de
Base Domain witten.de
Scan Status Ok
Last Scan5/7/2025, 4:39:57 PM
Next Scan 5/21/2025, 4:39:57 PM

Last Scan

Scanned5/7/2025, 4:39:57 PM
URL https://witten.de/robots.txt
Redirect https://www.witten.de/robots.txt
Redirect Domain www.witten.de
Redirect Base witten.de
Domain IPs 80.82.223.250
Redirect IPs 2001:4ba0:92e0:250::1, 80.82.223.250
Response IP 80.82.223.250
Found Yes
Hash ad93214d2554a025846d2a7bc2e38ac41c9099d3f000254092ba4715dcb05581
SimHash 5c01290401d3

Groups

*

Rule Path
Disallow /barrierefreiheit/barriere_melden.html
Disallow /portal/kontakt.html
Disallow /portal/suche.html
Disallow /portal/suche2.html
Disallow /portal/weiterempfehlen.html
Disallow /allris/___tmp/

webcopier

Rule Path
Disallow /

httrack*

Rule Path
Disallow /