htw-berlin.de
robots.txt

Robots Exclusion Standard data for htw-berlin.de

Resource Scan

Scan Details

Site Domain htw-berlin.de
Base Domain htw-berlin.de
Scan Status Ok
Last Scan2025-10-17T15:49:56+00:00
Next Scan 2025-11-16T15:49:56+00:00

Last Scan

Scanned2025-10-17T15:49:56+00:00
URL https://htw-berlin.de/robots.txt
Redirect https://www.htw-berlin.de/robots.txt
Redirect Domain www.htw-berlin.de
Redirect Base htw-berlin.de
Domain IPs 141.45.7.250
Redirect IPs 141.45.7.250
Response IP 141.45.7.250
Found Yes
Hash 409607ff632aea7a9ab5dbc7e67acb809c0c2b49fc10679c50dd948549a538f3
SimHash 981cdd226e53

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /