mycampus.imp.fu-berlin.de
robots.txt

Robots Exclusion Standard data for mycampus.imp.fu-berlin.de

Resource Scan

Scan Details

Site Domain mycampus.imp.fu-berlin.de
Base Domain fu-berlin.de
Scan Status Ok
Last Scan2024-11-03T16:13:21+00:00
Next Scan 2024-12-03T16:13:21+00:00

Last Scan

Scanned2024-11-03T16:13:21+00:00
URL https://mycampus.imp.fu-berlin.de/robots.txt
Domain IPs 160.45.117.104
Response IP 160.45.117.104
Found Yes
Hash 1ea284792c83270ba8d902e5df799de23ff96a0c98ba3b8ef1884b226434b83a
SimHash 1814b804eb40

Groups

*

Rule Path
Disallow /portal/tool/

*

Rule Path
Disallow /mvs2/evento/

*

Rule Path
Disallow /mvs2/maternity-protection/

*

Rule Path
Disallow /libraray/

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

bingbot

Rule Path
Disallow /mvs2

gptbot

Rule Path
Disallow /

grammarly

Rule Path
Disallow /