msu.de
robots.txt

Robots Exclusion Standard data for msu.de

Resource Scan

Scan Details

Site Domain msu.de
Base Domain msu.de
Scan Status Ok
Last Scan2025-10-11T06:34:41+00:00
Next Scan 2025-11-10T06:34:41+00:00

Last Scan

Scanned2025-10-11T06:34:41+00:00
URL https://msu.de/robots.txt
Domain IPs 217.160.0.12
Response IP 217.160.0.12
Found Yes
Hash 446cb5e16db7018865d4b92ffc620d8454485bb94e248ccacfba927705cdf864
SimHash 901d3d42e0d1

Groups

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow *.dmg

semrushbot-sa

Rule Path
Disallow *.dmg

ahrefsbot

Rule Path
Disallow *.dmg

jobboersebot

Rule Path
Disallow *.dmg

wotbox

Rule Path
Disallow *.dmg