spektrum.de
robots.txt

Robots Exclusion Standard data for spektrum.de

Resource Scan

Scan Details

Site Domain spektrum.de
Base Domain spektrum.de
Scan Status Ok
Last Scan2024-11-16T16:43:53+00:00
Next Scan 2024-11-23T16:43:53+00:00

Last Scan

Scanned2024-11-16T16:43:53+00:00
URL https://spektrum.de/robots.txt
Redirect https://www.spektrum.de/robots.txt
Redirect Domain www.spektrum.de
Redirect Base spektrum.de
Domain IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132
Redirect IPs 151.101.130.132, 151.101.194.132, 151.101.2.132, 151.101.66.132, 2a04:4e42:200::644, 2a04:4e42:400::644, 2a04:4e42:600::644, 2a04:4e42::644
Response IP 199.232.46.132
Found Yes
Hash 9664c80f68b53771d1afe33e6a6b9b6726c14daa2fca02bf53ffd488f935d86b
SimHash 2145f880a311

Groups

ms search 4.0 robot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /icons/
Disallow /template/warenkorb