wuerzburg.spin.de
robots.txt

Robots Exclusion Standard data for wuerzburg.spin.de

Resource Scan

Scan Details

Site Domain wuerzburg.spin.de
Base Domain spin.de
Scan Status Ok
Last Scan2024-09-19T20:51:24+00:00
Next Scan 2024-10-03T20:51:24+00:00

Last Scan

Scanned2024-09-19T20:51:24+00:00
URL https://wuerzburg.spin.de/robots.txt
Domain IPs 2001:780:138:481::d55f:4f5c, 213.95.79.92
Response IP 213.95.79.92
Found Yes
Hash ec7e55ab08b19c02817aff2fc5d59a7c633ae8082353f48ca15104d21526c358
SimHash 481cfd62bc13

Groups

*

Rule Path
Disallow /url
Disallow /login
Disallow /login/
Disallow /api/
Disallow /tabs/
Disallow /pw
Disallow /block/
Disallow /verify/
Disallow /cu/
Disallow /wb/
Disallow /promo/
Disallow /comment/
Disallow /account/checklogin

fasterfox

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

wesee

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.