Log In Sign Up

mvbnet.de
robots.txt

Robots Exclusion Standard data for mvbnet.de

Resource Scan

Scan Details

Site Domain mvbnet.de
Base Domain mvbnet.de
Scan Status Ok
Last Scan2025-04-23T19:43:23+00:00
Next Scan 2025-05-23T19:43:23+00:00

Last Scan

Scanned2025-04-23T19:43:23+00:00
URL https://mvbnet.de/robots.txt
Domain IPs 2001:8d8:100f:f000::273, 217.160.0.146
Response IP 217.160.0.146
Found Yes
Hash 153dc2609b59dd1927336e9e8520f8dbedc23700b0a15c64201c6ccfe4b5666a
SimHash ee2cdd04dbd1

Groups

*

Rule Path
Disallow /barrierefrei/
Disallow /backup-alte-seite/
Disallow /cgi-bin/
Disallow /ausschreibung/
Disallow /beta/
Disallow /downloads/
Disallow /auskunft/
Disallow /fahrplanauskunft/
Disallow /logs/
Disallow /pma/
Disallow /webstatistik/
Disallow /wp-admin/
Disallow /wp-content/
Disallow /wp-includes/
Disallow /wp-login.php

emailcollector

Rule Path
Disallow /

teleport*

Rule Path
Disallow /

webwhacker*

Rule Path
Disallow /

webzip*

Rule Path
Disallow /

net attache*

Rule Path
Disallow /

sitesnagger*

Rule Path
Disallow /

httrack*

Rule Path
Disallow /

webcapture*

Rule Path
Disallow /

websauger*

Rule Path
Disallow /

webreaper*

Rule Path
Disallow /

roverbot*

Rule Path
Disallow /
Back to top

Comments

  • User-agent:*
  • Disallow: /*.zip$
  • Disallow: /*.gif$
  • Disallow: /*.jpg$
  • Disallow: /*.php$
  • Disallow: /*.swf$
  • User-agent: Firefly/1.0
  • Disallow: /
Back to top