Log In Sign Up

luebeck-places.de
robots.txt

Robots Exclusion Standard data for luebeck-places.de

Resource Scan

Scan Details

Site Domain luebeck-places.de
Base Domain luebeck-places.de
Scan Status Ok
Last Scan2024-09-30T06:07:48+00:00
Next Scan 2024-10-07T06:07:48+00:00

Last Scan

Scanned2024-09-30T06:07:48+00:00
URL https://luebeck-places.de/robots.txt
Redirect https://www.luebeck-places.de/robots.txt
Redirect Domain www.luebeck-places.de
Redirect Base luebeck-places.de
Domain IPs 176.52.242.230
Redirect IPs 176.52.242.230
Response IP 176.52.242.230
Found Yes
Hash 552e51b4cb31039249623aef6bcc70070d939cc2abe89c1f426fea05fcb5c987
SimHash eb2018026fa0

Groups

googlebot-news

Rule Path
Disallow *
Allow /news*

*

Rule Path
Disallow /phpsearch_files/
Disallow /rating-form/
Disallow /*.inc.php
Disallow /404.html
Disallow /jquery-activmap/
Disallow /elp/
Disallow /goto/
Disallow /goto.php
Allow /jquery-activmap/js/
Allow /jquery-activmap/css/
Allow /elp/assets/js/
Allow /rating-form/assets/js/
Allow /phpsearch_files/phpsearch.css
Allow /rating-form/assets/css/
Allow /jquery-activmap/img/
Allow /rating-form/uploads//css/rating_form_1.css
Allow /elp/embed-comments.php
Allow /elp/assets/css/
Allow /elp/assets/img/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.luebeck-places.de/sitemap.xml
Back to top

Comments

  • ===================================
  • Generator: http://pixelfolk.net/tools/robots
  • Erstellt am: 08.10.2015, 09:46
  • Webseite: https://www.luebeck-places.de
  • ===================================
  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Schließe folgende Spider komplett aus:
  • ===================================
Back to top