Log In Sign Up

familienfreund.de
robots.txt

Robots Exclusion Standard data for familienfreund.de

Resource Scan

Scan Details

Site Domain familienfreund.de
Base Domain familienfreund.de
Scan Status Ok
Last Scan2024-10-01T15:47:11+00:00
Next Scan 2024-10-02T15:47:11+00:00

Last Scan

Scanned2024-10-01T15:47:11+00:00
URL https://familienfreund.de/robots.txt
Redirect https://www.familienfreund.de/robots.txt
Redirect Domain www.familienfreund.de
Redirect Base familienfreund.de
Domain IPs 85.13.139.100
Redirect IPs 85.13.139.100
Response IP 85.13.139.100
Found Yes
Hash b85cc0159598ce9ce390f1162679b05eb8e191e3a468b8a3aacc8751aa4bcd52
SimHash 992118020f31

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/cache/

googlebot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/cache/
Allow /wp-content/cache/borlabs_cache/

semrushbot

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/cache/
Allow /wp-content/cache/borlabs_cache/

webreaper
webcopier
offline explorer
httrack
microsoft.url.control
emailcollector
penthesilea

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.familienfreund.de/sitemap_index.xml
Back to top

Comments

  • ===================================
  • Generator: http://pixelfolk.net/tools/robots
  • Erstellt am: 29.01.2015, 13:28
  • Webseite: https://www.familienfreund.de
  • ===================================
  • ===================================
  • Folgende Seiten sollen nicht indexiert werden:
  • ===================================
  • ===================================
  • Besonderheit für Google
  • ===================================
  • ===================================
  • Besonderheit für Semrush
  • ===================================
  • ===================================
  • Schließe folgende Spider komplett aus:
  • ===================================
Back to top