Log In Sign Up

sendasmile.de
robots.txt

Robots Exclusion Standard data for sendasmile.de

Resource Scan

Scan Details

Site Domain sendasmile.de
Base Domain sendasmile.de
Scan Status Ok
Last Scan2024-11-02T13:37:13+00:00
Next Scan 2024-11-16T13:37:13+00:00

Last Scan

Scanned2024-11-02T13:37:13+00:00
URL https://sendasmile.de/robots.txt
Redirect https://www.sendasmile.de/robots.txt
Redirect Domain www.sendasmile.de
Redirect Base sendasmile.de
Domain IPs 108.156.133.52, 108.156.133.63, 108.156.133.72, 108.156.133.96
Redirect IPs 108.156.133.52, 108.156.133.63, 108.156.133.72, 108.156.133.96
Response IP 108.156.133.63
Found Yes
Hash 045106c4ced99c278f56b1efcec53f79b7a709609c3a65bafc5843215bd96ef1
SimHash 5f170949a0ef

Groups

*

Rule Path
Disallow */suchen*
Disallow /designer/*
Disallow /editor/*
Disallow /sos
Disallow /pipeline
Disallow /pipelinex
Disallow /*q%3D*
Disallow /*s%3D*
Disallow /*cat%3D*
Disallow /*kategorie%3D*
Disallow /kontakt/aendern
Disallow /kontakt/ansehen
Disallow /auth/loginModal
Disallow /auth/signupModal
Disallow /auth/loginmodal
Disallow /auth/signupmodal
Disallow /*redirect%3D*
Disallow /*url%3D*
Disallow /*aktivitaet%3D*
Disallow /*alter%3D*
Disallow /*altersgruppe%3D*
Disallow /*alterskategorie%3D*
Disallow /*anlass%3D*
Disallow /*anzahl-der-fotos%3D*
Disallow /*farbe%3D*
Disallow /*form%3D*
Disallow /*fuer-alter%3D*
Disallow /*jahreszahl%3D*
Disallow /*jubilaeumsjahr%3D*
Disallow /*kartensorte%3D*
Disallow /*logo%3D*
Disallow /*mit-alter%3D*
Disallow /*mit-entworfener-rueckseite%3D*
Disallow /*mit-foto%3D*
Disallow /*mit-name%3D*
Disallow /*stil%3D*
Disallow /*thema%3D*
Disallow /*tiere%3D*
Disallow /*trends%3D*
Disallow /*ausrichtung%3D*
Disallow /*color%5B*%5D
Disallow /*farbe%5B*%5D
Disallow /*doing_wp_cron%3D*
Disallow /*vornaam%3D*
Disallow /*CmsPages*
Disallow /modals/*
Disallow /blog/lv.php*
Disallow /blog/wp-content/themes/k2blog/lv.php*

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1
Back to top

Other Records

Field Value
sitemap https://www.sendasmile.de/sitemap_index.xml
sitemap https://www.sendasmile.de/blog/sitemap_index.xml
Back to top

Comments

  • [German DE Domain] Spider guider
  • 202208 Disallow internal search engine
  • END Disallow internal search engine
  • 240406 Disallow all crawlers access to certain pages
  • END Disallow all crawlers access to certain pages
  • Disallow search parameters for site (q) and blog (s)
  • 201908 Disallow cat= on any page
  • END Disallow cat= on any page
  • 20212601 Disallow category filter
  • END Disallow category filter
  • 201903 Temporarily block access to dutch kontakt pages
  • Disallow: /kontakt/nachbestellen
  • END Temporarily block access to dutch kontakt pages
  • 201903 Disallow sign in page
  • END Disallow sign in page
  • 201903 - Disallow redirect parameter
  • END Disallow redirect parameter
  • 202308 - Disallow url parameter
  • END Disallow url parameter
  • 240604 - Disallow filter parameters
  • Disallow: /*fuer=*
  • END Disallow filter parameters
  • 201903 at 13:06 Disallow unidentified parameters
  • End Disallow unidentified parameters
  • 20200914 WP Cron Cachekiller & Publisher
  • END WP Cron Cachekiller & Publisher
  • 20200403 Disallow voornaam parameter
  • Disallow: /*vorname=*
  • End Disallow voornaam parameter
  • 201903 - Disallow cmspages directory
  • END Disallow cmspages directory
  • 201903 - Disallow certain directories
  • END Disallow certain directories
  • 20240419 WP Pageview Pixel lv.php
  • END WP Pageview Pixel lv.php
  • Sitemap files
  • 201912 Crawl delays
Back to top