Log In Sign Up

lachmeister.de
robots.txt

Robots Exclusion Standard data for lachmeister.de

Resource Scan

Scan Details

Site Domain lachmeister.de
Base Domain lachmeister.de
Scan Status Ok
Last Scan2024-09-22T08:32:25+00:00
Next Scan 2024-09-29T08:32:25+00:00

Last Scan

Scanned2024-09-22T08:32:25+00:00
URL https://lachmeister.de/robots.txt
Redirect https://www.lachmeister.de/robots.txt
Redirect Domain www.lachmeister.de
Redirect Base lachmeister.de
Domain IPs 217.160.0.104
Redirect IPs 217.160.0.104
Response IP 217.160.0.104
Found Yes
Hash 79107dc96bb57638de056f77e23b2872d90604b3fd60b30fe958e233d481c5af
SimHash 505e54e0c130

Groups

*

Rule Path
Disallow /admin/
Disallow /logs/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

discobot

Rule Path
Disallow /

blekkobot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

uptimerobot/2.0

Rule Path
Disallow /

ezooms robot

Rule Path
Disallow /

perl lwp

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

wiseguys robot

Rule Path
Disallow /

turnitin robot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

babya discoverer

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /
Back to top

Comments

  • Block MJ12bot
  • Block Ahrefs
  • Block Sogou
  • Block SEOkicks
  • SEOkicks
  • Dicoveryengine.com
  • Blekkobot
  • Block BlexBot
  • Block SISTRIX
  • Block Uptime robot
  • Block Ezooms Robot
  • Block Perl LWP
  • Block netEstate NE Crawler
  • Block WiseGuys Robot
  • Block Turnitin Robot
  • Exabot
  • Yandex
  • Babya Discoverer
  • SemrushBot/1~bl
  • DotBot
  • Internet Archive (Wayback Machine)
Back to top