wecltd.de
robots.txt

Robots Exclusion Standard data for wecltd.de

Resource Scan

Scan Details

Site Domain wecltd.de
Base Domain wecltd.de
Scan Status Ok
Last Scan2024-09-18T04:45:09+00:00
Next Scan 2024-09-25T04:45:09+00:00

Last Scan

Scanned2024-09-18T04:45:09+00:00
URL https://wecltd.de/robots.txt
Domain IPs 35.204.250.43
Response IP 35.204.250.43
Found Yes
Hash ffbfbcfdcbf4823ade389fa404b69efddedcaa351ff0f7a1582ed6cb856300a8
SimHash 521fc4a2ce1b

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • User-agent: *
  • Disallow: