enr34.jp
robots.txt

Robots Exclusion Standard data for enr34.jp

Resource Scan

Scan Details

Site Domain enr34.jp
Base Domain enr34.jp
Scan Status Ok
Last Scan2024-09-16T07:01:47+00:00
Next Scan 2024-09-23T07:01:47+00:00

Last Scan

Scanned2024-09-16T07:01:47+00:00
URL http://enr34.jp/robots.txt
Domain IPs 59.106.171.77
Response IP 59.106.171.77
Found Yes
Hash 8745e79d876d0514c0c6fee192068d2d34f6f2dfc9d312644600f77c6841a1b7
SimHash 121edc00f21a

Groups

lc-crawler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

bingbot
msnbot
ezooms.bot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.
  • `clawl-delay` is not a known field.