kadokawa.co.jp
robots.txt

Robots Exclusion Standard data for kadokawa.co.jp

Resource Scan

Scan Details

Site Domain kadokawa.co.jp
Base Domain kadokawa.co.jp
Scan Status Ok
Last Scan2024-09-18T22:14:09+00:00
Next Scan 2024-10-18T22:14:09+00:00

Last Scan

Scanned2024-09-18T22:14:09+00:00
URL https://kadokawa.co.jp/robots.txt
Redirect https://www.kadokawa.co.jp/robots.txt
Redirect Domain www.kadokawa.co.jp
Redirect Base kadokawa.co.jp
Domain IPs 18.180.82.163
Redirect IPs 108.157.254.10, 108.157.254.114, 108.157.254.30, 108.157.254.82, 2600:9000:2753:1e00:0:67e:3240:93a1, 2600:9000:2753:2e00:0:67e:3240:93a1, 2600:9000:2753:5e00:0:67e:3240:93a1, 2600:9000:2753:800:0:67e:3240:93a1, 2600:9000:2753:a400:0:67e:3240:93a1, 2600:9000:2753:ce00:0:67e:3240:93a1, 2600:9000:2753:d000:0:67e:3240:93a1, 2600:9000:2753:f400:0:67e:3240:93a1
Response IP 108.157.254.30
Found Yes
Hash 7c9ab95f6b951f71b2fd658f299637195e787c67d9cefb7cf62fec714cefac38
SimHash 431f4460ee18

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

Comments

  • bingbot
  • AhrefsBot
  • SemrushBot
  • MJ12bot
  • MegaIndex
  • DotBot
  • PetalBot
  • MauiBot