kokontouzai.org
robots.txt

Robots Exclusion Standard data for kokontouzai.org

Resource Scan

Scan Details

Site Domain kokontouzai.org
Base Domain kokontouzai.org
Scan Status Ok
Last Scan2024-09-19T03:39:04+00:00
Next Scan 2024-09-26T03:39:04+00:00

Last Scan

Scanned2024-09-19T03:39:04+00:00
URL https://kokontouzai.org/robots.txt
Domain IPs 210.157.78.15
Response IP 210.157.78.15
Found Yes
Hash 0ce020b8082743284c2c8dc54fc3f2f670b90a57f7b67396ecb9a03528076ca7
SimHash 932f89421f99

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/plugins
Disallow /wp-content/themes

megalodon

Rule Path
Disallow /

archive.org_bot
ia_archiver

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

steeler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

proximic

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://kokontouzai.org/wp-sitemap.xml

Comments

  • Megalodon-block
  • archivebot-block
  • Common Crawl
  • NICT
  • COMSYS
  • Netcraft
  • Grapeshot
  • BuiltWith
  • AhrefsBot
  • SEMrush
  • Steeler
  • Dotbot
  • Majestic
  • Serpstat
  • SEOkicks
  • Barkrowler
  • BLEXBot
  • MegaIndex
  • proximic