myindex.jp
robots.txt

Robots Exclusion Standard data for myindex.jp

Resource Scan

Scan Details

Site Domain myindex.jp
Base Domain myindex.jp
Scan Status Ok
Last Scan2026-02-02T10:29:17+00:00
Next Scan 2026-02-09T10:29:17+00:00

Last Scan

Scanned2026-02-02T10:29:17+00:00
URL https://myindex.jp/robots.txt
Domain IPs 162.43.116.78
Response IP 162.43.116.78
Found Yes
Hash e81c4866189b5d4ebb388cfc0bd301e7f5835630f79dbf7c526547cd87e16a14
SimHash 6212ea410513

Groups

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

amazonbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://myindex.jp/sitemap_https.xml.gz

Comments

  • for HTTPS
  • https://myindex.jp/
  • User-agent: bingbot
  • Crawl-delay: 30