Log In Sign Up

gene.exfamily.jp
robots.txt

Robots Exclusion Standard data for gene.exfamily.jp

Resource Scan

Scan Details

Site Domain gene.exfamily.jp
Base Domain exfamily.jp
Scan Status Ok
Last Scan2025-04-24T21:36:02+00:00
Next Scan 2025-05-24T21:36:02+00:00

Last Scan

Scanned2025-04-24T21:36:02+00:00
URL https://gene.exfamily.jp/robots.txt
Domain IPs 3.171.198.108, 3.171.198.13, 3.171.198.64, 3.171.198.82
Response IP 3.171.198.82
Found Yes
Hash 91b75a31fa4f8222880246e596aff149faf849a8610e2fe4785c6f39e0df65ad
SimHash 987cd522ae92

Groups

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

archiveteam archivebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /
Back to top