jasis.jp
robots.txt

Robots Exclusion Standard data for jasis.jp

Resource Scan

Scan Details

Site Domain jasis.jp
Base Domain jasis.jp
Scan Status Ok
Last Scan2024-09-19T11:06:30+00:00
Next Scan 2024-10-19T11:06:30+00:00

Last Scan

Scanned2024-09-19T11:06:30+00:00
URL https://jasis.jp/robots.txt
Redirect https://www.jasis.jp/robots.txt
Redirect Domain www.jasis.jp
Redirect Base jasis.jp
Domain IPs 52.84.229.104, 52.84.229.5, 52.84.229.55, 52.84.229.85
Redirect IPs 52.84.229.104, 52.84.229.5, 52.84.229.55, 52.84.229.85
Response IP 52.84.229.5
Found Yes
Hash 6a09c89fec0dea8b62eee22c8629c5fa6292be547d8252bc4414be278e389b16
SimHash 301c634981c6

Groups

*

Rule Path
Disallow /pg2021/
Disallow /pg2022/
Disallow /pg2023/
Disallow /pg2024/
Disallow /pg2025/
Disallow /pg2026/
Disallow /pg2027/
Disallow /pg2028/
Disallow /pg2029/
Disallow /pg2030/
Disallow /pg2031/
Disallow /pg2032/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /