crawlj.osdn.jp
robots.txt

Robots Exclusion Standard data for crawlj.osdn.jp

Resource Scan

Scan Details

Site Domain crawlj.osdn.jp
Base Domain osdn.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2024-09-19T08:33:32+00:00
Next Scan 2024-12-18T08:33:32+00:00

Last Successful Scan

Scanned2023-11-02T08:05:38+00:00
URL https://crawlj.osdn.jp/robots.txt
Domain IPs 54.148.152.249
Response IP 54.148.152.249
Found Yes
Hash a00ec19e6f88e0510090d9ffb7080ae8572c0c6300fc2194ad73e8dbd8795178
SimHash 09554040c7d3

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/