jaxa.jp
robots.txt

Robots Exclusion Standard data for jaxa.jp

Resource Scan

Scan Details

Site Domain jaxa.jp
Base Domain jaxa.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-15T04:36:59+00:00
Next Scan 2024-08-13T04:36:59+00:00

Last Successful Scan

Scanned2023-12-25T04:28:26+00:00
URL https://www.jaxa.jp/robots.txt
Domain IPs 96.17.96.30, 96.17.96.9
Response IP 104.88.70.99
Found Yes
Hash 9516d503d6a6f39f7af0141efdf00e651847b9abdc76d359a2d4c62da45a0364
SimHash b13c2cc0a71f

Groups

*

Rule Path
Disallow /errors/
Disallow /shared/
Disallow /img/
Disallow /images/
Disallow /common/
Disallow /press/media/
Disallow /*assets_c
Disallow /projects/pr/calendar
Disallow /press/kit/
Disallow /press/az/info/
Disallow /press/az/se/
Disallow /mrd/
Disallow /mrd/hcz4/
Disallow /mrd/M8ps/
Disallow /mrd/Nva7/
Disallow /mrd/r6J4/
Disallow /mrd/S6eF/
Disallow /mrd/u9Er/
Disallow /research/

ndl-japan

Rule Path
Disallow