gov-online.go.jp
robots.txt

Robots Exclusion Standard data for gov-online.go.jp

Resource Scan

Scan Details

Site Domain gov-online.go.jp
Base Domain gov-online.go.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-08T15:17:42+00:00
Next Scan 2024-11-22T15:17:42+00:00

Last Successful Scan

Scanned2024-10-01T10:02:45+00:00
URL https://gov-online.go.jp/robots.txt
Redirect https://www.gov-online.go.jp/robots.txt
Redirect Domain www.gov-online.go.jp
Redirect Base gov-online.go.jp
Domain IPs 13.227.254.111, 13.227.254.115, 13.227.254.25, 13.227.254.7
Redirect IPs 13.227.254.111, 13.227.254.115, 13.227.254.25, 13.227.254.7, 2600:9000:200a:1600:17:6779:54c0:93a1, 2600:9000:200a:6800:17:6779:54c0:93a1, 2600:9000:200a:7600:17:6779:54c0:93a1, 2600:9000:200a:8400:17:6779:54c0:93a1, 2600:9000:200a:c200:17:6779:54c0:93a1, 2600:9000:200a:d600:17:6779:54c0:93a1, 2600:9000:200a:e800:17:6779:54c0:93a1, 2600:9000:200a:fa00:17:6779:54c0:93a1
Response IP 13.227.254.7
Found Yes
Hash 5e9b2be9065fdfa6c1c2f776edea588433ad874dfb4f1adb22c3b7e4a758ce1d
SimHash 4c28c41cad92

Groups

*

Rule Path
Disallow /api/
Disallow /404.html
Disallow /503.html

Other Records

Field Value
sitemap https://www.gov-online.go.jp/sitemap.xml
sitemap https://www.gov-online.go.jp/sitemap_gov-online_go_jp.xml