career.whitecross.co.jp
robots.txt
Robots Exclusion Standard data for career.whitecross.co.jp
Resource Scan
Scan Details
Site Domain | career.whitecross.co.jp |
Base Domain | whitecross.co.jp |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-20T17:15:22+00:00 |
Next Scan | 2024-12-19T17:15:22+00:00 |
Last Successful Scan
Scanned | 2024-07-30T16:44:13+00:00 |
URL | https://career.whitecross.co.jp/robots.txt |
Domain IPs | 108.157.254.105, 108.157.254.120, 108.157.254.41, 108.157.254.52 |
Response IP | 108.157.254.52 |
Found | Yes |
Hash | 14b928fedc539c8b197618f9ab6613f4386bedbeb99cf533c6775d29de5d0a67 |
SimHash | 28187d2aeabb |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php |
Disallow | /phpinfo.php |
Disallow | /api/ |
Disallow | /mod_pagespeed_beacon |
Disallow | /search/ |
Disallow | /feed/ |
Disallow | /feeds/ |
Disallow | /rss/ |
Disallow | /config/ |
Other Records
Field | Value |
---|---|
sitemap | https://career.whitecross.co.jp/sitemap.xml |