career.whitecross.co.jp
robots.txt

Robots Exclusion Standard data for career.whitecross.co.jp

Resource Scan

Scan Details

Site Domain career.whitecross.co.jp
Base Domain whitecross.co.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-20T17:15:22+00:00
Next Scan 2024-12-19T17:15:22+00:00

Last Successful Scan

Scanned2024-07-30T16:44:13+00:00
URL https://career.whitecross.co.jp/robots.txt
Domain IPs 108.157.254.105, 108.157.254.120, 108.157.254.41, 108.157.254.52
Response IP 108.157.254.52
Found Yes
Hash 14b928fedc539c8b197618f9ab6613f4386bedbeb99cf533c6775d29de5d0a67
SimHash 28187d2aeabb

Groups

semrushbot
baidu
yeti
blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /index.php
Disallow /phpinfo.php
Disallow /api/
Disallow /mod_pagespeed_beacon
Disallow /search/
Disallow /feed/
Disallow /feeds/
Disallow /rss/
Disallow /config/

Other Records

Field Value
sitemap https://career.whitecross.co.jp/sitemap.xml