asiacareer.jp
robots.txt

Robots Exclusion Standard data for asiacareer.jp

Resource Scan

Scan Details

Site Domain asiacareer.jp
Base Domain asiacareer.jp
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-18T19:23:46+00:00
Next Scan 2025-04-18T19:23:46+00:00

Last Successful Scan

Scanned2023-09-27T18:56:45+00:00
URL https://asiacareer.jp/robots.txt
Domain IPs 104.21.72.53, 172.67.175.166, 2606:4700:3033::6815:4835, 2606:4700:3034::ac43:afa6
Response IP 104.21.72.53
Found Yes
Hash e54317d5332126faa75c7271df1581ef674950b6336a67e2f5f4504c9458e1e3
SimHash 081e9c60ee9b

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://asiacareer.jp/sitemap.xml