elite-network.co.jp
robots.txt

Robots Exclusion Standard data for elite-network.co.jp

Resource Scan

Scan Details

Site Domain elite-network.co.jp
Base Domain elite-network.co.jp
Scan Status Ok
Last Scan2024-05-27T14:38:46+00:00
Next Scan 2024-06-26T14:38:46+00:00

Last Scan

Scanned2024-05-27T14:38:46+00:00
URL https://elite-network.co.jp/robots.txt
Redirect https://www.elite-network.co.jp/robots.txt
Redirect Domain www.elite-network.co.jp
Redirect Base elite-network.co.jp
Domain IPs 210.140.221.143
Redirect IPs 151.101.130.225, 151.101.194.225, 151.101.2.225, 151.101.66.225, 2a04:4e42:200::737, 2a04:4e42:400::737, 2a04:4e42:600::737, 2a04:4e42::737
Response IP 199.232.46.225
Found Yes
Hash c22d47a52e60b055343a2ec18eebd0dc07d43625198bb04bab443e4d00cb6f55
SimHash 640c4080c2d0

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

*

Rule Path
Disallow /include/parts/job_list_jobdetail.html
Disallow /include/parts/k_job_list_jobdetail.html
Disallow /include/recruit_count.html