jp.jobtome.com
robots.txt
Robots Exclusion Standard data for jp.jobtome.com
Resource Scan
Scan Details
Site Domain | jp.jobtome.com |
Base Domain | jobtome.com |
Scan Status | Ok |
Last Scan | 2024-04-21T11:09:34+00:00 |
Next Scan | 2024-05-21T11:09:34+00:00 |
Last Scan
Scanned | 2024-04-21T11:09:34+00:00 |
URL | https://jp.jobtome.com/robots.txt |
Domain IPs | 104.26.14.161, 104.26.15.161, 172.67.69.217 |
Response IP | 104.26.14.161 |
Found | Yes |
Hash | 13de8122855ce43de2d1af506b4d167a42543e4516625f1c446119ed440d2780 |
SimHash | c702c6c4c710 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/getjob |
Disallow | /i/* |
Disallow | /cd/* |
Disallow | /private/search |
Disallow | *fo%3D1 |
Disallow | /feed-wel/ |
Disallow | /ads/ |
Disallow | *%26orgn%3D113 |
Warnings
- 2 invalid lines.
Comments