us.jobtome.com
robots.txt
Robots Exclusion Standard data for us.jobtome.com
Resource Scan
Scan Details
Site Domain | us.jobtome.com |
Base Domain | jobtome.com |
Scan Status | Ok |
Last Scan | 2024-04-18T17:29:48+00:00 |
Next Scan | 2024-05-18T17:29:48+00:00 |
Last Scan
Scanned | 2024-04-18T17:29:48+00:00 |
URL | https://us.jobtome.com/robots.txt |
Domain IPs | 104.26.14.161, 104.26.15.161, 172.67.69.217 |
Response IP | 172.67.69.217 |
Found | Yes |
Hash | 13de8122855ce43de2d1af506b4d167a42543e4516625f1c446119ed440d2780 |
SimHash | c702c6c4c710 |
Groups
*
Rule | Path |
---|---|
Disallow | /search/getjob |
Disallow | /i/* |
Disallow | /cd/* |
Disallow | /private/search |
Disallow | *fo%3D1 |
Disallow | /feed-wel/ |
Disallow | /ads/ |
Disallow | *%26orgn%3D113 |
Warnings
- 2 invalid lines.
Comments