hu.jobtome.com
robots.txt
Robots Exclusion Standard data for hu.jobtome.com
Resource Scan
Scan Details
| Site Domain | hu.jobtome.com |
| Base Domain | jobtome.com |
| Scan Status | Ok |
| Last Scan | 2024-04-21T01:37:38+00:00 |
| Next Scan | 2024-05-21T01:37:38+00:00 |
Last Scan
| Scanned | 2024-04-21T01:37:38+00:00 |
| URL | https://hu.jobtome.com/robots.txt |
| Domain IPs | 104.26.14.161, 104.26.15.161, 172.67.69.217 |
| Response IP | 104.26.14.161 |
| Found | Yes |
| Hash | 13de8122855ce43de2d1af506b4d167a42543e4516625f1c446119ed440d2780 |
| SimHash | c702c6c4c710 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/getjob |
| Disallow | /i/* |
| Disallow | /cd/* |
| Disallow | /private/search |
| Disallow | *fo%3D1 |
| Disallow | /feed-wel/ |
| Disallow | /ads/ |
| Disallow | *%26orgn%3D113 |
Warnings
- 2 invalid lines.
Comments