joblookup.com
robots.txt
Robots Exclusion Standard data for joblookup.com
Resource Scan
Scan Details
| Site Domain | joblookup.com |
| Base Domain | joblookup.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-03-22T17:55:47+00:00 |
| Next Scan | 2025-05-21T17:55:47+00:00 |
Last Successful Scan
| Scanned | 2023-09-06T10:37:56+00:00 |
| URL | https://joblookup.com/robots.txt |
| Domain IPs | 104.26.0.116, 104.26.1.116, 172.67.73.195, 2606:4700:20::681a:174, 2606:4700:20::681a:74, 2606:4700:20::ac43:49c3 |
| Response IP | 104.26.1.116 |
| Found | Yes |
| Hash | 62ecd492c3d3e9ff711f4bdfe2d7c8ee53ee5f01c2c53067b40e8b7ccdc7cfca |
| SimHash | 1777d5cb451b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /api/ |
| Disallow | /uk/delay/job/ |
| Disallow | /uk/dispatch/job/ |
| Disallow | /uk/post/job/ |
| Disallow | /uk/redirect/job/ |
| Disallow | /us/delay/job/ |
| Disallow | /us/dispatch/job/ |
| Disallow | /us/post/job/ |
| Disallow | /us/redirect/job/ |
| Disallow | /email/job/ |
| Disallow | /logger |
| Disallow | /sync |
| Disallow | /ajax/ |