jobs.ps
robots.txt
Robots Exclusion Standard data for jobs.ps
Resource Scan
Scan Details
Site Domain | jobs.ps |
Base Domain | jobs.ps |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-11T04:29:26+00:00 |
Next Scan | 2024-11-09T04:29:26+00:00 |
Last Successful Scan
Scanned | 2023-04-17T14:16:44+00:00 |
URL | https://jobs.ps/robots.txt |
Redirect | https://www.jobs.ps/robots.txt |
Redirect Domain | www.jobs.ps |
Redirect Base | jobs.ps |
Domain IPs | 104.26.4.43, 104.26.5.43, 172.67.73.175, 2606:4700:20::681a:42b, 2606:4700:20::681a:52b, 2606:4700:20::ac43:49af |
Redirect IPs | 104.26.4.43, 104.26.5.43, 172.67.73.175, 2606:4700:20::681a:42b, 2606:4700:20::681a:52b, 2606:4700:20::ac43:49af |
Response IP | 104.26.4.43 |
Found | Yes |
Hash | 07145f761460018609a9c6d71a7df028a39ab68a18e847a9154f93f326df5175 |
SimHash | 0d040401d7f3 |
Groups
*
Rule | Path |
---|---|
Disallow |
*
Rule | Path |
---|---|
Disallow | /jobs/*/save$ |
Disallow | /employer/follow/* |
Disallow | /en/employer/follow/* |
Disallow | /jobs/*/send-email |
Disallow | /en/jobs/*/send-email |
Disallow | /jobs/*/report |
Disallow | /en/jobs/*/report |
Other Records
Field | Value |
---|---|
sitemap | https://www.jobs.ps/sitemap.xml |