shiftco.global
robots.txt
Robots Exclusion Standard data for shiftco.global
Resource Scan
Scan Details
| Site Domain | shiftco.global |
| Base Domain | shiftco.global |
| Scan Status | Ok |
| Last Scan | 2024-11-05T02:16:49+00:00 |
| Next Scan | 2024-11-19T02:16:49+00:00 |
Last Scan
| Scanned | 2024-11-05T02:16:49+00:00 |
| URL | https://shiftco.global/robots.txt |
| Domain IPs | 104.17.59.185 |
| Response IP | 104.17.59.185 |
| Found | Yes |
| Hash | 8ab36cdc0a26b70b02e2a9e5d0806577ef716af9a911dc61392e86e169c40125 |
| SimHash | 2d44d801e9fb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /pick-institution |
| Disallow | /terms |
| Disallow | /privacy-policy |
| Disallow | /legal |
| Disallow | /backoffice |
| Disallow | /networks/*/recruiter/jobs |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shiftco.global/sitemap.xml |