simplysalesjobs.co.uk
robots.txt
Robots Exclusion Standard data for simplysalesjobs.co.uk
Resource Scan
Scan Details
| Site Domain | simplysalesjobs.co.uk |
| Base Domain | simplysalesjobs.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-02T16:43:23+00:00 |
| Next Scan | 2024-11-09T16:43:23+00:00 |
Last Scan
| Scanned | 2024-11-02T16:43:23+00:00 |
| URL | https://simplysalesjobs.co.uk/robots.txt |
| Redirect | https://www.simplysalesjobs.co.uk/robots.txt |
| Redirect Domain | www.simplysalesjobs.co.uk |
| Redirect Base | simplysalesjobs.co.uk |
| Domain IPs | 104.26.14.46, 104.26.15.46, 172.67.75.31, 2606:4700:20::681a:e2e, 2606:4700:20::681a:f2e, 2606:4700:20::ac43:4b1f |
| Redirect IPs | 104.26.14.46, 104.26.15.46, 172.67.75.31, 2606:4700:20::681a:e2e, 2606:4700:20::681a:f2e, 2606:4700:20::ac43:4b1f |
| Response IP | 172.67.75.31 |
| Found | Yes |
| Hash | 0139fde84a20ad424438f18cc17d0ca6045a3c42f0b3fab4aa8d198e3fa24131 |
| SimHash | 6d1854565237 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /__r_frontend_dev.php |
| Disallow | /__r_frontend_dev.php/ |
| Disallow | /apply-job/ |
| Disallow | /recommend-job/ |
| Disallow | /email-job/ |
| Disallow | /job-bookmark/ |
| Disallow | /application-signup-new/ |
| Disallow | /external-application-signup/ |
| Disallow | /qa-post-login/ |
| Disallow | /careers/*/* |
| Disallow | /api/ |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.simplysalesjobs.co.uk/en-GB/sitemap/index.xml |
Warnings
- `noindex` is not a known field.