bpretailjobs.co.uk
robots.txt
Robots Exclusion Standard data for bpretailjobs.co.uk
Resource Scan
Scan Details
| Site Domain | bpretailjobs.co.uk |
| Base Domain | bpretailjobs.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-14T03:36:14+00:00 |
| Next Scan | 2024-12-14T03:36:14+00:00 |
Last Scan
| Scanned | 2024-11-14T03:36:14+00:00 |
| URL | https://www.bpretailjobs.co.uk/robots.txt |
| Domain IPs | 2600:9000:2024:1600:3:6495:c780:93a1, 2600:9000:2024:5600:3:6495:c780:93a1, 2600:9000:2024:6000:3:6495:c780:93a1, 2600:9000:2024:7600:3:6495:c780:93a1, 2600:9000:2024:a600:3:6495:c780:93a1, 2600:9000:2024:aa00:3:6495:c780:93a1, 2600:9000:2024:e00:3:6495:c780:93a1, 2600:9000:2024:e400:3:6495:c780:93a1, 65.9.112.126, 65.9.112.46, 65.9.112.48, 65.9.112.49 |
| Response IP | 65.9.112.49 |
| Found | Yes |
| Hash | b39c438cdfa3e38eaafef7166c5c50b297682ff2087ffafc92b2733de12c7868 |
| SimHash | 2c1d89fa4b5e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */ajaxaction/* |
| Disallow | */action/* |
| Disallow | /500.html |
| Disallow | /admin/* |
| Disallow | /agency/* |
| Disallow | /calendar/* |
| Disallow | /emailimages/* |
| Disallow | /webservices/* |
| Disallow | /intranet/* |
| Disallow | /commonincludes/* |
| Disallow | /applicantportalincludes/* |
| Disallow | /adminportalincludes/* |
| Disallow | /file/* |
| Disallow | /onlineassessments/* |
| Disallow | /sso/* |
| Disallow | /redeployment/* |
| Disallow | /jobs/vacancy/find/results/map |
| Disallow | /jobs/vacancy/find/results/map/ |
| Disallow | /rebrand/vacancy/find/results/map |
| Disallow | /rebrand/vacancy/find/results/map/ |
| Disallow | /staging/vacancy/find/results/map |
| Disallow | /staging/vacancy/find/results/map/ |