careers.deeset.co.uk
robots.txt
Robots Exclusion Standard data for careers.deeset.co.uk
Resource Scan
Scan Details
| Site Domain | careers.deeset.co.uk |
| Base Domain | deeset.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-03T11:16:56+00:00 |
| Next Scan | 2024-12-03T11:16:56+00:00 |
Last Scan
| Scanned | 2024-11-03T11:16:56+00:00 |
| URL | https://careers.deeset.co.uk/robots.txt |
| Domain IPs | 2600:9000:20fe:5800:5:f79a:3040:93a1, 2600:9000:20fe:6000:5:f79a:3040:93a1, 2600:9000:20fe:6800:5:f79a:3040:93a1, 2600:9000:20fe:9a00:5:f79a:3040:93a1, 2600:9000:20fe:c00:5:f79a:3040:93a1, 2600:9000:20fe:d400:5:f79a:3040:93a1, 2600:9000:20fe:dc00:5:f79a:3040:93a1, 2600:9000:20fe:f800:5:f79a:3040:93a1, 65.9.112.13, 65.9.112.3, 65.9.112.78, 65.9.112.85 |
| Response IP | 108.157.214.93 |
| Found | Yes |
| Hash | 36136a9f8f36956e8b2154d17efce75b3da72f3b59a97d510cf0377db1f88cad |
| SimHash | 0c0d89ffd15e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */ajaxaction/* |
| Disallow | */action/* |
| Disallow | /500.html |
| Disallow | /admin/* |
| Disallow | /agency/* |
| Disallow | /calendar/* |
| Disallow | /emailimages/* |
| Disallow | /file/* |
| Disallow | /sso/* |
| Disallow | /webservices/* |
| Disallow | /intranet/* |
| Disallow | /redeployment/* |
| Disallow | /commonincludes/* |
| Disallow | /applicantportalincludes/* |
| Disallow | /adminportalincludes/* |
| Disallow | /assessments/* |
| Disallow | /tupe/* |
| Disallow | /jobs/vacancy/find/results/map |
| Disallow | /jobs/vacancy/find/results/map/ |
| Disallow | /staging/vacancy/find/results/map |
| Disallow | /staging/vacancy/find/results/map/ |
| Disallow | /cmst/vacancy/find/results/map |
| Disallow | /cmst/vacancy/find/results/map/ |