jobsatpendragongroup.co.uk
robots.txt
Robots Exclusion Standard data for jobsatpendragongroup.co.uk
Resource Scan
Scan Details
| Site Domain | jobsatpendragongroup.co.uk |
| Base Domain | jobsatpendragongroup.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-12T03:55:38+00:00 |
| Next Scan | 2024-11-11T03:55:38+00:00 |
Last Scan
| Scanned | 2024-10-12T03:55:38+00:00 |
| URL | https://www.jobsatpendragongroup.co.uk/robots.txt |
| Domain IPs | 2600:9000:2024:3c00:e:a68:4980:93a1, 2600:9000:2024:4200:e:a68:4980:93a1, 2600:9000:2024:5c00:e:a68:4980:93a1, 2600:9000:2024:7a00:e:a68:4980:93a1, 2600:9000:2024:7c00:e:a68:4980:93a1, 2600:9000:2024:8400:e:a68:4980:93a1, 2600:9000:2024:a200:e:a68:4980:93a1, 2600:9000:2024:d400:e:a68:4980:93a1, 65.9.112.113, 65.9.112.22, 65.9.112.30, 65.9.112.70 |
| Response IP | 18.165.140.121 |
| Found | Yes |
| Hash | 8f558016e3e405c92d920aa60ef81524a21079735b35a438c8bb8826ba57c9b7 |
| SimHash | 6d14a1f9d11e |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */ajaxaction/* |
| Disallow | */action/* |
| Disallow | /500.html |
| Disallow | /admin/* |
| Disallow | /agency/* |
| Disallow | /calendar/* |
| Disallow | /emailimages/* |
| Disallow | /file/* |
| Disallow | /sso/* |
| Disallow | /webservices/* |
| Disallow | /intranet/* |
| Disallow | /commonincludes/* |
| Disallow | /applicantportalincludes/* |
| Disallow | /adminportalincludes/* |
| Disallow | /assessments/* |
| Disallow | /redeployment/* |
| Disallow | /supporthub/* |
| Disallow | /jobs/vacancy/find/results/map |
| Disallow | /jobs/vacancy/find/results/map/ |
| Disallow | /refresh/vacancy/find/results/map |
| Disallow | /refresh/vacancy/find/results/map/ |