redgroupltd.co.uk
robots.txt
Robots Exclusion Standard data for redgroupltd.co.uk
Resource Scan
Scan Details
| Site Domain | redgroupltd.co.uk |
| Base Domain | redgroupltd.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-10-21T17:33:26+00:00 |
| Next Scan | 2025-11-04T17:33:26+00:00 |
Last Scan
| Scanned | 2025-10-21T17:33:26+00:00 |
| URL | https://redgroupltd.co.uk/robots.txt |
| Redirect | https://www.redgroupltd.co.uk/robots.txt |
| Redirect Domain | www.redgroupltd.co.uk |
| Redirect Base | redgroupltd.co.uk |
| Domain IPs | 20.90.155.179 |
| Redirect IPs | 20.90.155.179 |
| Response IP | 20.90.155.179 |
| Found | Yes |
| Hash | be82eaf0152a635ab77819f4136445bf70a07e3f8af703b2dd0400d1822d1ece |
| SimHash | 7d4d37849ad1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /download.php |
| Disallow | /filedownload.php |
| Disallow | /.well-known/security.txt |
| Disallow | /cv |
| Disallow | /api |
| Disallow | /storage/application_forms |
| Disallow | /storage/forms |
| Disallow | /storage/job_imports_xml |
| Disallow | /storage/documents/usa |
| Disallow | /storage/images/jobseeker_profile_photos |
| Disallow | /cp_email_testing.php |
| Disallow | /*page.php |
| Disallow | /*sites.php |
| Disallow | /*debug.php |
| Disallow | /*wp-admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.redgroupltd.co.uk/sitemap_index.xml |