mitchellson.co.uk
robots.txt
Robots Exclusion Standard data for mitchellson.co.uk
Resource Scan
Scan Details
| Site Domain | mitchellson.co.uk |
| Base Domain | mitchellson.co.uk |
| Scan Status | Ok |
| Last Scan | 2025-10-22T03:16:11+00:00 |
| Next Scan | 2025-11-05T03:16:11+00:00 |
Last Scan
| Scanned | 2025-10-22T03:16:11+00:00 |
| URL | https://mitchellson.co.uk/robots.txt |
| Redirect | https://www.mitchellson.co.uk/robots.txt |
| Redirect Domain | www.mitchellson.co.uk |
| Redirect Base | mitchellson.co.uk |
| Domain IPs | 159.65.214.54 |
| Redirect IPs | 134.213.224.176 |
| Response IP | 134.213.224.176 |
| Found | Yes |
| Hash | f10dabccb335612fe45b50d84922c71054e74408ffde8a9c1477875e88fd39d2 |
| SimHash | 6c4527849ad1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /download.php |
| Disallow | /filedownload.php |
| Disallow | /.well-known/security.txt |
| Disallow | /cv |
| Disallow | /api |
| Disallow | /storage/application_forms |
| Disallow | /storage/forms |
| Disallow | /storage/job_imports_xml |
| Disallow | /storage/documents/usa |
| Disallow | /storage/images/jobseeker_profile_photos |
| Disallow | /cp_email_testing.php |
| Disallow | /*page.php |
| Disallow | /*sites.php |
| Disallow | /*debug.php |
| Disallow | /*wp-admin |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mitchellson.co.uk/sitemap_index.xml |