sunweb.co.uk
robots.txt
Robots Exclusion Standard data for sunweb.co.uk
Resource Scan
Scan Details
| Site Domain | sunweb.co.uk |
| Base Domain | sunweb.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-21T13:10:22+00:00 |
| Next Scan | 2024-10-05T13:10:22+00:00 |
Last Scan
| Scanned | 2024-09-21T13:10:22+00:00 |
| URL | https://sunweb.co.uk/robots.txt |
| Redirect | https://www.sunweb.co.uk/robots.txt |
| Redirect Domain | www.sunweb.co.uk |
| Redirect Base | sunweb.co.uk |
| Domain IPs | 15.197.167.90, 3.33.186.135 |
| Redirect IPs | 13.215.31.72, 175.41.180.202, 2406:da18:b3d:e200::1f4, 2406:da18:b3d:e201::1f4 |
| Response IP | 13.215.246.123 |
| Found | Yes |
| Hash | 536d71722162414f3ecb8bcd66a16edfdf8cfc3587ef2487f23541dc7667dc04 |
| SimHash | b8d07bc7c4b4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/search? |
| Disallow | *%26Duration* |
| Disallow | *%26Participants* |
| Disallow | *%26ParticipantsDistribution* |
| Disallow | *%26TransportType* |
| Disallow | /sitecore |
| Disallow | /*/booking/* |
| Disallow | /login?* |
| Disallow | /my-sunweb* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sunweb.co.uk/sitemap-index.xml |
Comments