onthebeach.co.uk
robots.txt
Robots Exclusion Standard data for onthebeach.co.uk
Resource Scan
Scan Details
| Site Domain | onthebeach.co.uk |
| Base Domain | onthebeach.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-17T09:02:08+00:00 |
| Next Scan | 2024-10-01T09:02:08+00:00 |
Last Scan
| Scanned | 2024-09-17T09:02:08+00:00 |
| URL | https://onthebeach.co.uk/robots.txt |
| Redirect | https://www.onthebeach.co.uk/robots.txt |
| Redirect Domain | www.onthebeach.co.uk |
| Redirect Base | onthebeach.co.uk |
| Domain IPs | 104.17.18.115, 104.17.19.115, 2606:4700::6811:1273, 2606:4700::6811:1373 |
| Redirect IPs | 104.17.18.115, 104.17.19.115, 2606:4700::6811:1273, 2606:4700::6811:1373 |
| Response IP | 104.17.19.115 |
| Found | Yes |
| Hash | 0f2a461964c2827923e8ee62b218d75d9fec9a1f545da9eb32152e5a3a87da3b |
| SimHash | fc7152d8ce93 |
Groups
twitterbot
| Rule | Path |
|---|---|
| Disallow | /flight_searches/ |
| Disallow | /hotel_searches/ |
| Disallow | /checkout/ |
| Disallow | /basket/ |
| Disallow | /ajax/ |
| Disallow | /no_results_redirect/ |
| Disallow | /searches/ |
| Disallow | /server_status |
| Disallow | /tripadvisor/ |
| Disallow | /gatekeeper/ |
| Disallow | /helios_deals/ |
| Disallow | /light_box/ |
| Disallow | /status |
| Disallow | /results |
| Disallow | /holiday/ |
*
| Rule | Path |
|---|---|
| Disallow | /flight_searches/ |
| Disallow | /hotel_searches/ |
| Disallow | /deals/ |
| Disallow | /checkout/ |
| Disallow | /basket/ |
| Disallow | /popups/ |
| Disallow | /ajax/ |
| Disallow | /no_results_redirect/ |
| Disallow | /searches/ |
| Disallow | /server_status |
| Disallow | /tripadvisor/ |
| Disallow | /email_review/ |
| Disallow | /gatekeeper/ |
| Disallow | /hotels/*/trip_advisor_reviews$ |
| Disallow | /deal/results/ |
| Disallow | /helios_deals/ |
| Disallow | /light_box/ |
| Disallow | /status |
| Disallow | /results |
| Disallow | /holiday/ |
| Disallow | /account-contact-us |
| Disallow | /the-departure-lounge |
| Disallow | /holidays/perks/free-airport-lounge/vib-access |
| Disallow | /cdn-cgi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.onthebeach.co.uk/sitemap.xml |