awayholidays.co.uk
robots.txt
Robots Exclusion Standard data for awayholidays.co.uk
Resource Scan
Scan Details
Site Domain | awayholidays.co.uk |
Base Domain | awayholidays.co.uk |
Scan Status | Ok |
Last Scan | 2024-10-22T05:21:24+00:00 |
Next Scan | 2024-11-21T05:21:24+00:00 |
Last Scan
Scanned | 2024-10-22T05:21:24+00:00 |
URL | https://awayholidays.co.uk/robots.txt |
Redirect | https://www.awayholidays.co.uk/robots.txt |
Redirect Domain | www.awayholidays.co.uk |
Redirect Base | awayholidays.co.uk |
Domain IPs | 104.18.28.40, 104.18.29.40, 2606:4700::6812:1c28, 2606:4700::6812:1d28 |
Redirect IPs | 104.18.28.40, 104.18.29.40, 2606:4700::6812:1c28, 2606:4700::6812:1d28 |
Response IP | 104.18.28.40 |
Found | Yes |
Hash | 5190e86f02355fd9896cb0d3585fb0296caf66dad25a62d89fc0f7c0866e7f59 |
SimHash | 89099698fc3b |
Groups
*
Rule | Path |
---|---|
Disallow | /awayholidaysapp/ |
Disallow | /awayholidaysapp/* |
Disallow | /AwayHolidayApp/404.aspx?* |
Disallow | /brochure/ |
Disallow | /blogs/ |
Disallow | /promotions/ |
Disallow | /travelguide/ |
Disallow | /UpdatedNewAwayHotelListUSA.aspx |
Disallow | /UpdatedNewAwayHotelList.aspx |
Disallow | /UpdatedNewAwayHotelList.aspx?* |
Allow | /promotions/atlantis-the-palm/ |
Allow | /promotions/atlantis-the-royal/ |
Disallow | /backend* |
Disallow | /AwayHolidayApp/NewAwayEnquiry.aspx* |
Disallow | /tours-email-enquiry/tourenquirypage.aspx* |
Disallow | /hoteldetail/tourhoteldetail.aspx?* |
Disallow | /holidays-tours/tour/search?* |
Disallow | /awayholidayapp/multicentre-enquiry.aspx?* |
Disallow | */emailtofriend/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.awayholidays.co.uk/sitemap.xml |