flightcentre.co.uk
robots.txt
Robots Exclusion Standard data for flightcentre.co.uk
Resource Scan
Scan Details
Site Domain | flightcentre.co.uk |
Base Domain | flightcentre.co.uk |
Scan Status | Ok |
Last Scan | 2024-09-26T16:37:45+00:00 |
Next Scan | 2024-10-10T16:37:45+00:00 |
Last Scan
Scanned | 2024-09-26T16:37:45+00:00 |
URL | https://flightcentre.co.uk/robots.txt |
Redirect | https://www.flightcentre.co.uk/robots.txt |
Redirect Domain | www.flightcentre.co.uk |
Redirect Base | flightcentre.co.uk |
Domain IPs | 54.229.57.103 |
Redirect IPs | 108.157.254.24, 108.157.254.32, 108.157.254.34, 108.157.254.96, 2600:9000:2753:2400:1a:49b4:5e80:93a1, 2600:9000:2753:3000:1a:49b4:5e80:93a1, 2600:9000:2753:3600:1a:49b4:5e80:93a1, 2600:9000:2753:7000:1a:49b4:5e80:93a1, 2600:9000:2753:8e00:1a:49b4:5e80:93a1, 2600:9000:2753:9200:1a:49b4:5e80:93a1, 2600:9000:2753:a00:1a:49b4:5e80:93a1, 2600:9000:2753:d800:1a:49b4:5e80:93a1 |
Response IP | 108.157.254.24 |
Found | Yes |
Hash | c08b291f25caa0e16463562bff8aa8512fd70e720a4df1c366af6eb4b9edf82f |
SimHash | 78969d03cf50 |
Groups
*
Rule | Path |
---|---|
Allow | /misc/*.css |
Allow | /misc/*.js |
Allow | /misc/*.gif |
Allow | /misc/*.jpg |
Allow | /misc/*.jpeg |
Allow | /misc/*.png |
Allow | /modules/*.css |
Allow | /modules/*.js |
Allow | /modules/*.gif |
Allow | /modules/*.jpg |
Allow | /modules/*.jpeg |
Allow | /modules/*.png |
Allow | /profiles/*.css |
Allow | /profiles/*.js |
Allow | /profiles/*.gif |
Allow | /profiles/*.jpg |
Allow | /profiles/*.jpeg |
Allow | /profiles/*.png |
Allow | /themes/*.css |
Allow | /themes/*.js |
Allow | /themes/*.gif |
Allow | /themes/*.jpg |
Allow | /themes/*.jpeg |
Allow | /themes/*.png |
Allow | /search/blogs* |
Disallow | /includes/ |
Disallow | /misc/ |
Disallow | /modules/ |
Disallow | /themes/ |
Disallow | */cms/* |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips/ |
Disallow | /node/add/ |
Disallow | /search/* |
Disallow | /user/register/ |
Disallow | /user/password/ |
Disallow | /user/login/ |
Disallow | /user/logout/ |
Disallow | /flightbooking/ |
Disallow | /?q=admin%2F |
Disallow | /?q=comment%2Freply%2F |
Disallow | /?q=filter%2Ftips%2F |
Disallow | /?q=node%2Fadd%2F |
Disallow | /?q=search%2F |
Disallow | /?q=user%2Fpassword%2F |
Disallow | /?q=user%2Fregister%2F |
Disallow | /?q=user%2Flogin%2F |
Disallow | /?q=user%2Flogout%2F |
Disallow | /no-edge/content-api/ |
Disallow | /store/appointment/form/ |
Disallow | /stores/appointment/form/ |
Disallow | /quote?sku= |
Disallow | /*/search |
Disallow | /product/ |
Disallow | /file/ |
Disallow | */quote/ |
Disallow | /booking |
Disallow | /web/ |
Disallow | /info/ |
Disallow | /travel-news/ |
Disallow | /taxonomy/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.flightcentre.co.uk/sitemap.xml |
sitemap | https://www.flightcentre.co.uk/aurora/api/sitemap/en-GB/content-sitemap.xml?types=blog_post,rich_page,blogs_landing,holidays_landing,holidays_destination,holidays_type,travel_guide_page |
sitemap | https://www.flightcentre.co.uk/sitemap.xml |
Comments