travelmarket.dk
robots.txt

Robots Exclusion Standard data for travelmarket.dk

Resource Scan

Scan Details

Site Domain travelmarket.dk
Base Domain travelmarket.dk
Scan Status Ok
Last Scan2024-09-29T02:11:33+00:00
Next Scan 2024-10-06T02:11:33+00:00

Last Scan

Scanned2024-09-29T02:11:33+00:00
URL https://travelmarket.dk/robots.txt
Redirect https://www.travelmarket.dk/robots.txt
Redirect Domain www.travelmarket.dk
Redirect Base travelmarket.dk
Domain IPs 89.221.160.31
Redirect IPs 89.221.160.31
Response IP 89.221.160.31
Found Yes
Hash 18e9c774ab4f7727000ecb441494d158957a707bf24a9811806ce18b7df190a1
SimHash d5754d56206b

Groups

bingbot
adidxbot

Rule Path
Disallow /tse_common/
Disallow /tse_common_pub/
Disallow /tse_charter/
Disallow /tse_charter_pub/
Disallow /tse_flight/
Disallow /tse_flight_pub/
Disallow /tse_theme/
Disallow /tse_theme_pub/
Disallow /tm_textad/
Disallow /tse_priceagent/
Disallow /cfml/stat_links.cfm
Disallow /stat_links.cfm
Disallow /cfml/stat_links
Disallow /cfml/print.cfm
Disallow /tmcomponents/modules/tse/
Disallow /tgt/tse.cfm
Disallow /tse_v2.cfm
Disallow /tse.cfm
Disallow /cfml/tse_v2.cfm
Disallow /cfml/tse.cfm
Disallow /print.cfm
Disallow /ajax.cfm
Disallow /inc/ajax/normalbrowse.cfm
Disallow /theme_v1_ajax_requests.cfm
Disallow /flight_v3_click_through.cfm
Disallow /charter_v3_ajax_requests.cfm
Disallow /charter_v5_ajax_requests.cfm
Disallow /iframe_text_ad.cfm
Disallow /inc/ajax/email_ajax_request.cfm
Disallow /catalogue_ajax.cfm
Disallow /hotel_v1_ajax_requests.cfm
Disallow /tse_listbox.cfm
Disallow /tmcomponents/modules/text_ad/iframe_text_ad.cfm
Disallow /partner/
Disallow /oslo_lufthavn_banner/
Disallow /tmcomponents/modules/traveloffer/stat_query.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v4_feedback.cfm
Disallow /welcome_back_ajax_requests.cfm
Disallow /inc/ajax/travelofferfixedresult.cfm
Disallow /hotel_v2_ajax_requests.cfm
Disallow /e-book-confirm.cfm
Disallow /tmcomponents/modules/tm_charter/public/charter_v4_click_through.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/*
Disallow /tmcomponents/modules/tm_flight_hotel_tse/public/ajax/*
Disallow /tmcomponents/modules/tm_flight_tse/public/ajax/*
Disallow /tmcomponents/modules/tm_super_search/public/ajax/*
Disallow /flight_hotel_v1_click_through.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /flight_v3_list.cfm
Disallow /charter_v5_list.cfm
Disallow /charter_v3_list.cfm
Disallow /lastminute_v3_list.cfm
Disallow /tmcomponents/modules/tm_charter/public/theme_v1_click_through.cfm
Disallow /tmcomponents/modules/tm_flight_tse/public/flight_v3_click_through.cfm
Disallow /tse_charter/public/ajax/charter_v8_ajax.cfm
Disallow /tse_flight/public/ajax/flight_v8_ajax.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v7_requests.cfm
Disallow /blog/attractions/*
Disallow /blog/lp_accomodation/*
Disallow /blog/lp_flight/*
Disallow /blog/faq/*
Disallow /blog/lp_charter/*
Disallow /hoteldetails.cfm

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /tse_common/
Disallow /tse_common_pub/
Disallow /tse_charter/
Disallow /tse_charter_pub/
Disallow /tse_flight/
Disallow /tse_flight_pub/
Disallow /tse_theme/
Disallow /tse_theme_pub/
Disallow /tm_textad/
Disallow /cfml/stat_links.cfm
Disallow /stat_links.cfm
Disallow /cfml/stat_links
Disallow /cfml/print.cfm
Disallow /tmcomponents/modules/tse/
Disallow /tgt/tse.cfm
Disallow /tse_v2.cfm
Disallow /tse.cfm
Disallow /cfml/tse_v2.cfm
Disallow /cfml/tse.cfm
Disallow /print.cfm
Disallow /ajax.cfm
Disallow /inc/ajax/normalbrowse.cfm
Disallow /theme_v1_ajax_requests.cfm
Disallow /flight_v3_click_through.cfm
Disallow /charter_v3_ajax_requests.cfm
Disallow /charter_v5_ajax_requests.cfm
Disallow /iframe_text_ad.cfm
Disallow /inc/ajax/email_ajax_request.cfm
Disallow /catalogue_ajax.cfm
Disallow /hotel_v1_ajax_requests.cfm
Disallow /tse_listbox.cfm
Disallow /tmcomponents/modules/text_ad/iframe_text_ad.cfm
Disallow /partner/
Disallow /oslo_lufthavn_banner/
Disallow /tmcomponents/modules/traveloffer/stat_query.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v4_feedback.cfm
Disallow /welcome_back_ajax_requests.cfm
Disallow /inc/ajax/travelofferfixedresult.cfm
Disallow /hotel_v2_ajax_requests.cfm
Disallow /e-book-confirm.cfm
Disallow /tmcomponents/modules/tm_charter/public/charter_v4_click_through.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/*
Disallow /tmcomponents/modules/tm_flight_hotel_tse/public/ajax/*
Disallow /tmcomponents/modules/tm_flight_tse/public/ajax/*
Disallow /tmcomponents/modules/tm_super_search/public/ajax/*
Disallow /flight_hotel_v1_click_through.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /flight_v3_list.cfm
Disallow /charter_v5_list.cfm
Disallow /charter_v3_list.cfm
Disallow /lastminute_v3_list.cfm
Disallow /tmcomponents/modules/tm_charter/public/theme_v1_click_through.cfm
Disallow /tmcomponents/modules/tm_flight_tse/public/flight_v3_click_through.cfm
Disallow /tse_charter/public/ajax/charter_v8_ajax.cfm
Disallow /tse_flight/public/ajax/flight_v8_ajax.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v7_requests.cfm
Disallow /blog/attractions/*
Disallow /blog/lp_accomodation/*
Disallow /blog/lp_flight/*
Disallow /blog/faq/*
Disallow /blog/lp_charter/*
Disallow /hoteldetails.cfm

googlebot

Rule Path
Disallow /tse_common/
Disallow /tse_common_pub/
Disallow /tse_charter/
Disallow /tse_charter_pub/
Disallow /tse_flight/
Disallow /tse_flight_pub/
Disallow /tse_theme/
Disallow /tse_theme_pub/
Disallow /tm_textad/
Disallow /cfml/stat_links.cfm
Disallow /stat_links.cfm
Disallow /cfml/stat_links
Disallow /cfml/print.cfm
Disallow /tmcomponents/modules/tse/
Disallow /tgt/tse.cfm
Disallow /tse_v2.cfm
Disallow /tse.cfm
Disallow /cfml/tse_v2.cfm
Disallow /cfml/tse.cfm
Disallow /print.cfm
Disallow /ajax.cfm
Disallow /inc/ajax/normalbrowse.cfm
Disallow /theme_v1_ajax_requests.cfm
Disallow /flight_v3_click_through.cfm
Disallow /charter_v3_ajax_requests.cfm
Disallow /charter_v5_ajax_requests.cfm
Disallow /iframe_text_ad.cfm
Disallow /inc/ajax/email_ajax_request.cfm
Disallow /catalogue_ajax.cfm
Disallow /hotel_v1_ajax_requests.cfm
Disallow /tse_listbox.cfm
Disallow /tmcomponents/modules/text_ad/iframe_text_ad.cfm
Disallow /partner/
Disallow /oslo_lufthavn_banner/
Disallow /tmcomponents/modules/traveloffer/stat_query.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v4_feedback.cfm
Disallow /welcome_back_ajax_requests.cfm
Disallow /inc/ajax/travelofferfixedresult.cfm
Disallow /hotel_v2_ajax_requests.cfm
Disallow /e-book-confirm.cfm
Disallow /tmcomponents/modules/tm_charter/public/charter_v4_click_through.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/*
Disallow /tmcomponents/modules/tm_flight_hotel_tse/public/ajax/*
Disallow /tmcomponents/modules/tm_flight_tse/public/ajax/*
Disallow /tmcomponents/modules/tm_super_search/public/ajax/*
Disallow /flight_hotel_v1_click_through.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /flight_v3_list.cfm
Disallow /tmcomponents/modules/tm_charter/public/theme_v1_click_through.cfm
Disallow /tmcomponents/modules/tm_flight_tse/public/flight_v3_click_through.cfm
Disallow /tse_charter/public/ajax/charter_v8_ajax.cfm
Disallow /tse_flight/public/ajax/flight_v8_ajax.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v7_requests.cfm
Disallow /blog/attractions/*
Disallow /blog/lp_accomodation/*
Disallow /blog/lp_flight/*
Disallow /blog/faq/*
Disallow /blog/lp_charter/*
Disallow /hoteldetails.cfm

adsbot-google

Rule Path
Disallow /tse_common/
Disallow /tse_common_pub/
Disallow /tse_charter/
Disallow /tse_charter_pub/
Disallow /tse_flight/
Disallow /tse_flight_pub/
Disallow /tse_theme/
Disallow /tse_theme_pub/
Disallow /tm_textad/
Disallow /flight_v3_click_through.cfm
Disallow /flight_v3_list.cfm
Disallow /tmcomponents/modules/tm_flight_tse/public/ajax/flight.cfm
Disallow /tmcomponents/modules/tm_flight_tse/public/ajax/flight_v7_ajax_requests.cfm
Disallow /tmcomponents/modules/tm_charter/public/charter_v4_click_through.cfm
Disallow /packages.cfm
Disallow /tmcomponents/modules/tm_super_search/public/ajax/super_search_v1_ajax_requests.cfm
Disallow /tmcomponents/modules/tm_hotel_tse/public/ajax/hotel_v2_supersearch_requests.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/charter_v5_supersearch_requests.cfm
Disallow /tmcomponents/modules/tm_flight_hotel_tse/public/ajax/flight_hotel_v2_ajax_requests.cfm
Disallow /tmcomponents/modules/tm_charter/public/ajax/theme_v1_supersearch_requests.cfm
Disallow /tmcomponents/modules/TM_Flight_Hotel_TSE/public/flight_hotel_v2_click_through.cfm
Disallow /tmcomponents/modules/tm_charter/public/charter_v4_click_through.cfm
Disallow /theme_v1_ajax_requests.cfm
Disallow /flight_hotel_v1_click_through.cfm
Disallow /travelclub_offer_clickthrough.cfm
Disallow /tmcomponents/modules/tm_charter/public/theme_v1_click_through.cfm
Disallow /vp_click_theme.htm
Disallow /tmcomponents/modules/tm_flight_tse/public/flight_v3_click_through.cfm
Disallow /hoteldetails.cfm

adsbot-google-mobile

Rule Path
Disallow /tse_common/
Disallow /tse_common_pub/
Disallow /tse_charter/
Disallow /tse_charter_pub/
Disallow /tse_flight/
Disallow /tse_flight_pub/
Disallow /tse_theme/
Disallow /tse_theme_pub/
Disallow /tm_textad/
Disallow /tmcomponents/modules/tm_flight_tse/public/ajax/flight.cfm
Disallow /tse_flight/public/ajax/flight_v8_ajax.cfm
Disallow /flight_v3_list.cfm
Disallow /tmcomponents/modules/tm_flight_tse/public/flight_v3_click_through.cfm
Disallow /tmcomponents/modules/tm_click_through/public/ajax/click_through_v1_ajax_requests.cfm
Disallow /tmcomponents/modules/tm_charter/public/charter_v4_click_through.cfm
Disallow /tse_theme/public/ajax/theme_v3_ajax.cfm
Disallow /theme_v1_list.cfm
Disallow /tmcomponents/modules/tm_charter/public/theme_v1_click_through.cfm
Disallow /hoteldetails.cfm

femtosearchbot
petalbot
moget
ichiro
naverbot
yeti
baiduspider
baiduspider-video
baiduspider-image
sogou spider
youdaobot

Rule Path
Disallow /