student.spareroom.co.uk
robots.txt
Robots Exclusion Standard data for student.spareroom.co.uk
Resource Scan
Scan Details
| Site Domain | student.spareroom.co.uk |
| Base Domain | spareroom.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-29T14:17:44+00:00 |
| Next Scan | 2024-10-13T14:17:44+00:00 |
Last Scan
| Scanned | 2024-09-29T14:17:44+00:00 |
| URL | https://student.spareroom.co.uk/robots.txt |
| Domain IPs | 34.98.110.16 |
| Response IP | 34.98.110.16 |
| Found | Yes |
| Hash | 14aaa90f9d7102437090ce9cf22e92047064364aaed6ebdb8b261e77247ba244 |
| SimHash | f936f8c6b2b0 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
slurp
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
amazonbot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
bingbot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
msnbot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
teoma
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
yandex
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
*
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/savesearch.pl |
| Disallow | /flatshare/shortlist.pl |
| Disallow | /flatshare/savesearch_confirm.pl |
| Disallow | /flatshare/upload-photo-request.pl |
| Disallow | /flatshare/*search_id%3D |
| Disallow | /flatshare/*rand%3D |
| Disallow | /flatshare/*searchtype%3Dadvanced |
| Disallow | /flatshare/search_copy_n_edit.pl |
| Disallow | /flatshare/search.pl?*action=search |
| Disallow | /flatshare/flatshare_detail.pl |
| Disallow | /flatshare/flatmate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /accommodation/*filter%3Dshowall |
| Disallow | /accommodation/*rand%3D |
| Disallow | /accommodation/*sort_by%3Ddays_since_placed |
| Disallow | /accommodation/*sort_by%3Dlast_updated |
| Disallow | /accommodation/*sort_by%3Dprice_high_to_low |
| Disallow | /flatmate/*filter%3Dshowall |
| Disallow | /flatmate/*rand%3D |
| Disallow | /flatmate/*sort_by%3Ddays_since_placed |
| Disallow | /flatmate/*sort_by%3Dlast_updated |
| Disallow | /flatmate/*sort_by%3Dprice_high_to_low |
| Disallow | /accommodation/*posttown_id%3D |
| Disallow | /accommodation/*postcode_id%3D |
| Disallow | /accommodation/*lookup%3D |
| Disallow | /accommodation/*lookup_county%3D |
| Disallow | /accommodation/*lookup_state%3D |
| Disallow | /accommodation/*lookup_area%3D |
| Disallow | /accommodation/*fakedir_name%3D |
| Disallow | /accommodation/*urlsession_id%3D |
| Disallow | /accommodation/*urlsession_key%3D |
| Disallow | /accommodation/*KW%3D |
| Disallow | /accommodation/*user_id%3D |
| Disallow | /accommodation/*username%3D |
| Disallow | /accommodation/*min_rent%3D |
| Disallow | /accommodation/*max_rent%3D |
| Disallow | /accommodation/*per%3D |
| Disallow | /accommodation/*min_beds%3D |
| Disallow | /accommodation/*max_beds%3D |
| Disallow | /accommodation/*no_of_rooms%3D |
| Disallow | /accommodation/*photoadsonly%3D |
| Disallow | /accommodation/*disabled_access%3D |
| Disallow | /accommodation/*living_room%3D |
| Disallow | /accommodation/*bills_inc%3D |
| Disallow | /accommodation/*fees_apply%3D |
| Disallow | /accommodation/*vegetarians%3D |
| Disallow | /accommodation/*max_degrees%3D |
| Disallow | /accommodation/*min_term%3D |
| Disallow | /accommodation/*max_term%3D |
| Disallow | /accommodation/*short_lets_considered%3D |
| Disallow | /accommodation/*landlord%3D |
| Disallow | /accommodation/*keyword%3D |
| Disallow | /accommodation/*smoking%3D |
| Disallow | /accommodation/*min_age_req%3D |
| Disallow | /accommodation/*max_age_req%3D |
| Disallow | /accommodation/*min_suitable_age%3D |
| Disallow | /accommodation/*max_suitable_age%3D |
| Disallow | /accommodation/*gender_req%3D |
| Disallow | /accommodation/*available_from%3D |
| Disallow | /accommodation/*year_avail%3D |
| Disallow | /accommodation/*mon_avail%3D |
| Disallow | /accommodation/*day_avail%3D |
| Disallow | /accommodation/*available_search%3D |
| Disallow | /accommodation/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /accommodation/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/?* |
| Disallow | /flatshare/reg.pl?flatshare_id=* |
| Disallow | /flatshare/api.pl |