spareroom.com
robots.txt
Robots Exclusion Standard data for spareroom.com
Resource Scan
Scan Details
| Site Domain | spareroom.com |
| Base Domain | spareroom.com |
| Scan Status | Ok |
| Last Scan | 2024-06-04T19:41:17+00:00 |
| Next Scan | 2024-06-11T19:41:17+00:00 |
Last Scan
| Scanned | 2024-06-04T19:41:17+00:00 |
| URL | https://spareroom.com/robots.txt |
| Redirect | https://www.spareroom.com/robots.txt |
| Redirect Domain | www.spareroom.com |
| Redirect Base | spareroom.com |
| Domain IPs | 151.101.130.49, 151.101.194.49, 151.101.2.49, 151.101.66.49 |
| Redirect IPs | 151.101.130.49, 151.101.194.49, 151.101.2.49, 151.101.66.49 |
| Response IP | 199.232.46.49 |
| Found | Yes |
| Hash | c79d70525fc6eb88a72cf330de2e3fbd79285d8bf5534104e5abeb7912f3a7f4 |
| SimHash | a155c8c113a1 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
slurp
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
amazonbot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
bingbot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
msnbot
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
teoma
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
yandex
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
*
| Rule | Path |
|---|---|
| Disallow | /downloads/ |
| Disallow | /virtual/ |
| Disallow | /www.googletagmanager.com |
| Disallow | /ajax.googleapis.com |
| Disallow | /cdn.optimizely.com |
| Disallow | /el/ |
| Disallow | /emailsout_trk/ |
| Disallow | /pro/* |
| Disallow | /roommate/wanted_listing_step1.pl?* |
| Disallow | /roommate/facebook_connect.pl |
| Disallow | /roommate/savesearch.pl |
| Disallow | /roommate/shortlist.pl |
| Disallow | /roommate/savesearch_confirm.pl |
| Disallow | /roommate/upload-photo-request.pl |
| Disallow | /roommate/*search_id%3D |
| Disallow | /roommate/search_copy_n_edit.pl |
| Disallow | /roommate/search.pl?*action=search |
| Disallow | /roommate/room_for_rent.pl |
| Disallow | /roommate/roommate_detail.pl |
| Disallow | /spotlightclick.pl* |
| Disallow | /rooms-for-rent/*filter%3Dshowall |
| Disallow | /rooms-for-rent/*sort_by%3Ddays_since_placed |
| Disallow | /rooms-for-rent/*sort_by%3Dlast_updated |
| Disallow | /rooms-for-rent/*sort_by%3Dprice_high_to_low |
| Disallow | /roommates/*filter%3Dshowall |
| Disallow | /roommates/*sort_by%3Ddays_since_placed |
| Disallow | /roommates/*sort_by%3Dlast_updated |
| Disallow | /roommates/*sort_by%3Dprice_high_to_low |
| Disallow | /rooms-for-rent/*posttown_id%3D |
| Disallow | /rooms-for-rent/*postcode_id%3D |
| Disallow | /rooms-for-rent/*lookup%3D |
| Disallow | /rooms-for-rent/*lookup_county%3D |
| Disallow | /rooms-for-rent/*lookup_state%3D |
| Disallow | /rooms-for-rent/*lookup_area%3D |
| Disallow | /rooms-for-rent/*fakedir_name%3D |
| Disallow | /rooms-for-rent/*urlsession_id%3D |
| Disallow | /rooms-for-rent/*urlsession_key%3D |
| Disallow | /rooms-for-rent/*user_id%3D |
| Disallow | /rooms-for-rent/*username%3D |
| Disallow | /rooms-for-rent/*min_rent%3D |
| Disallow | /rooms-for-rent/*max_rent%3D |
| Disallow | /rooms-for-rent/*per%3D |
| Disallow | /rooms-for-rent/*min_beds%3D |
| Disallow | /rooms-for-rent/*max_beds%3D |
| Disallow | /rooms-for-rent/*no_of_rooms%3D |
| Disallow | /rooms-for-rent/*photoadsonly%3D |
| Disallow | /rooms-for-rent/*disabled_access%3D |
| Disallow | /rooms-for-rent/*living_room%3D |
| Disallow | /rooms-for-rent/*bills_inc%3D |
| Disallow | /rooms-for-rent/*fees_apply%3D |
| Disallow | /rooms-for-rent/*vegetarians%3D |
| Disallow | /rooms-for-rent/*max_degrees%3D |
| Disallow | /rooms-for-rent/*min_term%3D |
| Disallow | /rooms-for-rent/*max_term%3D |
| Disallow | /rooms-for-rent/*short_lets_considered%3D |
| Disallow | /rooms-for-rent/*landlord%3D |
| Disallow | /rooms-for-rent/*keyword%3D |
| Disallow | /rooms-for-rent/*smoking%3D |
| Disallow | /rooms-for-rent/*min_age_req%3D |
| Disallow | /rooms-for-rent/*max_age_req%3D |
| Disallow | /rooms-for-rent/*min_suitable_age%3D |
| Disallow | /rooms-for-rent/*max_suitable_age%3D |
| Disallow | /rooms-for-rent/*gender_req%3D |
| Disallow | /rooms-for-rent/*available_from%3D |
| Disallow | /rooms-for-rent/*year_avail%3D |
| Disallow | /rooms-for-rent/*mon_avail%3D |
| Disallow | /rooms-for-rent/*day_avail%3D |
| Disallow | /rooms-for-rent/*available_search%3D |
| Disallow | /rooms-for-rent/*days_of_wk_available%3D7%2Bdays%2Ba%2Bweek |
| Disallow | /rooms-for-rent/*days_of_wk_available%3DWeekends%2Bonly |
| Disallow | /flatshare/ |
| Disallow | /flatmate/ |
| Disallow | /virtual/ |
| Disallow | /roommate/api.pl |
| Disallow | /content/plain/terms-us |
| Disallow | /content/plain/privacy-us |
| Disallow | /roommate/reg.pl |
| Disallow | /flatshare/wanted_listing_step1.pl?* |
| Disallow | /flatshare/facebook_connect.pl |
| Disallow | /flatshare/search_copy_n_edit.pl |