Log In Sign Up

m.yelp.co.uk
robots.txt

Robots Exclusion Standard data for m.yelp.co.uk

Resource Scan

Scan Details

Site Domain m.yelp.co.uk
Base Domain yelp.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-01T08:31:58+00:00
Next Scan 2025-04-30T08:31:58+00:00

Last Successful Scan

Scanned2024-12-25T08:30:57+00:00
URL https://m.yelp.co.uk/robots.txt
Redirect https://www.yelp.co.uk/robots.txt
Redirect Domain www.yelp.co.uk
Redirect Base yelp.co.uk
Domain IPs 108.156.144.22, 108.156.144.23, 108.156.144.35, 108.156.144.62
Redirect IPs 108.156.144.22, 108.156.144.23, 108.156.144.35, 108.156.144.62
Response IP 108.156.144.62
Found Yes
Hash c081e49c507441ea03b29d31578c15c2e153f1650b08e4b6106aaebdc57ecb02
SimHash 2d1795356555

Groups

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
google-inspectiontool
googlebot
googlebot-mobile
mediapartners-google

Rule Path
Disallow /1014943
Disallow /3584794
Disallow /5787254
Disallow /ad_acknowledgment
Disallow /ad_spice
Disallow /ad_visibility
Disallow /adredir?
Disallow /adtrack
Disallow /advertise?
Disallow /biz/*?*&translate=1*
Disallow /biz/*?*&translate=True*
Disallow /biz/*?translate=1*
Disallow /biz/*?translate=True*
Disallow /biz/*destination%3D*
Disallow /biz/impression/*
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-0
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-1
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-2
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-3
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-4
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-5
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-6
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-7
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-8
Disallow /biz/outlook-autumn-market-fundamental-catwalk-flimsy-roost-legibility-individualism-grocer-predestination-9
Disallow /biz_attribute
Disallow /biz_link
Disallow /biz_photos/*/log_views
Disallow /biz_photos/feedback/
Disallow /biz_redir
Disallow /biz_share
Disallow /biz_update
Disallow /bookmark?
Disallow /browse/reviews/recent
Disallow /client_errors
Disallow /elite?
Disallow /events/export/
Disallow /facebook_connect
Disallow /flag_content?
Disallow /gamtarget
Disallow /location_suggest
Disallow /login?
Disallow /mail?
Disallow /menu/*/feedback_form
Disallow /message_the_business
Disallow /mss/review_feedback/
Disallow /mtb_composer
Disallow /not_recommended_reviews
Disallow /photo/
Disallow /possible_biz_owner
Disallow /px.gif
Disallow /redir?
Disallow /review_feed_auto_fetch
Disallow /search_suggest
Disallow /send_to_friend
Disallow /signup?
Disallow /sit_rep
Disallow /spice
Disallow /start_order
Disallow /syndicate
Disallow /talk/new_topic
Disallow /thanx?
Disallow /transaction_platform/start_order
Disallow /user_details_answers_given
Disallow /user_details_bookmarks
Disallow /user_details_friends
Disallow /user_details_reviews_self
Disallow /user_details_thanx
Disallow /user_photos
Disallow /weekly/signup
Disallow /writeareview/
Disallow /yuv

google-extended

Rule Path
Disallow /

bingbot
*

Rule Path
Disallow /
Back to top

Comments

  • By accessing Yelp's website (© 2024) you agree to Yelp's Terms of Service, available at
  • https://www.yelp.com/static?country=US&p=tos
  • If you would like to inquire about crawling Yelp, please contact us at
  • https://www.yelp.com/contact
  • As always, Asimov's Three Laws are in effect:
  • 1. A robot may not injure a human being or, through inaction, allow a human
  • being to come to harm.
  • 2. A robot must obey orders given it by human beings except where such
  • orders would conflict with the First Law.
  • 3. A robot must protect its own existence as long as such protection does
  • not conflict with the First or Second Law.
Back to top