yelp.com.hk
robots.txt

Robots Exclusion Standard data for yelp.com.hk

Resource Scan

Scan Details

Site Domain yelp.com.hk
Base Domain yelp.com.hk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-31T02:19:55+00:00
Next Scan 2024-06-30T02:19:55+00:00

Last Successful Scan

Scanned2024-04-25T02:18:36+00:00
URL https://yelp.com.hk/robots.txt
Redirect https://zh.yelp.com.hk/robots.txt
Redirect Domain zh.yelp.com.hk
Redirect Base yelp.com.hk
Domain IPs 108.157.254.105, 108.157.254.51, 108.157.254.78, 108.157.254.80
Redirect IPs 108.157.254.105, 108.157.254.51, 108.157.254.78, 108.157.254.80
Response IP 108.157.254.80
Found Yes
Hash 1f4c871457b2604c690c06403dee44a861f518fd3673f207254a4fbc93c80510
SimHash ad173531e75e

Groups

*
bingbot
adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
mediapartners-google

Rule Path
Disallow /

Comments

  • By accessing Yelp's website (© 2024) you agree to Yelp's Terms of Service, available at
  • https://www.yelp.com/static?country=US&p=tos
  • If you would like to inquire about crawling Yelp, please contact us at
  • https://www.yelp.com/contact
  • As always, Asimov's Three Laws are in effect:
  • 1. A robot may not injure a human being or, through inaction, allow a human
  • being to come to harm.
  • 2. A robot must obey orders given it by human beings except where such
  • orders would conflict with the First Law.
  • 3. A robot must protect its own existence as long as such protection does
  • not conflict with the First or Second Law.