happycow.net
robots.txt

Robots Exclusion Standard data for happycow.net

Resource Scan

Scan Details

Site Domain happycow.net
Base Domain happycow.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T11:04:58+00:00
Next Scan 2024-11-27T11:04:58+00:00

Last Successful Scan

Scanned2024-10-29T11:04:10+00:00
URL https://happycow.net/robots.txt
Redirect https://www.happycow.net/robots.txt
Redirect Domain www.happycow.net
Redirect Base happycow.net
Domain IPs 107.154.146.2, 45.60.96.2
Redirect IPs 107.154.150.2
Response IP 107.154.150.2
Found Yes
Hash 067fcf42cd5d9349cb478d3c2595df15d08c60326cc040f52b52c8e1bc81fe7d
SimHash 2339841e4d92

Groups

*

Rule Path
Disallow /api/
Disallow /hcediting/

mediapartners-google

Rule Path
Disallow

googlebot-mobile

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.happycow.net/sitemaps/sitemap-index.xml

Comments

  • Even robots must agree to HappyCow site Terms of Use (especially robots!)
  • https://www.happycow.net/terms-of-use
  • Disallow: /ajax/user-data
  • Disallow: /ajax/views/mobile
  • Disallow: /ajax/views/cookie
  • Disallow: /img/points/
  • Disallow: /img/mobile/
  • Disallow: /img/hc_ambassador.png
  • Disallow: /img/category/