Log In Sign Up

farmy.ch
robots.txt

Robots Exclusion Standard data for farmy.ch

Resource Scan

Scan Details

Site Domain farmy.ch
Base Domain farmy.ch
Scan Status Ok
Last Scan2024-09-19T06:32:56+00:00
Next Scan 2024-10-03T06:32:56+00:00

Last Scan

Scanned2024-09-19T06:32:56+00:00
URL https://farmy.ch/robots.txt
Domain IPs 93.92.134.165
Response IP 93.92.134.165
Found Yes
Hash 6f1e62b6c095afaf566503c9061c4d3ebfe21ae4046ce84412b60d39b35c431e
SimHash b09c0c1f4cd0

Groups

*

Rule Path
Disallow /checkout
Disallow /cashier
Disallow /cart
Disallow /orders
Disallow /ahoy
Disallow /states
Disallow /users
Disallow /account
Disallow /user_diet_preferences
Disallow /api/frontend/notifications
Disallow /api/farmy/delivery_slots/nearest_delivery_date
Disallow /api/frontend/hubs/delivery_terms
Disallow /hubs/promo_type_from_zipcode
Disallow /ng/templates/content_promos/content_promo_dock
Disallow /api/frontend/orders/current_free_products
Disallow /api/frontend/orders/incomplete
Disallow /ng/templates/partners/partner_return_to_btn

bingbot

Rule Path
Disallow /checkout
Disallow /cashier
Disallow /cart
Disallow /orders
Disallow /ahoy
Disallow /states
Disallow /users
Disallow /account
Disallow /api

Other Records

Field Value
crawl-delay 3

audisto

Rule Path
Disallow /checkout
Disallow /cashier
Disallow /orders
Disallow /ahoy
Disallow /states
Disallow /users

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • Slow down Bingbot
  • The Audisto Full Crawler
  • Semrush
Back to top