Log In Sign Up

barstack.com
robots.txt

Robots Exclusion Standard data for barstack.com

Resource Scan

Scan Details

Site Domain barstack.com
Base Domain barstack.com
Scan Status Ok
Last Scan2025-11-05T16:28:57+00:00
Next Scan 2025-11-12T16:28:57+00:00

Last Scan

Scanned2025-11-05T16:28:57+00:00
URL https://barstack.com/robots.txt
Domain IPs 104.21.84.222, 172.67.197.101, 2606:4700:3032::ac43:c565, 2606:4700:3037::6815:54de
Response IP 172.67.197.101
Found Yes
Hash 96e1b71dd52eaa40f126a5c9da0a96c1b5a8ceb9de630c0cc3f7de00ac984b09
SimHash be850d9f6f54

Groups

*

Rule Path
Disallow /debug
Disallow /search
Disallow /users/sign_in
Disallow /users/sign_up
Disallow /api/v1/bars/recipes.json
Disallow /api/v1/bars/ingredients.json
Disallow /api/v1/bars/inventory.json
Disallow /api/v1/recipes/show.json
Disallow /api/v1/recipes/updated_since.json
Disallow /api/v1/ingredients/show.json
Disallow /api/v1/ingredients/updated_since.json
Disallow /api/v1/users/show_current.json
Disallow /api/v1/bars/custom_bars.json
Disallow /api/v2/bars/recipes.json
Disallow /api/v2/bars/ingredients.json
Disallow /api/v2/bars/inventory.json
Disallow /api/v2/recipes/show.json
Disallow /api/v2/recipes/updated_since.json
Disallow /api/v2/ingredients/show.json
Disallow /api/v2/ingredients/updated_since.json
Disallow /api/v2/users/show_current.json
Disallow /api/v2/bars/custom_bars.json
Disallow /api/v2/bars/add_ingredient.json
Disallow /api/v2/bars/add_recommendation.json
Disallow /api/v2/bars/remove_ingredient.json
Disallow /api/v2/bars/remove_recommendation.json
Disallow /api/v2/upc/lookup.json
Disallow /api/v2/upc/vote.json
Back to top

Other Records

Field Value
sitemap http://barstack.com/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top