Log In Sign Up

preparationrecipe.com
robots.txt

Robots Exclusion Standard data for preparationrecipe.com

Resource Scan

Scan Details

Site Domain preparationrecipe.com
Base Domain preparationrecipe.com
Scan Status Ok
Last Scan2025-09-12T13:28:19+00:00
Next Scan 2025-09-19T13:28:19+00:00

Last Scan

Scanned2025-09-12T13:28:19+00:00
URL https://preparationrecipe.com/robots.txt
Domain IPs 104.21.69.252, 172.67.216.32, 2606:4700:3035::6815:45fc, 2606:4700:3035::ac43:d820
Response IP 104.21.69.252
Found Yes
Hash ba6ca109fe5bdd3a0a93709961b1c92b5f63dea1d0481b9d6f97241659e311cf
SimHash 6b635a612252

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /cgi-bin/
Disallow /tmp/
Disallow /private/
Disallow /cart/
Disallow /checkout/
Disallow /thank-you/
Disallow /?s=
Disallow /search
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /images/
Allow /css/
Allow /js/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.preparationrecipe.com/sitemap_index.xml
Back to top

Comments

  • robots.txt for https://www.preparationrecipe.com
  • Last reviewed: 21 Jun 2025
  • ------------------------------------------------------------------
  • 1. Default rules for every crawler (incl. Google, Bing & DuckDuckBot)
  • ------------------------------------------------------------------
  • --- Block admin, system, and e-commerce funnels -------------
  • --- Block thin/duplicate content ----------------------------
  • --- Allow resources needed for rendering --------------------
  • Optionally drop the next line to hide your plugin list
  • Allow: /wp-content/plugins/
  • ------------------------------------------------------------------
  • 2. Block specific aggressive or competitive crawlers
  • ------------------------------------------------------------------
  • ------------------------------------------------------------------
  • 3. Sitemap
  • ------------------------------------------------------------------
Back to top