Log In Sign Up

nature-provides.com
robots.txt

Robots Exclusion Standard data for nature-provides.com

Resource Scan

Scan Details

Site Domain nature-provides.com
Base Domain nature-provides.com
Scan Status Ok
Last Scan2025-09-23T01:21:27+00:00
Next Scan 2025-10-23T01:21:27+00:00

Last Scan

Scanned2025-09-23T01:21:27+00:00
URL https://nature-provides.com/robots.txt
Domain IPs 104.26.6.93, 104.26.7.93, 172.67.70.252, 2606:4700:20::681a:65d, 2606:4700:20::681a:75d, 2606:4700:20::ac43:46fc
Response IP 104.26.7.93
Found Yes
Hash 00b894e6941cf1b8b1ed9b505fde47f8bd533219382dbd3d8aab2d63259a9a1f
SimHash 395ed2ca0533

Groups

*

Rule Path
Disallow /cart/
Disallow /checkout/
Disallow /my-account/
Disallow /addons/
Disallow /wp-admin/
Disallow /?s=
Disallow /search/
Disallow /cart-2/
Disallow /checkout-2/
Disallow /my-account-2/
Disallow /*?yith-woocompare-add-product=
Disallow /*?add_to_wishlist==
Allow /wp-admin/admin-ajax.php
Disallow /readme.html
Disallow /license.txt
Disallow /wp-content/plugins/
Disallow /*?orderby=
Disallow /*?add-to-cart=
Disallow /*?filter_
Back to top

Comments

  • Block core system pages
  • Allow essential admin-ajax.php for functionality
  • Block WordPress sensitive files
  • Block plugin directories
  • Block duplicate query params (sorting, filtering if they cause crawl bloat)
Back to top