Log In Sign Up

purovitalis.com
robots.txt

Robots Exclusion Standard data for purovitalis.com

Resource Scan

Scan Details

Site Domain purovitalis.com
Base Domain purovitalis.com
Scan Status Ok
Last Scan2025-12-03T12:24:00+00:00
Next Scan 2025-12-17T12:24:00+00:00

Last Scan

Scanned2025-12-03T12:24:00+00:00
URL https://purovitalis.com/robots.txt
Domain IPs 172.66.40.232, 172.66.43.24, 2606:4700:3108::ac42:28e8, 2606:4700:3108::ac42:2b18
Response IP 172.66.40.232
Found Yes
Hash fdead7d4e823d5bcfc93a35c49567f9118c65f8d5ebb684837d6ec9bfc7e7da6
SimHash e0d89e726683

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path Comment
Disallow /?s= -
Disallow /page/*/?s= -
Disallow /search/ -
Disallow /cart/ -
Disallow /checkout/ -
Disallow /my-account/ -
Disallow /account/ -
Disallow /orders/ -
Disallow /wc-api/ -
Disallow /*add-to-cart%3D* -
Disallow /*?*srsltid= -
Disallow /*?orderby= duplicate sorting URLs
Disallow /*?filter_* faceted search duplicates
Disallow /*?utm_* -
Disallow /*?fbclid=* -
Disallow /*?v=* -

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15

semrushsiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15
Back to top

Other Records

Field Value
sitemap https://purovitalis.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • =========================================
  • Robots.txt for WooCommerce (Purovitalis)
  • =========================================
  • Allow Google full crawling (ignore crawl-delay anyway)
  • Block obvious aggressive bots
  • =========================================
  • Crawl-delay setup for SEO tools
  • =========================================
  • Ahrefs main crawler (link index)
  • Ahrefs Site Audit (keep allowed for your audits)
  • Semrush main crawler (link index)
  • Semrush Site Audit (keep allowed for your audits)
  • ---------------------------
  • END YOAST BLOCK
Back to top