funstra.com
robots.txt

Robots Exclusion Standard data for funstra.com

Resource Scan

Scan Details

Site Domain funstra.com
Base Domain funstra.com
Scan Status Ok
Last Scan2025-12-08T20:57:44+00:00
Next Scan 2026-01-07T20:57:44+00:00

Last Scan

Scanned2025-12-08T20:57:44+00:00
URL https://funstra.com/robots.txt
Domain IPs 104.21.15.149, 172.67.206.84, 2606:4700:3031::6815:f95, 2606:4700:3033::ac43:ce54
Response IP 172.67.206.84
Found Yes
Hash fb2da37241fb5aabfbc354fe098908e6f40b5ef46587c70bf5c26706d8859123
SimHash 2f05b9e36382

Groups

*

Rule Path
Disallow /ajax/
Disallow /*?*
Disallow /*?SID=
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /sendfriend/
Disallow /wishlist/

Comments

  • Do not crawl query strings
  • Do not crawl links with session IDs
  • Do not crawl seach pages and not-SEO catalog links
  • Disallow: /review/ ##added nofollow to review.xml
  • Disallow: /blog/wp-content/themes/genie/