crabtreeandcrabtree.com
robots.txt

Robots Exclusion Standard data for crabtreeandcrabtree.com

Resource Scan

Scan Details

Site Domain crabtreeandcrabtree.com
Base Domain crabtreeandcrabtree.com
Scan Status Ok
Last Scan2025-06-12T04:02:04+00:00
Next Scan 2025-07-12T04:02:04+00:00

Last Scan

Scanned2025-06-12T04:02:04+00:00
URL https://crabtreeandcrabtree.com/robots.txt
Domain IPs 62.100.206.179
Response IP 62.100.206.179
Found Yes
Hash f4fc93924fa76383e6f7842cff240ce9b744824af5fbf21fd47dc36731339f70
SimHash c968ccc0a413

Groups

*

Rule Path
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow *?ver=

Other Records

Field Value
sitemap https://www.crabtreeandcrabtree.com/sitemap_index.xml
sitemap https://www.crabtreeandcrabtree.com/wp-content/plugins/creatomatic-sam/includes/sam-sitemap.php
sitemap https://www.crabtreeandcrabtree.com/sitemap_index.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK