craftedbythehunts.com
robots.txt

Robots Exclusion Standard data for craftedbythehunts.com

Resource Scan

Scan Details

Site Domain craftedbythehunts.com
Base Domain craftedbythehunts.com
Scan Status Ok
Last Scan6/23/2025, 11:38:29 AM
Next Scan 6/30/2025, 11:38:29 AM

Last Scan

Scanned6/23/2025, 11:38:29 AM
URL https://craftedbythehunts.com/robots.txt
Redirect https://pineandpoplar.com/robots.txt
Redirect Domain pineandpoplar.com
Redirect Base pineandpoplar.com
Domain IPs 104.21.20.238, 172.67.194.221, 2606:4700:3034::6815:14ee, 2606:4700:3036::ac43:c2dd
Redirect IPs 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb
Response IP 104.18.37.69
Found Yes
Hash cdb84f5981ae4381d6e269b5f46a47f2ba837a1d1ed98e91537940922aad7187
SimHash a5cc4a40e412

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://pineandpoplar.com/sitemap_index.xml

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK