nonguiltypleasures.com
robots.txt

Robots Exclusion Standard data for nonguiltypleasures.com

Resource Scan

Scan Details

Site Domain nonguiltypleasures.com
Base Domain nonguiltypleasures.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan7/3/2025, 12:31:11 AM
Next Scan 7/17/2025, 12:31:11 AM

Last Successful Scan

Scanned6/17/2025, 6:20:47 PM
URL https://nonguiltypleasures.com/robots.txt
Redirect https://www.nonguiltypleasures.com/robots.txt
Redirect Domain www.nonguiltypleasures.com
Redirect Base nonguiltypleasures.com
Domain IPs 104.21.1.65, 172.67.128.188, 2606:4700:3034::6815:141, 2606:4700:3034::ac43:80bc
Redirect IPs 104.18.37.69, 172.64.150.187, 2606:4700:4400::6812:2545, 2606:4700:4400::ac40:96bb
Response IP 172.64.150.187
Found Yes
Hash a668f17f3bf93db053909e6f246b1a5a3164a228ff1d2b323b67145ef17307ea
SimHash a5cc6a40e410

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.nonguiltypleasures.com/sitemap_index.xml

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK