hairsoutofplace.com
robots.txt

Robots Exclusion Standard data for hairsoutofplace.com

Resource Scan

Scan Details

Site Domain hairsoutofplace.com
Base Domain hairsoutofplace.com
Scan Status Ok
Last Scan2025-10-20T14:53:25+00:00
Next Scan 2025-10-27T14:53:25+00:00

Last Scan

Scanned2025-10-20T14:53:25+00:00
URL https://hairsoutofplace.com/robots.txt
Domain IPs 104.21.91.209, 172.67.180.113, 2606:4700:3033::ac43:b471, 2606:4700:3035::6815:5bd1
Response IP 172.67.180.113
Found Yes
Hash ac61920f4852ad3f5921ab30e72925103d1af5e5faa490232b9f7ca1c6511cfd
SimHash a4c06b40e610

Groups

*

Rule Path
Disallow /cdn-cgi/
Disallow /*add-to-cart%3D*

Comments

  • Prevent Crawling Unnecessary Endpoints - Dynamically added by BigScoots