crushwins.com
robots.txt

Robots Exclusion Standard data for crushwins.com

Resource Scan

Scan Details

Site Domain crushwins.com
Base Domain crushwins.com
Scan Status Ok
Last Scan2025-10-24T13:08:48+00:00
Next Scan 2025-11-07T13:08:48+00:00

Last Scan

Scanned2025-10-24T13:08:48+00:00
URL https://crushwins.com/robots.txt
Redirect https://www.crushwins.com/robots.txt
Redirect Domain www.crushwins.com
Redirect Base crushwins.com
Domain IPs 104.21.73.96, 172.67.189.91
Redirect IPs 104.21.73.96, 172.67.189.91
Response IP 172.67.189.91
Found Yes
Hash 8e864fdacc73fb7734113795ecbb477dbf58e1c733ee394fcb4f22059d4918ca
SimHash 4901db50c594

Groups

*

Rule Path
Disallow /shared_files/
Allow /shared_files/scripts.js

Other Records

Field Value
sitemap https://www.crushwins.com/sitemap.xml