crushaderstech.com
robots.txt

Robots Exclusion Standard data for crushaderstech.com

Resource Scan

Scan Details

Site Domain crushaderstech.com
Base Domain crushaderstech.com
Scan Status Ok
Last Scan2025-07-21T17:26:12+00:00
Next Scan 2025-08-20T17:26:12+00:00

Last Scan

Scanned2025-07-21T17:26:12+00:00
URL https://crushaderstech.com/robots.txt
Domain IPs 66.235.200.113
Response IP 66.235.200.113
Found Yes
Hash 89bee0df7d45d735e91fa7016be2df4fcdbcaf549efc15b0d5ef024baea9de36
SimHash 6d0d5844c593

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap http://crushaderstech.com/sitemap.xml