crmsite.net
robots.txt

Robots Exclusion Standard data for crmsite.net

Resource Scan

Scan Details

Site Domain crmsite.net
Base Domain crmsite.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-03T21:42:23+00:00
Next Scan 2025-07-02T21:42:23+00:00

Last Successful Scan

Scanned2023-11-18T19:12:40+00:00
URL https://crmsite.net/robots.txt
Domain IPs 104.21.4.41, 172.67.131.163, 2606:4700:3037::6815:429, 2606:4700:3037::ac43:83a3
Response IP 104.21.4.41
Found Yes
Hash a8b8c6e2e69586a9c4c800bd145c5e016345f7f9355d06e4f5853e24e6421791
SimHash 8c506f486bd2

Groups

*

Rule Path
Disallow /content/*

Comments

  • robots.txt for all our sites