cl.9781x.xyz
robots.txt
Robots Exclusion Standard data for cl.9781x.xyz
Resource Scan
Scan Details
| Site Domain | cl.9781x.xyz |
| Base Domain | 9781x.xyz |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 3/25/2025, 7:31:57 PM |
| Next Scan | 5/24/2025, 7:31:57 PM |
Last Successful Scan
| Scanned | 1/2/2025, 7:29:38 PM |
| URL | https://cl.9781x.xyz/robots.txt |
| Domain IPs | 104.21.24.134, 172.67.218.243, 2606:4700:3032::6815:1886, 2606:4700:3037::ac43:daf3 |
| Response IP | 172.67.218.243 |
| Found | Yes |
| Hash | b17aa6b7ef0b7a282aa874ed527e7833858577a213f0423a756811fcff01ad8a |
| SimHash | 750079524f54 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /require/ |
| Disallow | /libs/ |
| Disallow | /hack/ |
| Disallow | /attachment/ |
| Disallow | /images/ |
| Disallow | /data/ |
| Disallow | /ipdata/ |
| Disallow | /template/ |
Warnings
- `request-rate` is not a known field.
Comments