cwill.us
robots.txt
Robots Exclusion Standard data for cwill.us
Resource Scan
Scan Details
| Site Domain | cwill.us |
| Base Domain | cwill.us |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2025-10-24T17:04:53+00:00 |
| Next Scan | 2025-11-07T17:04:53+00:00 |
Last Successful Scan
| Scanned | 2025-09-16T17:04:02+00:00 |
| URL | https://cwill.us/robots.txt |
| Domain IPs | 104.26.8.167, 104.26.9.167, 172.67.73.47, 2606:4700:20::681a:8a7, 2606:4700:20::681a:9a7, 2606:4700:20::ac43:492f |
| Response IP | 104.26.8.167 |
| Found | Yes |
| Hash | 9fb30f06a456321bf3ebbdea60af32e8691e975a563506a2c4eae1329d67ddc5 |
| SimHash | e0144594ef53 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ghost/ |
| Disallow | /email/ |
| Disallow | /members/api/comments/counts/ |
| Disallow | /r/ |
| Disallow | /webmentions/receive/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cwill.us/sitemap.xml |