disastersites.com
robots.txt
Robots Exclusion Standard data for disastersites.com
Resource Scan
Scan Details
| Site Domain | disastersites.com |
| Base Domain | disastersites.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-11-11T03:03:37+00:00 |
| Next Scan | 2025-11-18T03:03:37+00:00 |
Last Successful Scan
| Scanned | 2025-11-02T03:21:25+00:00 |
| URL | https://disastersites.com/robots.txt |
| Domain IPs | 50.28.12.135 |
| Response IP | 50.28.12.135 |
| Found | Yes |
| Hash | cfa9ccf2cb947449a5f23b5915cfd528f56ebf14a3583a307244dd6ed99ac064 |
| SimHash | e04c1709c590 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /application/ |
| Disallow | /development/ |
| Disallow | /externals/ |
| Disallow | /temporary/ |
Other Records
| Field | Value |
|---|---|
| sitemap | /index.php/sitemap?format=xml&rewrite=1 |