thewesternnews.com
robots.txt
Robots Exclusion Standard data for thewesternnews.com
Resource Scan
Scan Details
| Site Domain | thewesternnews.com |
| Base Domain | thewesternnews.com |
| Scan Status | Ok |
| Last Scan | 2024-11-16T14:01:26+00:00 |
| Next Scan | 2024-11-23T14:01:26+00:00 |
Last Scan
| Scanned | 2024-11-16T14:01:26+00:00 |
| URL | https://thewesternnews.com/robots.txt |
| Domain IPs | 208.91.62.24, 208.91.62.25, 208.91.62.26, 208.91.62.27 |
| Response IP | 208.91.62.27 |
| Found | Yes |
| Hash | 0708430ea83c28e530379e327b72ab36a8b541328cd8d9fff6bdf5b05ebcc230 |
| SimHash | 1014db424033 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /accounts/login/ |
| Disallow | /users/ |
| Disallow | /ratings/votes/ |
*
| Rule | Path |
|---|---|
| Allow | / |
Comments