northyorkrangers.org
robots.txt
Robots Exclusion Standard data for northyorkrangers.org
Resource Scan
Scan Details
| Site Domain | northyorkrangers.org |
| Base Domain | northyorkrangers.org |
| Scan Status | Ok |
| Last Scan | 2024-09-22T00:50:59+00:00 |
| Next Scan | 2024-09-29T00:50:59+00:00 |
Last Scan
| Scanned | 2024-09-22T00:50:59+00:00 |
| URL | http://northyorkrangers.org/robots.txt |
| Domain IPs | 34.171.199.74 |
| Response IP | 34.171.199.74 |
| Found | Yes |
| Hash | 8e6e5200e334e98a15770ded2f4a3fd8cf9c28f581ace3092677d540f3f76d56 |
| SimHash | 980c106baff3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /p/ |
| Disallow | /thumbnail_images/ |
| Disallow | /buttons/ |
| Disallow | /rosters/*/events.pdf* |
| Disallow | /rosters/*/statistics.pdf |
| Disallow | /themes/* |
| Disallow | *.zip |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.northyorkrangers.org/sitemap.xml |