nyserda.ny.gov
robots.txt
Robots Exclusion Standard data for nyserda.ny.gov
Resource Scan
Scan Details
| Site Domain | nyserda.ny.gov |
| Base Domain | ny.gov |
| Scan Status | Ok |
| Last Scan | 2024-05-31T02:58:37+00:00 |
| Next Scan | 2024-06-30T02:58:37+00:00 |
Last Scan
| Scanned | 2024-05-31T02:58:37+00:00 |
| URL | https://nyserda.ny.gov/robots.txt |
| Redirect | https://www.nyserda.ny.gov/robots.txt |
| Redirect Domain | www.nyserda.ny.gov |
| Redirect Base | ny.gov |
| Domain IPs | 104.18.12.160, 104.18.13.160 |
| Redirect IPs | 104.18.12.160, 104.18.13.160 |
| Response IP | 104.18.12.160 |
| Found | Yes |
| Hash | 7c4f239525f77d2b70eb94c7f83355b25a644ab7b598be1686da304bbdb0c175 |
| SimHash | 3011ea04ef96 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?p=1 |
| Disallow | /ph/ |
| Disallow | /Test/* |
| Disallow | /goto/ |
| Disallow | /staff/* |
Warnings
- 1 invalid line.