health.ny.gov
robots.txt
Robots Exclusion Standard data for health.ny.gov
Resource Scan
Scan Details
| Site Domain | health.ny.gov |
| Base Domain | ny.gov |
| Scan Status | Ok |
| Last Scan | 2024-05-22T17:43:54+00:00 |
| Next Scan | 2024-06-21T17:43:54+00:00 |
Last Scan
| Scanned | 2024-05-22T17:43:54+00:00 |
| URL | https://health.ny.gov/robots.txt |
| Domain IPs | 108.138.128.116, 108.138.128.118, 108.138.128.22, 108.138.128.3 |
| Response IP | 108.138.128.118 |
| Found | Yes |
| Hash | 347f4e83afc53e0f907bc477f55864ee5b2ba81e98acee734a301d6f879cbafb |
| SimHash | 7c505d006b13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /statistics/cancer/environmental_facilities_and_cancer_incidence/ |