health.ny.gov
robots.txt
Robots Exclusion Standard data for health.ny.gov
Resource Scan
Scan Details
Site Domain | health.ny.gov |
Base Domain | ny.gov |
Scan Status | Ok |
Last Scan | 2024-09-19T17:49:23+00:00 |
Next Scan | 2024-10-19T17:49:23+00:00 |
Last Scan
Scanned | 2024-09-19T17:49:23+00:00 |
URL | https://health.ny.gov/robots.txt |
Domain IPs | 13.226.34.23, 13.226.34.59, 13.226.34.67, 13.226.34.74 |
Response IP | 13.226.34.23 |
Found | Yes |
Hash | 347f4e83afc53e0f907bc477f55864ee5b2ba81e98acee734a301d6f879cbafb |
SimHash | 7c505d006b13 |
Groups
*
Rule | Path |
---|---|
Disallow | /statistics/cancer/environmental_facilities_and_cancer_incidence/ |