bpca.ny.gov
robots.txt

Robots Exclusion Standard data for bpca.ny.gov

Resource Scan

Scan Details

Site Domain bpca.ny.gov
Base Domain ny.gov
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-30T21:44:45+00:00
Next Scan 2024-07-29T21:44:45+00:00

Last Successful Scan

Scanned2023-03-15T20:13:13+00:00
URL https://bpca.ny.gov/robots.txt
Domain IPs 18.214.18.200, 3.213.250.219, 34.206.153.9, 35.153.77.116, 44.214.115.56, 52.86.254.142, 54.82.85.23
Response IP 44.214.115.56
Found Yes
Hash 60ce362516d599bbd7d3531667a239efd8f66aa6d4dde9119998c0c906aeaf05
SimHash 610098004f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://bpca.ny.gov/wp-sitemap.xml