open-data.nyc
robots.txt

Robots Exclusion Standard data for open-data.nyc

Resource Scan

Scan Details

Site Domain open-data.nyc
Base Domain open-data.nyc
Scan Status Ok
Last Scan2025-04-19T18:24:21+00:00
Next Scan 2025-05-19T18:24:21+00:00

Last Scan

Scanned2025-04-19T18:24:21+00:00
URL https://open-data.nyc/robots.txt
Redirect https://2025.open-data.nyc/robots.txt
Redirect Domain 2025.open-data.nyc
Redirect Base open-data.nyc
Domain IPs 173.236.197.237
Redirect IPs 173.236.238.124
Response IP 173.236.238.124
Found Yes
Hash 5ac4d17402351945c1dc54246249275c70675e92cb2726bf7ab549b51557e358
SimHash 41005c0009b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://2025.open-data.nyc/wp-sitemap.xml