nyc.gov
robots.txt

Robots Exclusion Standard data for nyc.gov

Resource Scan

Scan Details

Site Domain nyc.gov
Base Domain nyc.gov
Scan Status Ok
Last Scan2024-11-05T00:25:35+00:00
Next Scan 2024-11-19T00:25:35+00:00

Last Scan

Scanned2024-11-05T00:25:35+00:00
URL https://nyc.gov/robots.txt
Redirect https://www.nyc.gov/robots.txt
Redirect Domain www.nyc.gov
Redirect Base nyc.gov
Domain IPs 157.188.15.121
Redirect IPs 23.210.101.240, 2600:1413:1:484::1500, 2600:1413:1:497::1500
Response IP 23.210.101.240
Found Yes
Hash 2bc363ecd41731d45a1e4fbdf6f7cfc7a6a88b746ab35bb36c4e80d36d23995a
SimHash 7c554000c9d2

Groups

*

Rule Path
Disallow /html/misc/