nyc.gov
robots.txt

Robots Exclusion Standard data for nyc.gov

Resource Scan

Scan Details

Site Domain nyc.gov
Base Domain nyc.gov
Scan Status Ok
Last Scan2024-06-17T14:08:26+00:00
Next Scan 2024-07-01T14:08:26+00:00

Last Scan

Scanned2024-06-17T14:08:26+00:00
URL https://nyc.gov/robots.txt
Redirect https://www.nyc.gov:443/robots.txt
Redirect Domain www.nyc.gov
Redirect Base nyc.gov
Domain IPs 157.188.12.160
Redirect IPs 104.110.76.20, 2600:1417:3f:b8c::1500, 2600:1417:3f:ba7::1500
Response IP 104.111.207.156
Found Yes
Hash 2bc363ecd41731d45a1e4fbdf6f7cfc7a6a88b746ab35bb36c4e80d36d23995a
SimHash 7c554000c9d2

Groups

*

Rule Path
Disallow /html/misc/