mycity.nyc.gov
robots.txt
Robots Exclusion Standard data for mycity.nyc.gov
Resource Scan
Scan Details
| Site Domain | mycity.nyc.gov |
| Base Domain | nyc.gov |
| Scan Status | Ok |
| Last Scan | 2024-11-11T23:54:19+00:00 |
| Next Scan | 2024-11-25T23:54:19+00:00 |
Last Scan
| Scanned | 2024-11-11T23:54:19+00:00 |
| URL | https://mycity.nyc.gov/robots.txt |
| Domain IPs | 2600:1413:b000:6::17d5:2bc4, 2600:1413:b000:6::17d5:2bd8, 96.17.96.13, 96.17.96.15 |
| Response IP | 23.59.168.131 |
| Found | Yes |
| Hash | 95a779fa9fc835690c46e30d3024ce105b3d06d4864b5fa43ea1556eff112669 |
| SimHash | 6324da8ccf93 |
Groups
*
| Product | Comment |
|---|---|
| * | applies to all robots |
| Rule | Path | Comment |
|---|---|---|
| Allow | / | allow all |
| Disallow | */secur/forgotpassword.jsp?* | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://mycity.nyc.gov/s/sitemap.xml |
Comments