thecity.nyc
robots.txt

Robots Exclusion Standard data for thecity.nyc

Resource Scan

Scan Details

Site Domain thecity.nyc
Base Domain thecity.nyc
Scan Status Ok
Last Scan2024-06-16T15:41:49+00:00
Next Scan 2024-06-23T15:41:49+00:00

Last Scan

Scanned2024-06-16T15:41:49+00:00
URL https://thecity.nyc/robots.txt
Redirect https://www.thecity.nyc/robots.txt
Redirect Domain www.thecity.nyc
Redirect Base thecity.nyc
Domain IPs 192.0.78.153, 192.0.78.207
Redirect IPs 192.0.78.153, 192.0.78.207
Response IP 192.0.78.207
Found Yes
Hash 4bae41bd6893c335f6b0dae1f942b30119e06f4a3b38df64a64e224d44864c08
SimHash fd0c1455cd93

Groups

*

Rule Path
Disallow /category/private

Other Records

Field Value
sitemap https://www.thecity.nyc/sitemap.xml
sitemap https://www.thecity.nyc/news-sitemap.xml
sitemap https://www.thecity.nyc/sitemap_index.xml