nycgo.com
robots.txt

Robots Exclusion Standard data for nycgo.com

Resource Scan

Scan Details

Site Domain nycgo.com
Base Domain nycgo.com
Scan Status Ok
Last Scan2024-05-11T10:41:08+00:00
Next Scan 2024-06-10T10:41:08+00:00

Last Scan

Scanned2024-05-11T10:41:08+00:00
URL https://nycgo.com/robots.txt
Redirect https://www.nyctourism.com/robots.txt
Redirect Domain www.nyctourism.com
Redirect Base nyctourism.com
Domain IPs 96.45.82.102, 96.45.82.189, 96.45.83.16, 96.45.83.236
Redirect IPs 13.225.4.116, 13.225.4.129, 13.225.4.3, 13.225.4.5, 2600:9000:21b4:200:c:8511:8840:93a1, 2600:9000:21b4:2c00:c:8511:8840:93a1, 2600:9000:21b4:3e00:c:8511:8840:93a1, 2600:9000:21b4:6800:c:8511:8840:93a1, 2600:9000:21b4:8800:c:8511:8840:93a1, 2600:9000:21b4:c000:c:8511:8840:93a1, 2600:9000:21b4:fa00:c:8511:8840:93a1, 2600:9000:21b4:fe00:c:8511:8840:93a1
Response IP 13.225.4.116
Found Yes
Hash 581fb1f7e153efbc1f67cde89dd019354d1f35b12cb68c0b46ba7e00ba79faa9
SimHash 664d88c00e95

Groups

*

Rule Path
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Disallow /sitemap-0.xml
Disallow /my-nyc/favorites

Other Records

Field Value
sitemap https://www.nyctourism.com/sitemap.xml
sitemap https://www.nyctourism.com/server-sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.