business.nyctourism.com
robots.txt

Robots Exclusion Standard data for business.nyctourism.com

Resource Scan

Scan Details

Site Domain business.nyctourism.com
Base Domain nyctourism.com
Scan Status Ok
Last Scan2024-10-29T06:46:38+00:00
Next Scan 2024-11-28T06:46:38+00:00

Last Scan

Scanned2024-10-29T06:46:38+00:00
URL https://business.nyctourism.com/robots.txt
Redirect https://www.business.nyctourism.com/robots.txt
Redirect Domain www.business.nyctourism.com
Redirect Base nyctourism.com
Domain IPs 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:1600:1e:91a:55c0:93a1, 2600:9000:2755:1a00:1e:91a:55c0:93a1, 2600:9000:2755:3000:1e:91a:55c0:93a1, 2600:9000:2755:4000:1e:91a:55c0:93a1, 2600:9000:2755:4a00:1e:91a:55c0:93a1, 2600:9000:2755:7c00:1e:91a:55c0:93a1, 2600:9000:2755:c00:1e:91a:55c0:93a1, 2600:9000:2755:d200:1e:91a:55c0:93a1
Redirect IPs 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:2600:1e:91a:55c0:93a1, 2600:9000:2755:3c00:1e:91a:55c0:93a1, 2600:9000:2755:4c00:1e:91a:55c0:93a1, 2600:9000:2755:5200:1e:91a:55c0:93a1, 2600:9000:2755:b800:1e:91a:55c0:93a1, 2600:9000:2755:dc00:1e:91a:55c0:93a1, 2600:9000:2755:e00:1e:91a:55c0:93a1, 2600:9000:2755:f000:1e:91a:55c0:93a1
Response IP 108.156.133.50
Found Yes
Hash 522bfe88eab98ccc29852025cbb6dc3c069b787b3d6527743e963d69f247aa9b
SimHash 6a4180408ab0

Groups

*

Rule Path
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Disallow /sitemap-0.xml
Disallow /my-nyc/favorites
Disallow /guide-geek-meeting-planners

Other Records

Field Value
sitemap https://www.business.nyctourism.com/sitemap.xml
sitemap https://www.business.nyctourism.com/server-sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.