nycandcompany.org
robots.txt

Robots Exclusion Standard data for nycandcompany.org

Resource Scan

Scan Details

Site Domain nycandcompany.org
Base Domain nycandcompany.org
Scan Status Ok
Last Scan2024-09-18T05:50:54+00:00
Next Scan 2024-10-18T05:50:54+00:00

Last Scan

Scanned2024-09-18T05:50:54+00:00
URL http://www.nycandcompany.org/robots.txt
Redirect https://www.business.nyctourism.com/robots.txt
Redirect Domain www.business.nyctourism.com
Redirect Base nyctourism.com
Domain IPs 96.45.82.102, 96.45.82.189, 96.45.83.16, 96.45.83.236
Redirect IPs 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:400:1e:91a:55c0:93a1, 2600:9000:2755:4200:1e:91a:55c0:93a1, 2600:9000:2755:5400:1e:91a:55c0:93a1, 2600:9000:2755:5c00:1e:91a:55c0:93a1, 2600:9000:2755:6600:1e:91a:55c0:93a1, 2600:9000:2755:8400:1e:91a:55c0:93a1, 2600:9000:2755:9a00:1e:91a:55c0:93a1, 2600:9000:2755:e400:1e:91a:55c0:93a1
Response IP 108.156.133.23
Found Yes
Hash 522bfe88eab98ccc29852025cbb6dc3c069b787b3d6527743e963d69f247aa9b
SimHash 6a4180408ab0

Groups

*

Rule Path
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Disallow /sitemap-0.xml
Disallow /my-nyc/favorites
Disallow /guide-geek-meeting-planners

Other Records

Field Value
sitemap https://www.business.nyctourism.com/sitemap.xml
sitemap https://www.business.nyctourism.com/server-sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.