nycandcompany.org
robots.txt
Robots Exclusion Standard data for nycandcompany.org
Resource Scan
Scan Details
Site Domain | nycandcompany.org |
Base Domain | nycandcompany.org |
Scan Status | Ok |
Last Scan | 2024-09-18T05:50:54+00:00 |
Next Scan | 2024-10-18T05:50:54+00:00 |
Last Scan
Scanned | 2024-09-18T05:50:54+00:00 |
URL | http://www.nycandcompany.org/robots.txt |
Redirect | https://www.business.nyctourism.com/robots.txt |
Redirect Domain | www.business.nyctourism.com |
Redirect Base | nyctourism.com |
Domain IPs | 96.45.82.102, 96.45.82.189, 96.45.83.16, 96.45.83.236 |
Redirect IPs | 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:400:1e:91a:55c0:93a1, 2600:9000:2755:4200:1e:91a:55c0:93a1, 2600:9000:2755:5400:1e:91a:55c0:93a1, 2600:9000:2755:5c00:1e:91a:55c0:93a1, 2600:9000:2755:6600:1e:91a:55c0:93a1, 2600:9000:2755:8400:1e:91a:55c0:93a1, 2600:9000:2755:9a00:1e:91a:55c0:93a1, 2600:9000:2755:e400:1e:91a:55c0:93a1 |
Response IP | 108.156.133.23 |
Found | Yes |
Hash | 522bfe88eab98ccc29852025cbb6dc3c069b787b3d6527743e963d69f247aa9b |
SimHash | 6a4180408ab0 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.json$ |
Disallow | /*_buildManifest.js$ |
Disallow | /*_middlewareManifest.js$ |
Disallow | /*_ssgManifest.js$ |
Disallow | /*.js$ |
Disallow | /sitemap-0.xml |
Disallow | /my-nyc/favorites |
Disallow | /guide-geek-meeting-planners |
Other Records
Field | Value |
---|---|
sitemap | https://www.business.nyctourism.com/sitemap.xml |
sitemap | https://www.business.nyctourism.com/server-sitemap.xml |
Warnings
- `host` is not a known field.
Comments