business.nycgo.com
robots.txt
Robots Exclusion Standard data for business.nycgo.com
Resource Scan
Scan Details
| Site Domain | business.nycgo.com |
| Base Domain | nycgo.com |
| Scan Status | Ok |
| Last Scan | 2024-08-30T07:13:53+00:00 |
| Next Scan | 2024-09-29T07:13:53+00:00 |
Last Scan
| Scanned | 2024-08-30T07:13:53+00:00 |
| URL | https://business.nycgo.com/robots.txt |
| Redirect | https://www.business.nyctourism.com/robots.txt |
| Redirect Domain | www.business.nyctourism.com |
| Redirect Base | nyctourism.com |
| Domain IPs | 96.45.82.102, 96.45.82.189, 96.45.83.16, 96.45.83.236 |
| Redirect IPs | 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:1a00:1e:91a:55c0:93a1, 2600:9000:2755:6200:1e:91a:55c0:93a1, 2600:9000:2755:800:1e:91a:55c0:93a1, 2600:9000:2755:8a00:1e:91a:55c0:93a1, 2600:9000:2755:8e00:1e:91a:55c0:93a1, 2600:9000:2755:dc00:1e:91a:55c0:93a1, 2600:9000:2755:e00:1e:91a:55c0:93a1, 2600:9000:2755:ea00:1e:91a:55c0:93a1 |
| Response IP | 108.156.133.93 |
| Found | Yes |
| Hash | 522bfe88eab98ccc29852025cbb6dc3c069b787b3d6527743e963d69f247aa9b |
| SimHash | 6a4180408ab0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.json$ |
| Disallow | /*_buildManifest.js$ |
| Disallow | /*_middlewareManifest.js$ |
| Disallow | /*_ssgManifest.js$ |
| Disallow | /*.js$ |
| Disallow | /sitemap-0.xml |
| Disallow | /my-nyc/favorites |
| Disallow | /guide-geek-meeting-planners |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.business.nyctourism.com/sitemap.xml |
| sitemap | https://www.business.nyctourism.com/server-sitemap.xml |
Warnings
- `host` is not a known field.
Comments