www.business.nyctourism.com
robots.txt
Robots Exclusion Standard data for www.business.nyctourism.com
Resource Scan
Scan Details
| Site Domain | www.business.nyctourism.com |
| Base Domain | nyctourism.com |
| Scan Status | Ok |
| Last Scan | 2024-10-29T06:09:29+00:00 |
| Next Scan | 2024-11-28T06:09:29+00:00 |
Last Scan
| Scanned | 2024-10-29T06:09:29+00:00 |
| URL | https://www.business.nyctourism.com/robots.txt |
| Domain IPs | 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:2800:1e:91a:55c0:93a1, 2600:9000:2755:6400:1e:91a:55c0:93a1, 2600:9000:2755:8400:1e:91a:55c0:93a1, 2600:9000:2755:9800:1e:91a:55c0:93a1, 2600:9000:2755:a00:1e:91a:55c0:93a1, 2600:9000:2755:a400:1e:91a:55c0:93a1, 2600:9000:2755:ae00:1e:91a:55c0:93a1, 2600:9000:2755:ea00:1e:91a:55c0:93a1 |
| Response IP | 108.156.133.50 |
| Found | Yes |
| Hash | 522bfe88eab98ccc29852025cbb6dc3c069b787b3d6527743e963d69f247aa9b |
| SimHash | 6a4180408ab0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*.json$ |
| Disallow | /*_buildManifest.js$ |
| Disallow | /*_middlewareManifest.js$ |
| Disallow | /*_ssgManifest.js$ |
| Disallow | /*.js$ |
| Disallow | /sitemap-0.xml |
| Disallow | /my-nyc/favorites |
| Disallow | /guide-geek-meeting-planners |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.business.nyctourism.com/sitemap.xml |
| sitemap | https://www.business.nyctourism.com/server-sitemap.xml |
Warnings
- `host` is not a known field.
Comments