business.nyctourism.com
robots.txt

Robots Exclusion Standard data for business.nyctourism.com

Resource Scan

Scan Details

Site Domain business.nyctourism.com
Base Domain nyctourism.com
Scan Status Ok
Last Scan2024-08-30T06:46:16+00:00
Next Scan 2024-09-29T06:46:16+00:00

Last Scan

Scanned2024-08-30T06:46:16+00:00
URL https://business.nyctourism.com/robots.txt
Redirect https://www.business.nyctourism.com/robots.txt
Redirect Domain www.business.nyctourism.com
Redirect Base nyctourism.com
Domain IPs 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:7800:1e:91a:55c0:93a1, 2600:9000:2755:7c00:1e:91a:55c0:93a1, 2600:9000:2755:b600:1e:91a:55c0:93a1, 2600:9000:2755:b800:1e:91a:55c0:93a1, 2600:9000:2755:ca00:1e:91a:55c0:93a1, 2600:9000:2755:e800:1e:91a:55c0:93a1, 2600:9000:2755:f400:1e:91a:55c0:93a1, 2600:9000:2755:f800:1e:91a:55c0:93a1
Redirect IPs 108.156.133.23, 108.156.133.48, 108.156.133.50, 108.156.133.93, 2600:9000:2755:3200:1e:91a:55c0:93a1, 2600:9000:2755:3800:1e:91a:55c0:93a1, 2600:9000:2755:5000:1e:91a:55c0:93a1, 2600:9000:2755:5c00:1e:91a:55c0:93a1, 2600:9000:2755:600:1e:91a:55c0:93a1, 2600:9000:2755:9800:1e:91a:55c0:93a1, 2600:9000:2755:9c00:1e:91a:55c0:93a1, 2600:9000:2755:c00:1e:91a:55c0:93a1
Response IP 108.156.133.50
Found Yes
Hash 522bfe88eab98ccc29852025cbb6dc3c069b787b3d6527743e963d69f247aa9b
SimHash 6a4180408ab0

Groups

*

Rule Path
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Disallow /sitemap-0.xml
Disallow /my-nyc/favorites
Disallow /guide-geek-meeting-planners

Other Records

Field Value
sitemap https://www.business.nyctourism.com/sitemap.xml
sitemap https://www.business.nyctourism.com/server-sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.