nycinsiderguide.com
robots.txt
Robots Exclusion Standard data for nycinsiderguide.com
Resource Scan
Scan Details
| Site Domain | nycinsiderguide.com |
| Base Domain | nycinsiderguide.com |
| Scan Status | Ok |
| Last Scan | 2024-10-02T22:40:46+00:00 |
| Next Scan | 2024-10-09T22:40:46+00:00 |
Last Scan
| Scanned | 2024-10-02T22:40:46+00:00 |
| URL | https://nycinsiderguide.com/robots.txt |
| Redirect | https://www.nycinsiderguide.com/robots.txt |
| Redirect Domain | www.nycinsiderguide.com |
| Redirect Base | nycinsiderguide.com |
| Domain IPs | 104.21.8.16, 172.67.130.91, 2606:4700:3030::6815:810, 2606:4700:3035::ac43:825b |
| Redirect IPs | 104.21.8.16, 172.67.130.91, 2606:4700:3030::6815:810, 2606:4700:3035::ac43:825b |
| Response IP | 104.21.8.16 |
| Found | Yes |
| Hash | 0fdedb3624f4e088de1773e9d05dc108c7d7ecdc7565cd3cd3a819e39bb16fd5 |
| SimHash | 97044c6607e5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /private/ |
| Disallow | /e/ |
| Disallow | /show-error-* |
| Disallow | /xmlrpc.php |
| Disallow | /trackback/ |
| Disallow | /comment-page- |
| Allow | /wp-content/uploads/ |
| Disallow | /html-mtpages-01-30-13/ |
| Disallow | /sitemap.xml.gz |
| Disallow | /slides-sitemap.xml |
| Disallow | /attachment-sitemap3.xml |
| Disallow | /links/feed/ |
| Allow | /image-files/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.nycinsiderguide.com/sitemap_index.xml |