smalldoorvet.com
robots.txt
Robots Exclusion Standard data for smalldoorvet.com
Resource Scan
Scan Details
| Site Domain | smalldoorvet.com |
| Base Domain | smalldoorvet.com |
| Scan Status | Ok |
| Last Scan | 2024-05-09T11:30:59+00:00 |
| Next Scan | 2024-06-08T11:30:59+00:00 |
Last Scan
| Scanned | 2024-05-09T11:30:59+00:00 |
| URL | https://smalldoorvet.com/robots.txt |
| Redirect | https://www.smalldoorvet.com/robots.txt |
| Redirect Domain | www.smalldoorvet.com |
| Redirect Base | smalldoorvet.com |
| Domain IPs | 75.2.60.5 |
| Redirect IPs | 13.215.144.61, 18.139.194.139, 2406:da18:880:3801::c8, 2406:da18:b3d:e202::64 |
| Response IP | 46.137.195.11 |
| Found | Yes |
| Hash | 988e2fb602d405c9019bfb35348a7d6d6c662e9b80f37ddb5be219327dcfec94 |
| SimHash | 0040687607f7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /nyc |
| Disallow | /newyork |
| Disallow | /ny |
| Disallow | /lp/landing-page-cat |
| Disallow | /lp/landing-page-dog |
| Disallow | /lp/navy-yard |
| Disallow | /lp/brookline |
| Disallow | /lp/spring-valley |
| Disallow | /lp/bethesda |
| Disallow | /lp/mclean |
| Disallow | /lp/nyc-mw |
| Disallow | /coming-soon/alexandria |
| Disallow | /coming-soon/arlington |
| Disallow | /coming-soon/lincoln-park |
| Disallow | /coming-soon/manhasset |
| Disallow | /coming-soon/river-north |
| Disallow | /coming-soon/south-end |
| Disallow | /coming-soon/southport |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.smalldoorvet.com/sitemap.xml |
Warnings
- `host` is not a known field.