huspy.com
robots.txt
Robots Exclusion Standard data for huspy.com
Resource Scan
Scan Details
| Site Domain | huspy.com |
| Base Domain | huspy.com |
| Scan Status | Ok |
| Last Scan | 2024-10-22T07:01:58+00:00 |
| Next Scan | 2024-11-21T07:01:58+00:00 |
Last Scan
| Scanned | 2024-10-22T07:01:58+00:00 |
| URL | https://huspy.com/robots.txt |
| Domain IPs | 13.225.4.105, 13.225.4.53, 13.225.4.74, 13.225.4.9 |
| Response IP | 13.225.4.105 |
| Found | Yes |
| Hash | 3d2c8b68b037feca84fb8d38799bf8fd2a0e415fb65f5408f5d1bc507fb61cdf |
| SimHash | 2555dc03cf92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_next |
| Disallow | /ae/search?locationSlugs=%7B%7Bneighborhood_reference%7D%7D |
| Disallow | /ae/search?locationSlugs=%7B%7Bcity_reference%7D%7D |
| Disallow | /ae/blog?categoryUUID=%7B%7BcategoryUUID%7D%7D |
| Disallow | /ae/search?locationSlugs=%7B%7Bdistrict_reference%7D%7D |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.huspy.com/sitemap.xml |
Warnings
- `host` is not a known field.