haven.com
robots.txt
Robots Exclusion Standard data for haven.com
Resource Scan
Scan Details
Site Domain | haven.com |
Base Domain | haven.com |
Scan Status | Ok |
Last Scan | 2024-05-06T12:29:18+00:00 |
Next Scan | 2024-05-20T12:29:18+00:00 |
Last Scan
Scanned | 2024-05-06T12:29:18+00:00 |
URL | https://haven.com/robots.txt |
Redirect | https://www.haven.com/robots.txt |
Redirect Domain | www.haven.com |
Redirect Base | haven.com |
Domain IPs | 52.208.238.237, 52.215.89.118, 54.73.118.255 |
Redirect IPs | 13.226.210.24, 13.226.210.26, 13.226.210.28, 13.226.210.95, 2600:9000:2024:1800:0:9d2c:740:93a1, 2600:9000:2024:5600:0:9d2c:740:93a1, 2600:9000:2024:7200:0:9d2c:740:93a1, 2600:9000:2024:9200:0:9d2c:740:93a1, 2600:9000:2024:9400:0:9d2c:740:93a1, 2600:9000:2024:a000:0:9d2c:740:93a1, 2600:9000:2024:d000:0:9d2c:740:93a1, 2600:9000:2024:ee00:0:9d2c:740:93a1 |
Response IP | 3.160.246.18 |
Found | Yes |
Hash | f6aa40dc67bb541d429dead412bb946fda095b1d19d15490f377de5afaa45f43 |
SimHash | 490058509092 |
Groups
*
Rule | Path |
---|---|
Disallow | /sw/ |
Disallow | /ga-virtual/ |
Disallow | /*Special_Offers_Result |
Disallow | /*special_offers_result |
Disallow | /*Special_Offers_Reserve |
Disallow | /*special_offers_reserve |
Disallow | /search-results/ |
Disallow | /campaigns/ |
Disallow | /?offertype= |
Disallow | /ownership/caravan-search |
Disallow | /ownership/caravan/* |
Disallow | /caravans-for-sale/caravan-search |
Disallow | /caravans-for-sale/caravan/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.haven.com/sitemap-2.0.xml |