haven.com
robots.txt

Robots Exclusion Standard data for haven.com

Resource Scan

Scan Details

Site Domain haven.com
Base Domain haven.com
Scan Status Ok
Last Scan2024-05-06T12:29:18+00:00
Next Scan 2024-05-20T12:29:18+00:00

Last Scan

Scanned2024-05-06T12:29:18+00:00
URL https://haven.com/robots.txt
Redirect https://www.haven.com/robots.txt
Redirect Domain www.haven.com
Redirect Base haven.com
Domain IPs 52.208.238.237, 52.215.89.118, 54.73.118.255
Redirect IPs 13.226.210.24, 13.226.210.26, 13.226.210.28, 13.226.210.95, 2600:9000:2024:1800:0:9d2c:740:93a1, 2600:9000:2024:5600:0:9d2c:740:93a1, 2600:9000:2024:7200:0:9d2c:740:93a1, 2600:9000:2024:9200:0:9d2c:740:93a1, 2600:9000:2024:9400:0:9d2c:740:93a1, 2600:9000:2024:a000:0:9d2c:740:93a1, 2600:9000:2024:d000:0:9d2c:740:93a1, 2600:9000:2024:ee00:0:9d2c:740:93a1
Response IP 3.160.246.18
Found Yes
Hash f6aa40dc67bb541d429dead412bb946fda095b1d19d15490f377de5afaa45f43
SimHash 490058509092

Groups

*

Rule Path
Disallow /sw/
Disallow /ga-virtual/
Disallow /*Special_Offers_Result
Disallow /*special_offers_result
Disallow /*Special_Offers_Reserve
Disallow /*special_offers_reserve
Disallow /search-results/
Disallow /campaigns/
Disallow /?offertype=
Disallow /ownership/caravan-search
Disallow /ownership/caravan/*
Disallow /caravans-for-sale/caravan-search
Disallow /caravans-for-sale/caravan/*

Other Records

Field Value
sitemap https://www.haven.com/sitemap-2.0.xml