Log In Sign Up

lastminute-cottages.co.uk
robots.txt

Robots Exclusion Standard data for lastminute-cottages.co.uk

Resource Scan

Scan Details

Site Domain lastminute-cottages.co.uk
Base Domain lastminute-cottages.co.uk
Scan Status Ok
Last Scan2024-09-14T20:52:03+00:00
Next Scan 2024-10-14T20:52:03+00:00

Last Scan

Scanned2024-09-14T20:52:03+00:00
URL https://lastminute-cottages.co.uk/robots.txt
Redirect https://www.lastminute-cottages.co.uk/robots.txt
Redirect Domain www.lastminute-cottages.co.uk
Redirect Base lastminute-cottages.co.uk
Domain IPs 108.157.150.106, 108.157.150.112, 108.157.150.30, 108.157.150.64, 2600:9000:24f9:1c00:8:5d30:8e00:93a1, 2600:9000:24f9:4400:8:5d30:8e00:93a1, 2600:9000:24f9:5c00:8:5d30:8e00:93a1, 2600:9000:24f9:600:8:5d30:8e00:93a1, 2600:9000:24f9:ba00:8:5d30:8e00:93a1, 2600:9000:24f9:d000:8:5d30:8e00:93a1, 2600:9000:24f9:d400:8:5d30:8e00:93a1, 2600:9000:24f9:e600:8:5d30:8e00:93a1
Redirect IPs 13.33.30.122, 13.33.30.129, 13.33.30.31, 13.33.30.5, 2600:9000:229f:2800:8:5d30:8e00:93a1, 2600:9000:229f:6400:8:5d30:8e00:93a1, 2600:9000:229f:7200:8:5d30:8e00:93a1, 2600:9000:229f:9200:8:5d30:8e00:93a1, 2600:9000:229f:a600:8:5d30:8e00:93a1, 2600:9000:229f:a800:8:5d30:8e00:93a1, 2600:9000:229f:dc00:8:5d30:8e00:93a1, 2600:9000:229f:fa00:8:5d30:8e00:93a1
Response IP 13.33.30.31
Found Yes
Hash ca4c9b30055841af02868480186d0d0071295ef74fa4815034633b45d237591a
SimHash a1082bcf9562

Groups

*

Rule Path
Disallow /api/
Disallow /searches/
Allow /two-bedroom-cottages-united-kingdom
Allow /summer-holiday-cottages-united-kingdom
Allow /staycation-cottages-united-kingdom
Allow /half-term-cottages-united-kingdom
Allow /child-friendly-cottages-united-kingdom
Allow /baby-friendly-cottages-united-kingdom
Allow /searches/*.json
Back to top

Other Records

Field Value
sitemap https://www.lastminute-cottages.co.uk/sitemaps/index.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
Back to top