eurocampings.co.uk
robots.txt

Robots Exclusion Standard data for eurocampings.co.uk

Resource Scan

Scan Details

Site Domain eurocampings.co.uk
Base Domain eurocampings.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-01T09:05:24+00:00
Next Scan 2024-08-30T09:05:24+00:00

Last Successful Scan

Scanned2023-01-15T12:25:15+00:00
URL https://eurocampings.co.uk/robots.txt
Redirect https://www.eurocampings.co.uk/robots.txt
Redirect Domain www.eurocampings.co.uk
Redirect Base eurocampings.co.uk
Domain IPs 80.95.166.55
Redirect IPs 2600:1413:b000:6::17d5:2bd4, 2600:1413:b000:6::17d5:2bd9, 96.17.96.12, 96.17.96.17
Response IP 23.223.18.153
Found Yes
Hash e8013b1af7103e68013a452ea17b9d4a86caf28b1afb183f38708739f5204fca
SimHash 6f4ddc21d511

Groups

*

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

msnbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.eurocampings.co.uk/sitemap/sitemap.en.xml

Comments

  • Yahoo !Slurp
  • YandexBot
  • DuckDuckBot