eurocampings.nl
robots.txt

Robots Exclusion Standard data for eurocampings.nl

Resource Scan

Scan Details

Site Domain eurocampings.nl
Base Domain eurocampings.nl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-17T09:40:31+00:00
Next Scan 2024-08-15T09:40:31+00:00

Last Successful Scan

Scanned2022-12-29T01:31:04+00:00
URL https://eurocampings.nl/robots.txt
Redirect https://www.eurocampings.nl/robots.txt
Redirect Domain www.eurocampings.nl
Redirect Base eurocampings.nl
Domain IPs 80.95.166.55
Redirect IPs 118.214.167.112, 118.214.167.73, 118.214.167.98, 2600:1413:b000:6::17d5:2bd4, 2600:1413:b000:6::17d5:2bd9
Response IP 96.17.96.9
Found Yes
Hash 94fc88e123fb09ef49aa64036bdae44521b355abf69df4aa4b87e8ea15b7143d
SimHash 6f4fdc20d511

Groups

*

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

msnbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /maintenance.html
Disallow /cpc/out/
Disallow /campsite/search/
Disallow /campsite/review/
Disallow /dfp/
Disallow /campsite/download-pdf/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.eurocampings.nl/sitemap/sitemap.nl.xml

Comments

  • Yahoo !Slurp
  • YandexBot
  • DuckDuckBot