dfdsseaways.dk
robots.txt

Robots Exclusion Standard data for dfdsseaways.dk

Resource Scan

Scan Details

Site Domain dfdsseaways.dk
Base Domain dfdsseaways.dk
Scan Status Ok
Last Scan2024-10-24T09:32:32+00:00
Next Scan 2024-11-23T09:32:32+00:00

Last Scan

Scanned2024-10-24T09:32:32+00:00
URL https://dfdsseaways.dk/robots.txt
Redirect https://www.dfds.com/robots.txt
Redirect Domain www.dfds.com
Redirect Base dfds.com
Domain IPs 13.226.2.126, 13.226.2.23, 13.226.2.73, 13.226.2.86
Redirect IPs 52.222.144.45, 52.222.144.57, 52.222.144.88, 52.222.144.89
Response IP 3.164.206.95
Found Yes
Hash 910d09a350bf3e2cf592137a08ca6956a162b9ecbf4ac77b119ef269b6ac0d55
SimHash 8302672206e2

Groups

*

Rule Path
Allow /
Disallow */page-data.json
Disallow /Downloadables/*.pdf
Disallow /PublishingImages/*.pdf
Disallow /PublicationsRepository/*.pdf
Disallow /Documents/*.pdf
Disallow /mediafiles/*.pdf
Disallow /news/*.pdf
Disallow *aspx*
Disallow *_api/web*
Disallow */ab/*
Disallow /en/passenger-ferries/press/history-dieppe-newhaven-line
Disallow /en/passenger-ferries/press/the-cote-des-dunes-and-the-cote-des-flandres
Disallow /en/passenger-ferries/press/new-terminal-in-dunkirk
Disallow /en/passenger-ferries/press/england-by-car-thanks-to-the-ferry-a-taste-of-freedom
Disallow /en/passenger-ferries/press/top-4-most-beautiful-beaches-britain
Disallow /en/passenger-ferries/press/indian-summer-in-england-with-camper
Disallow /en/passenger-ferries/press/weekend-getaway
Disallow /en/passenger-ferries/press/winter-in-england
Disallow /en/passenger-ferries/press/gardens-in-kent
Disallow /en/passenger-ferries/press/jc-charlo
Disallow /en/passenger-ferries/destinations/guides/a-day-in-london
Disallow /en/passenger-ferries/destinations/guides/getting-into-london
Disallow /en/passenger-ferries/offers/klaipeda-plus
Disallow /en/passenger-ferries/offers/lets-deal-mini-cruise-to-klaipeda
Disallow /en/passenger-ferries/offers/scr-svensk-camping
Disallow /en/passenger-ferries/offers/swedish-motorcyclists-association
Disallow /en/passenger-ferries/offers/smartbox
Disallow /en/passenger-ferries/offers/senior-deal
Disallow /en/passenger-ferries/offers/senior-deal/oslo-copenhagen
Disallow /en/passenger-ferries/offers/senior-deal/copenhagen-oslo
Disallow /en/passenger-ferries/offers/gogift
Disallow /en/passenger-ferries/offers/boozt
Disallow /en/passenger-ferries/offers/plus-deal
Disallow /en/passenger-ferries/offers/family-mini-cruise
Disallow /en/passenger-ferries/offers/half-price-back
Disallow /en/passenger-ferries/offers/lets-deal
Disallow /en/passenger-ferries/offers/lets-deal-minicruise-to-copenhagen
Disallow /en/passenger-ferries/offers/oresund-bridge-club-40-percent-off-minicruise
Disallow /en/passenger-ferries/offers/good-better-best
Disallow /en/passenger-ferries/offers/springtime-oslo-offer
Disallow /bg-bg/passenger-ferries*
Disallow /cs-cz/passenger-ferries*
Disallow /da-dk/passenger-ferries*
Disallow /de-de/passenger-ferries*
Disallow /es-es/passenger-ferries*
Disallow /et-ee/passenger-ferries*
Disallow /fi-fi/passenger-ferries*
Disallow /fr-be/passenger-ferries*
Disallow /fr-fr/passenger-ferries*
Disallow /it-it/passenger-ferries*
Disallow /lt-lt/passenger-ferries*
Disallow /lv-lv/passenger-ferries*
Disallow /nb-no/passenger-ferries*
Disallow /nl-be/passenger-ferries*
Disallow /nl-nl/passenger-ferries*
Disallow /pl-pl/passenger-ferries*
Disallow /pt-br/passenger-ferries*
Disallow /ro-ro/passenger-ferries*
Disallow /ru-ru/passenger-ferries*
Disallow /sk-sk/passenger-ferries*
Disallow /sv-se/passenger-ferries*
Disallow /bg-bg/freight-shipping*
Disallow /cs-cz/freight-shipping*
Disallow /da-dk/freight-shipping*
Disallow /de-de/freight-shipping*
Disallow /es-es/freight-shipping*
Disallow /et-ee/freight-shipping*
Disallow /fi-fi/freight-shipping*
Disallow /fr-be/freight-shipping*
Disallow /fr-fr/freight-shipping*
Disallow /it-it/freight-shipping*
Disallow /lt-lt/freight-shipping*
Disallow /lv-lv/freight-shipping*
Disallow /nb-no/freight-shipping*
Disallow /nl-be/freight-shipping*
Disallow /nl-nl/freight-shipping*
Disallow /pl-pl/freight-shipping*
Disallow /pt-br/freight-shipping*
Disallow /ro-ro/freight-shipping*
Disallow /ru-ru/freight-shipping*
Disallow /sk-sk/freight-shipping*
Disallow /sv-se/freight-shipping*
Disallow /bg-bg/logistics-solutions*
Disallow /cs-cz/logistics-solutions*
Disallow /da-dk/logistics-solutions*
Disallow /de-de/logistics-solutions*
Disallow /es-es/logistics-solutions*
Disallow /et-ee/logistics-solutions*
Disallow /fi-fi/logistics-solutions*
Disallow /fr-be/logistics-solutions*
Disallow /fr-fr/logistics-solutions*
Disallow /it-it/logistics-solutions*
Disallow /lt-lt/logistics-solutions*
Disallow /lv-lv/logistics-solutions*
Disallow /nb-no/logistics-solutions*
Disallow /nl-be/logistics-solutions*
Disallow /nl-nl/logistics-solutions*
Disallow /pl-pl/logistics-solutions*
Disallow /pt-br/logistics-solutions*
Disallow /ro-ro/logistics-solutions*
Disallow /ru-ru/logistics-solutions*
Disallow /sk-sk/logistics-solutions*
Disallow /sv-se/logistics-solutions*
Disallow /en/preview*

adsbot-google

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.dfds.com/sitemap.xml

Comments

  • Algolia-Crawler-Verif: 6A1F2BB6994B83DF
  • Disallow misc resources
  • Disallow FR offers in EN
  • Disallow SE offers in EN
  • Exclude English BUs paths from other markets
  • Ads bot
  • Sitemaps