Log In Sign Up

dfds.com
robots.txt

Robots Exclusion Standard data for dfds.com

Resource Scan

Scan Details

Site Domain dfds.com
Base Domain dfds.com
Scan Status Ok
Last Scan2025-09-09T04:24:49+00:00
Next Scan 2025-09-23T04:24:49+00:00

Last Scan

Scanned2025-09-09T04:24:49+00:00
URL https://dfds.com/robots.txt
Redirect https://www.dfds.com/robots.txt
Redirect Domain www.dfds.com
Redirect Base dfds.com
Domain IPs 52.84.45.10, 52.84.45.12, 52.84.45.15, 52.84.45.19
Redirect IPs 65.9.112.108, 65.9.112.115, 65.9.112.65, 65.9.112.96
Response IP 18.244.87.115
Found Yes
Hash dfc8b376c63bd745e32e80ba0dbb3d3f7a1aac091f7a886808e3bd36cdbca378
SimHash 7bb291821837

Groups

*

Rule Path
Allow /
Disallow *_api/web*
Disallow */ab/*
Disallow /*/booking?*
Disallow /*/yourbooking?*
Disallow /bg-bg/patnicheski-feriboti/account*
Disallow /bg-bg/passenger-ferries/account*
Disallow /cs-cz/cestovni-trajekty/account*
Disallow /cs-cz/passenger-ferries/account*
Disallow /da-dk/passagerfaerger/bruger*
Disallow /de-de/passagierfaehren/account*
Disallow /en/passenger-ferries/account*
Disallow /en-gb/passenger-ferries/account*
Disallow /es-es/ferris-de-pasajeros/account*
Disallow /es-es/passenger-ferries/account*
Disallow /et-ee/reisilaevad/konto*
Disallow /fi-fi/matkustajalautat/account*
Disallow /fi-fi/passenger-ferries/account*
Disallow /fr-be/ferries-passagers/compte*
Disallow /fr-fr/ferries-passagers/compte*
Disallow /fr-ma/ferries-passagers/compte*
Disallow /it-it/traghetti-passeggeri/account*
Disallow /it-it/passenger-ferries/account*
Disallow /ja-jp/passenger-ferries/account*
Disallow /ko-kr/passenger-ferries/account*
Disallow /lt-lt/keleiviniai-keltai/paskyra*
Disallow /lv-lv/pasazieru-pramji/konts*
Disallow /nb-no/ferge/konto*
Disallow /nl-be/overtochten-passagiers/account*
Disallow /nl-nl/overtochten-passagiers/account*
Disallow /pl-pl/promy-pasazerskie/konto*
Disallow /pt-br/balsas-de-passageiros/account*
Disallow /pt-br/passenger-ferries/account*
Disallow /ro-ro/feribot/account*
Disallow /ro-ro/passenger-ferries/account*
Disallow /ru-ru/passazhirskiye-paromy/propter*
Disallow /sk-sk/cestovne-trajekty/account*
Disallow /sk-sk/passenger-ferries/account*
Disallow /sv-se/passagerarfartyg/konto*
Disallow /tr-tr/yolcu-feribotlari/account*
Disallow /tr-tr/passenger-ferries/account*
Disallow /zh-cn/passenger-ferries/account*
Disallow /bg-bg/en/*
Disallow /bg-bg//en/*
Disallow /cs-cz/en/*
Disallow /cs-cz//en/*
Disallow /da-dk/en/*
Disallow /da-dk//en/*
Disallow /de-de/en/*
Disallow /de-de//en/*
Disallow /en/en/*
Disallow /en//en/*
Disallow /en-gb/en/*
Disallow /en-gb//en/*
Disallow /es-es/en/*
Disallow /es-es//en/*
Disallow /et-ee/en/*
Disallow /et-ee//en/*
Disallow /fi-fi/en/*
Disallow /fi-fi//en/*
Disallow /fr-be/en/*
Disallow /fr-be//en/*
Disallow /fr-be/fr-fr/*
Disallow /fr-fr/en/*
Disallow /fr-fr//en/*
Disallow /fr-fr/fr-fr/*
Disallow /fr-ma/en/*
Disallow /fr-ma//en/*
Disallow /fr-ma/fr-fr/*
Disallow /it-it/en/*
Disallow /it-it//en/*
Disallow /ja-jp/en/*
Disallow /ja-jp//en/*
Disallow /ko-kr/en/*
Disallow /ko-kr//en/*
Disallow /lt-lt/en/*
Disallow /lt-lt//en/*
Disallow /lv-lv/en/*
Disallow /lv-lv//en/*
Disallow /nb-no/en/*
Disallow /nb-no//en/*
Disallow /nl-be/en/*
Disallow /nl-be//en/*
Disallow /nl-nl/en/*
Disallow /nl-nl//en/*
Disallow /pl-pl/en/*
Disallow /pl-pl//en/*
Disallow /pt-br/en/*
Disallow /pt-br//en/*
Disallow /ro-ro/en/*
Disallow /ro-ro//en/*
Disallow /ru-ru/en/*
Disallow /ru-ru//en/*
Disallow /sk-sk/en/*
Disallow /sk-sk//en/*
Disallow /sv-se/en/*
Disallow /sv-se//en/*
Disallow /tr-tr/en/*
Disallow /tr-tr//en/*
Disallow /zh-cn/en/*
Disallow /zh-cn//en/*
Disallow /en/preview*
Disallow /bg-bg/passenger-ferries*
Disallow /cs-cz/passenger-ferries*
Disallow /da-dk/passenger-ferries*
Disallow /de-de/passenger-ferries*
Disallow /es-es/passenger-ferries*
Disallow /et-ee/passenger-ferries*
Disallow /fi-fi/passenger-ferries*
Disallow /fr-be/passenger-ferries*
Disallow /fr-fr/passenger-ferries*
Disallow /fr-ma/passenger-ferries*
Disallow /it-it/passenger-ferries*
Disallow /lt-lt/passenger-ferries*
Disallow /lv-lv/passenger-ferries*
Disallow /nb-no/passenger-ferries*
Disallow /nl-be/passenger-ferries*
Disallow /nl-nl/passenger-ferries*
Disallow /pl-pl/passenger-ferries*
Disallow /pt-br/passenger-ferries*
Disallow /ro-ro/passenger-ferries*
Disallow /ru-ru/passenger-ferries*
Disallow /sk-sk/passenger-ferries*
Disallow /sv-se/passenger-ferries*
Disallow /tr-tr/passenger-ferries*

adsbot-google

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.dfds.com/sitemap.xml
Back to top

Comments

  • Algolia Crawler Verification settings
  • Algolia-Crawler-Verif: 6A1F2BB6994B83DF
  • General settings
  • Disallow misc resources
  • Disallow account pages
  • Disallow non-english locale to have a malformed url
  • Disallow preview paths
  • Disallow english BUs paths from other markets
  • Google Ads bot settings
  • Sitemaps
Back to top