clarks.de
robots.txt

Robots Exclusion Standard data for clarks.de

Resource Scan

Scan Details

Site Domain clarks.de
Base Domain clarks.de
Scan Status Ok
Last Scan2025-06-24T02:46:39+00:00
Next Scan 2025-07-24T02:46:39+00:00

Last Scan

Scanned2025-06-24T02:46:39+00:00
URL https://clarks.de/robots.txt
Redirect https://www.clarks.com/de-de/robots.txt
Redirect Domain www.clarks.com
Redirect Base clarks.com
Domain IPs 75.2.65.169, 99.83.129.68
Redirect IPs 104.18.30.157, 104.18.31.157, 2606:4700::6812:1e9d, 2606:4700::6812:1f9d
Response IP 104.18.30.157
Found Yes
Hash 2bb81c9a3b3167413b9ba51639029cc7e60cd4696e70c5075099515f41e1070a
SimHash 625c9854d1db

Groups

*

Rule Path
Disallow */en-gb/basket*
Disallow */en-ie/basket*
Disallow */checkout*
Disallow */login*
Disallow */reset-password*
Disallow */register*
Disallow */my-account*
Disallow */find-order
Disallow */search*
Disallow *?size*
Disallow *?color*
Disallow *?productType*
Disallow *?productSubType*
Disallow *?styleName*
Disallow *?fit*
Disallow *?upperMaterial*
Disallow *?technologies*
Disallow *?minPrice*
Disallow *?maxPrice*
Disallow *?review*
Disallow *?heelHeight*
Disallow *?brand*
Disallow *?fastening*
Disallow *?gender*
Disallow *?sortBy*
Disallow */newsletter-unsubscribe*
Disallow */my-appointment*
Disallow */appointment-success*
Disallow */appointment-failed*
Disallow */cart*

adsbot-google-mobile

Rule Path
Allow */basket*
Allow */register*
Allow */my-account*
Allow */search*
Allow *?size*
Allow *?color*
Allow *?productType*
Allow *?productSubType*
Allow *?styleName*
Allow *?fit*
Allow *?upperMaterial*
Allow *?technologies*
Allow *?minPrice*
Allow *?maxPrice*
Allow *?review*
Allow *?heelHeight*
Allow *?brand*
Allow *?fastening*
Allow *?gender*
Allow *?sortBy*
Allow */cart*

adsbot-google

Rule Path
Allow */basket*
Allow */register*
Allow */my-account*
Allow */search*
Allow *?size*
Allow *?color*
Allow *?productType*
Allow *?styleName*
Allow *?fit*
Allow *?upperMaterial*
Allow *?technologies*
Allow *?minPrice*
Allow *?maxPrice*
Allow *?review*
Allow *?heelHeight*
Allow *?brand*
Allow *?fastening*
Allow *?gender*
Allow *?sortBy*
Allow */cart*

adidxbot

Rule Path
Allow */basket*
Allow */register*
Allow */my-account*
Allow */search*
Allow *?size*
Allow *?color*
Allow *?productType*
Allow *?styleName*
Allow *?fit*
Allow *?upperMaterial*
Allow *?technologies*
Allow *?minPrice*
Allow *?maxPrice*
Allow *?review*
Allow *?heelHeight*
Allow *?brand*
Allow *?fastening*
Allow *?gender*
Allow *?sortBy*
Allow */cart*

cazoodlebot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gigabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot/1.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.clarks.com/en-gb/sitemap.xml
sitemap https://www.clarks.com/en-us/sitemap.xml
sitemap https://www.clarks.com/en-ca/sitemap.xml
sitemap https://www.clarks.com/fr-ca/sitemap.xml
sitemap https://www.clarks.com/en-ie/sitemap.xml
sitemap https://www.clarks.com/de-at/sitemap.xml
sitemap https://www.clarks.com/en-be/sitemap.xml
sitemap https://www.clarks.com/nl-be/sitemap.xml
sitemap https://www.clarks.com/fr-be/sitemap.xml
sitemap https://www.clarks.com/en-hr/sitemap.xml
sitemap https://www.clarks.com/en-cy/sitemap.xml
sitemap https://www.clarks.com/en-cz/sitemap.xml
sitemap https://www.clarks.com/en-dk/sitemap.xml
sitemap https://www.clarks.com/en-fi/sitemap.xml
sitemap https://www.clarks.com/en-fr/sitemap.xml
sitemap https://www.clarks.com/fr-fr/sitemap.xml
sitemap https://www.clarks.com/en-de/sitemap.xml
sitemap https://www.clarks.com/de-de/sitemap.xml
sitemap https://www.clarks.com/en-gr/sitemap.xml
sitemap https://www.clarks.com/en-hu/sitemap.xml
sitemap https://www.clarks.com/en-it/sitemap.xml
sitemap https://www.clarks.com/it-it/sitemap.xml
sitemap https://www.clarks.com/en-lv/sitemap.xml
sitemap https://www.clarks.com/en-li/sitemap.xml
sitemap https://www.clarks.com/en-lu/sitemap.xml
sitemap https://www.clarks.com/fr-lu/sitemap.xml
sitemap https://www.clarks.com/en-mt/sitemap.xml
sitemap https://www.clarks.com/en-nl/sitemap.xml
sitemap https://www.clarks.com/nl-nl/sitemap.xml
sitemap https://www.clarks.com/en-pl/sitemap.xml
sitemap https://www.clarks.com/en-pt/sitemap.xml
sitemap https://www.clarks.com/en-ro/sitemap.xml
sitemap https://www.clarks.com/en-es/sitemap.xml
sitemap https://www.clarks.com/es-es/sitemap.xml
sitemap https://www.clarks.com/en-se/sitemap.xml
sitemap https://www.clarks.com/en-ch/sitemap.xml
sitemap https://www.clarks.com/de-ch/sitemap.xml
sitemap https://www.clarks.com/fr-ch/sitemap.xml
sitemap https://www.clarks.com/it-ch/sitemap.xml
sitemap https://www.clarks.com/en-at/sitemap.xml
sitemap https://www.clarks.com/en-bg/sitemap.xml
sitemap https://www.clarks.com/hreflang-sitemap.xml
sitemap https://www.clarks.com/editorial-sitemap.xml
sitemap https://www.clarks.com/misc-sitemap.xml
sitemap https://www.clarks.com/content-landing-sitemap.xml

Comments

  • Block access to specific groups of pages
  • Sitemap Index Files
  • Hreflang Sitemap Files