Log In Sign Up

sick.com
robots.txt

Robots Exclusion Standard data for sick.com

Resource Scan

Scan Details

Site Domain sick.com
Base Domain sick.com
Scan Status Ok
Last Scan2024-06-19T06:24:45+00:00
Next Scan 2024-07-03T06:24:45+00:00

Last Scan

Scanned2024-06-19T06:24:45+00:00
URL https://sick.com/robots.txt
Redirect https://www.sick.com/robots.txt
Redirect Domain www.sick.com
Redirect Base sick.com
Domain IPs 80.72.131.66
Redirect IPs 23.44.4.160, 23.44.4.170
Response IP 23.50.232.234
Found Yes
Hash 8839f827a5205544d485b53a56df53f8800cd07b8ce8e31f87d9055111d9c7d8
SimHash 27071690a3f8

Groups

*

Rule Path
Disallow /search?*
Disallow /*?q=*
Disallow /*/*/search/suggest
Disallow /*/*/cart
Disallow /*/*/checkout
Disallow /*/*/my-account
Disallow /*/*/my-company
Disallow /*/*/compare
Disallow /pc/*
Disallow /hq/*
Disallow /mc/*
Disallow /gr/*
Disallow /ru/*

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.sick.com/cz/cs/sitemap.xml
sitemap https://www.sick.com/cz/cs/sitemap.xml
sitemap https://www.sick.com/sk/cs/sitemap.xml
sitemap https://www.sick.com/dk/da/sitemap.xml
sitemap https://www.sick.com/at/de/sitemap.xml
sitemap https://www.sick.com/be/de/sitemap.xml
sitemap https://www.sick.com/ch/de/sitemap.xml
sitemap https://www.sick.com/cz/de/sitemap.xml
sitemap https://www.sick.com/de/de/sitemap.xml
sitemap https://www.sick.com/ae/en/sitemap.xml
sitemap https://www.sick.com/at/en/sitemap.xml
sitemap https://www.sick.com/au/en/sitemap.xml
sitemap https://www.sick.com/be/en/sitemap.xml
sitemap https://www.sick.com/br/en/sitemap.xml
sitemap https://www.sick.com/ca/en/sitemap.xml
sitemap https://www.sick.com/ch/en/sitemap.xml
sitemap https://www.sick.com/cl/en/sitemap.xml
sitemap https://www.sick.com/cn/en/sitemap.xml
sitemap https://www.sick.com/cz/en/sitemap.xml
sitemap https://www.sick.com/de/en/sitemap.xml
sitemap https://www.sick.com/dk/en/sitemap.xml
sitemap https://www.sick.com/es/en/sitemap.xml
sitemap https://www.sick.com/fi/en/sitemap.xml
sitemap https://www.sick.com/fr/en/sitemap.xml
sitemap https://www.sick.com/gb/en/sitemap.xml
sitemap https://www.sick.com/gr/en/sitemap.xml
sitemap https://www.sick.com/hk/en/sitemap.xml
sitemap https://www.sick.com/il/en/sitemap.xml
sitemap https://www.sick.com/in/en/sitemap.xml
sitemap https://www.sick.com/it/en/sitemap.xml
sitemap https://www.sick.com/jp/en/sitemap.xml
sitemap https://www.sick.com/kr/en/sitemap.xml
sitemap https://www.sick.com/mc/en/sitemap.xml
sitemap https://www.sick.com/mx/en/sitemap.xml
sitemap https://www.sick.com/my/en/sitemap.xml
sitemap https://www.sick.com/nl/en/sitemap.xml
sitemap https://www.sick.com/no/en/sitemap.xml
sitemap https://www.sick.com/nz/en/sitemap.xml
sitemap https://www.sick.com/pl/en/sitemap.xml
sitemap https://www.sick.com/ru/en/sitemap.xml
sitemap https://www.sick.com/se/en/sitemap.xml
sitemap https://www.sick.com/sg/en/sitemap.xml
sitemap https://www.sick.com/sk/en/sitemap.xml
sitemap https://www.sick.com/th/en/sitemap.xml
sitemap https://www.sick.com/tr/en/sitemap.xml
sitemap https://www.sick.com/tw/en/sitemap.xml
sitemap https://www.sick.com/us/en/sitemap.xml
sitemap https://www.sick.com/za/en/sitemap.xml
sitemap https://www.sick.com/br/es/sitemap.xml
sitemap https://www.sick.com/cl/es/sitemap.xml
sitemap https://www.sick.com/es/es/sitemap.xml
sitemap https://www.sick.com/mx/es/sitemap.xml
sitemap https://www.sick.com/fi/fi/sitemap.xml
sitemap https://www.sick.com/be/fr/sitemap.xml
sitemap https://www.sick.com/ca/fr/sitemap.xml
sitemap https://www.sick.com/ch/fr/sitemap.xml
sitemap https://www.sick.com/fr/fr/sitemap.xml
sitemap https://www.sick.com/it/it/sitemap.xml
sitemap https://www.sick.com/jp/ja/sitemap.xml
sitemap https://www.sick.com/kr/ko/sitemap.xml
sitemap https://www.sick.com/be/nl/sitemap.xml
sitemap https://www.sick.com/nl/nl/sitemap.xml
sitemap https://www.sick.com/pl/pl/sitemap.xml
sitemap https://www.sick.com/br/pt/sitemap.xml
sitemap https://www.sick.com/il/ru/sitemap.xml
sitemap https://www.sick.com/pl/ru/sitemap.xml
sitemap https://www.sick.com/ru/ru/sitemap.xml
sitemap https://www.sick.com/fi/sv/sitemap.xml
sitemap https://www.sick.com/se/sv/sitemap.xml
sitemap https://www.sick.com/tr/tr/sitemap.xml
sitemap https://www.sick.com/hk/zf/sitemap.xml
sitemap https://www.sick.com/tw/zf/sitemap.xml
sitemap https://www.sick.com/cn/zh/sitemap.xml
sitemap https://www.sick.com/mc/zh/sitemap.xml
Back to top

Comments

  • For all robots
  • Block (search-) result pages
  • Block LAND/SPRACHE/search/suggest
  • Block access to specific groups of pages
  • Disallow: /sickstorefront/* # Should be included aprox. on 2024-08-19 (See: WEB-3228)
  • Disallow: /sickstorefront_*/* # Should be included aprox. on 2024-08-19 (See: WEB-3228)
  • Disallow: /*/*/search?* # Temporary remove 2024-02-21 because of noindex in html. TODO: Should be included in this file again in aprox. 6 month. (See WEB-2990)
  • Block Countries and internal stuff
  • Disallow: /ag/*
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Send search crawlers to discover the sitemap
Back to top