kuka.com
robots.txt

Robots Exclusion Standard data for kuka.com

Resource Scan

Scan Details

Site Domain kuka.com
Base Domain kuka.com
Scan Status Ok
Last Scan2024-09-15T07:09:55+00:00
Next Scan 2024-10-15T07:09:55+00:00

Last Scan

Scanned2024-09-15T07:09:55+00:00
URL https://kuka.com/robots.txt
Redirect https://www.kuka.com/robots.txt
Redirect Domain www.kuka.com
Redirect Base kuka.com
Domain IPs 185.209.67.46
Redirect IPs 104.18.24.87, 104.18.25.87, 2606:4700::6812:1857, 2606:4700::6812:1957
Response IP 104.18.25.87
Found Yes
Hash c277eabbecc1b45502683f1bbdd6cd78ed98edebc8c3a10cac3918462c2a058a
SimHash 3959956bc0c2

Groups

*

Rule Path
Disallow /*?*terms=*
Disallow /*?*filters=*
Disallow /*GenerateZipFromList*
Disallow /ident*
Disallow /bundle/beac*
Disallow /sitec*
Disallow /layouts/system/Visitor*
Disallow /event/da*
Disallow /errorpages/

rogerbot

Rule Path
Disallow /*?*

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

*

Rule Path
Disallow /da-dk/
Disallow /nl-nl/
Disallow /fi-fi/
Disallow /id-id/
Disallow /nb-no/
Disallow /ru-ru/
Disallow /en-ae/
Disallow /ar-ae/
Disallow /ar-sa/
Disallow /en/

Other Records

Field Value
sitemap https://www.kuka.com/sitemapindex.xml

Comments

  • robots.txt for https://www.kuka.com/
  • disallow various download center and filter links
  • Disable indexing of URLs with Parameters for MOZ (SEO) crawler /url?parameter=abc
  • Sitemap