Log In Sign Up

kenwoodworld.com
robots.txt

Robots Exclusion Standard data for kenwoodworld.com

Resource Scan

Scan Details

Site Domain kenwoodworld.com
Base Domain kenwoodworld.com
Scan Status Ok
Last Scan2024-06-01T02:00:42+00:00
Next Scan 2024-07-01T02:00:42+00:00

Last Scan

Scanned2024-06-01T02:00:42+00:00
URL https://kenwoodworld.com/robots.txt
Redirect https://www.kenwoodworld.com/robots.txt
Redirect Domain www.kenwoodworld.com
Redirect Base kenwoodworld.com
Domain IPs 35.190.208.151
Redirect IPs 23.199.134.34
Response IP 23.15.108.232
Found Yes
Hash 21fd20966a7dde65b40f4b18a6a0d53e3678fae9d2c3bee1451c0bf8a5f45596
SimHash 85738ff28dea

Groups

*

Rule Path
Disallow /*cart
Disallow /*checkout
Disallow /*my-account
Disallow /ja-jp
Disallow /he-il
Disallow /kk-kz
Disallow /en-th
Disallow /en-pk
Disallow /en-in
Disallow /ru-ru/search-results?q=
Disallow /ru-ru/customer-support/faqs/-----?q=
Disallow /en-sys
Disallow /en-ar
Disallow /ru-ua

trendictionbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Allow /ru-ru

yandexbot

Rule Path
Disallow /
Allow /ru-ru

googlebot

Rule Path
Disallow /*_openstat
Disallow /*from%3Dadwords
Disallow /*?from=
Disallow /*%26sort%3D
Disallow /?refpage=
Disallow /ru-ru/search-results?q=
Disallow /ru-ru/customer-support/faqs/-----?q=
Disallow /*cart
Disallow /*checkout
Disallow /*my-account

sogou news spider

Rule Path
Disallow /
Allow /zh-cn

baiduspider

Rule Path
Disallow /
Allow /zh-cn

zumbot

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

orangebot

Rule Path
Disallow /

jobdiggerspider

Rule Path
Disallow /

yeti

Rule Path
Disallow /
Allow /ko-kr

cazoodlebot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.kenwoodworld.com/cs-cz/sitemap.xml
sitemap https://www.kenwoodworld.com/da-dk/sitemap.xml
sitemap https://www.kenwoodworld.com/de-at/sitemap.xml
sitemap https://www.kenwoodworld.com/de-ch/sitemap.xml
sitemap https://www.kenwoodworld.com/de-de/sitemap.xml
sitemap https://www.kenwoodworld.com/el-gr/sitemap.xml
sitemap https://www.kenwoodworld.com/en-au/sitemap.xml
sitemap https://www.kenwoodworld.com/en-ca/sitemap.xml
sitemap https://www.kenwoodworld.com/en-gb/sitemap.xml
sitemap https://www.kenwoodworld.com/en-nz/sitemap.xml
sitemap https://www.kenwoodworld.com/en-us/sitemap.xml
sitemap https://www.kenwoodworld.com/es-es/sitemap.xml
sitemap https://www.kenwoodworld.com/fi-fi/sitemap.xml
sitemap https://www.kenwoodworld.com/fr-be/sitemap.xml
sitemap https://www.kenwoodworld.com/fr-ca/sitemap.xml
sitemap https://www.kenwoodworld.com/fr-ch/sitemap.xml
sitemap https://www.kenwoodworld.com/fr-fr/sitemap.xml
sitemap https://www.kenwoodworld.com/hu-hu/sitemap.xml
sitemap https://www.kenwoodworld.com/it-it/sitemap.xml
sitemap https://www.kenwoodworld.com/ja-jp/sitemap.xml
sitemap https://www.kenwoodworld.com/nb-no/sitemap.xml
sitemap https://www.kenwoodworld.com/nl-be/sitemap.xml
sitemap https://www.kenwoodworld.com/nl-nl/sitemap.xml
sitemap https://www.kenwoodworld.com/pl-pl/sitemap.xml
sitemap https://www.kenwoodworld.com/pt-pt/sitemap.xml
sitemap https://www.kenwoodworld.com/sk-sk/sitemap.xml
sitemap https://www.kenwoodworld.com/sv-se/sitemap.xml
sitemap https://www.kenwoodworld.com/zh-cn/sitemap.xml
Back to top

Comments

  • For all robots
  • Block access to specific groups of SAP pages
  • Block access to specific non existing local folders
  • Block CazoodleBot as it does not present correct accept content headers
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot
  • Allow spiders to discover all the local sitemaps
Back to top

Warnings

  • 4 invalid lines.
Back to top