Log In Sign Up

knuth.com
robots.txt

Robots Exclusion Standard data for knuth.com

Resource Scan

Scan Details

Site Domain knuth.com
Base Domain knuth.com
Scan Status Ok
Last Scan2024-09-24T05:30:57+00:00
Next Scan 2024-10-24T05:30:57+00:00

Last Scan

Scanned2024-09-24T05:30:57+00:00
URL https://knuth.com/robots.txt
Redirect https://www.knuth.com/robots.txt
Redirect Domain www.knuth.com
Redirect Base knuth.com
Domain IPs 68.183.240.247
Redirect IPs 68.183.240.247
Response IP 68.183.240.247
Found Yes
Hash 235b20217424ace389fbfa30f3bb5aa3ab496ee3ad461da45494395a073f9225
SimHash 2610dd74c6e2

Groups

*

Rule Path
Disallow */shop/*
Disallow /*forcedevicetype
Disallow /*pimcore_override_output_timestamp
Disallow /*pimcore_preview
Disallow /*_locale
Disallow /*_dc
Disallow /*_format
Disallow /*_path
Disallow /*_controller
Disallow /*systemlocale
Disallow /*pimcore_editmode
Disallow /*SID
Disallow /*___store
Disallow /*___from_store
Disallow /*SKU
Disallow /*category
Disallow /*baureihe

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.knuth.com/sitemap.categories-cz.xml
sitemap https://www.knuth.com/sitemap.categories-de.xml
sitemap https://www.knuth.com/sitemap.categories-en-us.xml
sitemap https://www.knuth.com/sitemap.categories-en-za.xml
sitemap https://www.knuth.com/sitemap.categories-en.xml
sitemap https://www.knuth.com/sitemap.categories-es.xml
sitemap https://www.knuth.com/sitemap.categories-es-us.xml
sitemap https://www.knuth.com/sitemap.categories-fr.xml
sitemap https://www.knuth.com/sitemap.categories-it.xml
sitemap https://www.knuth.com/sitemap.categories-pl.xml
sitemap https://www.knuth.com/sitemap.categories-ro.xml
sitemap https://www.knuth.com/sitemap.categories-ru.xml
sitemap https://www.knuth.com/sitemap.other-cz.xml
sitemap https://www.knuth.com/sitemap.other-de.xml
sitemap https://www.knuth.com/sitemap.other-en.xml
sitemap https://www.knuth.com/sitemap.other-en-us.xml
sitemap https://www.knuth.com/sitemap.other-en-za.xml
sitemap https://www.knuth.com/sitemap.other-es.xml
sitemap https://www.knuth.com/sitemap.other-es-us.xml
sitemap https://www.knuth.com/sitemap.other-fr.xml
sitemap https://www.knuth.com/sitemap.other-it.xml
sitemap https://www.knuth.com/sitemap.other-pl.xml
sitemap https://www.knuth.com/sitemap.other-ro.xml
sitemap https://www.knuth.com/sitemap.other-ru.xml
sitemap https://www.knuth.com/sitemap.products-cz.xml
sitemap https://www.knuth.com/sitemap.products-de.xml
sitemap https://www.knuth.com/sitemap.products-en.xml
sitemap https://www.knuth.com/sitemap.products-en-us.xml
sitemap https://www.knuth.com/sitemap.products-en-za.xml
sitemap https://www.knuth.com/sitemap.products-es.xml
sitemap https://www.knuth.com/sitemap.products-es-us.xml
sitemap https://www.knuth.com/sitemap.products-fr.xml
sitemap https://www.knuth.com/sitemap.products-it.xml
sitemap https://www.knuth.com/sitemap.products-pl.xml
sitemap https://www.knuth.com/sitemap.products-ro.xml
sitemap https://www.knuth.com/sitemap.products-ru.xml
sitemap https://www.knuth.com/sitemap.en-za-pages.xml
sitemap https://www.knuth.com/sitemap.accessories-en.xml
sitemap https://www.knuth.com/sitemap.accessories-de.xml
sitemap https://www.knuth.com/sitemap.accessories-fr.xml
sitemap https://www.knuth.com/sitemap.accessories-es.xml
sitemap https://www.knuth.com/sitemap.accessories-it.xml
sitemap https://www.knuth.com/sitemap.accessories-ru.xml
sitemap https://www.knuth.com/sitemap.accessories-cz.xml
sitemap https://www.knuth.com/sitemap.accessories-pl.xml
sitemap https://www.knuth.com/sitemap.accessories-ro.xml
sitemap https://www.knuth.com/sitemap.accessories-en-us.xml
sitemap https://www.knuth.com/sitemap.accessories-es-us.xml
sitemap https://www.knuth.com/sitemap.accessories-en-za.xml
Back to top

Warnings

  • 1 invalid line.
Back to top