knovel.com
robots.txt

Robots Exclusion Standard data for knovel.com

Resource Scan

Scan Details

Site Domain knovel.com
Base Domain knovel.com
Scan Status Ok
Last Scan2025-10-02T16:20:04+00:00
Next Scan 2025-11-01T16:20:04+00:00

Last Scan

Scanned2025-10-02T16:20:04+00:00
URL https://knovel.com/robots.txt
Redirect https://app.knovel.com/robots.txt
Redirect Domain app.knovel.com
Redirect Base knovel.com
Domain IPs 3.175.86.114, 3.175.86.69, 3.175.86.8, 3.175.86.82
Redirect IPs 104.18.41.23, 172.64.146.233
Response IP 104.18.41.23
Found Yes
Hash 71d317be592e2eb0fad91ecbbcd1893d04396c64616b13fd651421c9a2a4bbab
SimHash 0118687283b7

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /kn/search
Disallow /web/poc/
Disallow /web/support/
Disallow /web/integration/
Disallow /kn/integrations/
Disallow /web/internal/
Disallow /kn/knovel-labs-internal
Disallow /web/myknovel.v
Disallow /kn/my-knovel
Disallow /hotlink/
Allow /hotlink/toc/
Disallow /web/view/
Disallow /kn/resources/
Allow /kn/resources/*/toc
Disallow /kn/resources/kpCPPOC005/toc
Disallow /kn/resources/kpKCP00008/toc
Disallow /kn/resources/kpCAT00002/toc
Disallow /kn/resources/kpH56V4RSS/toc
Disallow /kn/resources/kpFACD0004/toc
Disallow /kn/resources/kpKCD0000F/toc

Other Records

Field Value
crawl-delay 0.5

Other Records

Field Value
sitemap https://app.knovel.com/sitemap/sitemap-toc.xml
sitemap https://app.knovel.com/sitemap/sitemap-channel.xml
sitemap https://app.knovel.com/sitemap/sitemap-entry.xml
sitemap https://app.knovel.com/sitemap/sitemap-seopage.xml