knowlton.ca
robots.txt

Robots Exclusion Standard data for knowlton.ca

Resource Scan

Scan Details

Site Domain knowlton.ca
Base Domain knowlton.ca
Scan Status Ok
Last Scan2025-12-12T23:55:15+00:00
Next Scan 2026-01-11T23:55:15+00:00

Last Scan

Scanned2025-12-12T23:55:15+00:00
URL https://knowlton.ca/robots.txt
Redirect https://www.knowlton.ca/robots.txt
Redirect Domain www.knowlton.ca
Redirect Base knowlton.ca
Domain IPs 199.34.228.41
Redirect IPs 199.34.228.41
Response IP 199.34.228.41
Found Yes
Hash c8ab5336bdaad24f9a2c00f756cb8d90b8ad466d338b07e6a1f04a9ffe0f6c70
SimHash ea58d4a0a793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /grosvenor.html
Disallow /background.html
Disallow /trevor.html
Disallow /app.html
Disallow /https%3A//www.kiva.org/lender/trevork

Other Records

Field Value
sitemap https://www.knowlton.ca/sitemap.xml