kastatic.org
robots.txt
Robots Exclusion Standard data for kastatic.org
Resource Scan
Scan Details
Site Domain | kastatic.org |
Base Domain | kastatic.org |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-08-12T22:38:50+00:00 |
Next Scan | 2024-11-10T22:38:50+00:00 |
Last Successful Scan
Scanned | 2023-12-24T22:35:51+00:00 |
URL | http://www.kastatic.org/robots.txt |
Redirect | https://www.khanacademy.org/robots.txt |
Redirect Domain | www.khanacademy.org |
Redirect Base | khanacademy.org |
Domain IPs | 172.217.194.121, 2404:6800:4003:c04::79 |
Redirect IPs | 151.101.1.42, 151.101.129.42, 151.101.193.42, 151.101.65.42 |
Response IP | 199.232.45.42 |
Found | Yes |
Hash | 4ec66c86f1d6f0fa70dc11052ee8a5c1d557552bb595e1cf5a92f910caaa3d70 |
SimHash | 68347c118e90 |
Groups
*
Rule | Path |
---|---|
Disallow | /_ah/ |
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /crash |
Disallow | /devadmin/ |
Disallow | /embed_video |
Disallow | /login?continue=* |
Disallow | /postlogin |
Disallow | /preview/ |
Disallow | /search |
Disallow | /searchtest |
Disallow | /settings/linkaccount |
Disallow | /khan-labs?step=terms-and-conditions |
Disallow | /khan-labs?step=terms-and-conditions-redirect |
Disallow | /khan-labs?step=no-birthdate |
Disallow | /khan-labs?step=under-age-gate |
Disallow | /khan-labs?step=english-only |
Disallow | /khan-labs?step=us-only |
Disallow | /khan-labs?step=children-over-limit |
Disallow | /khan-labs?step=ineligible |
Disallow | *?qa_expand_key* |
Other Records
Field | Value |
---|---|
sitemap | https://www.khanacademy.org/sitemap.xml |