ck12.org
robots.txt

Robots Exclusion Standard data for ck12.org

Resource Scan

Scan Details

Site Domain ck12.org
Base Domain ck12.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-30T07:23:38+00:00
Next Scan 2024-06-28T07:23:38+00:00

Last Successful Scan

Scanned2023-08-25T04:16:09+00:00
URL https://ck12.org/robots.txt
Redirect https://www.ck12.org/robots.txt
Redirect Domain www.ck12.org
Redirect Base ck12.org
Domain IPs 2600:9000:2003:1600:8:f05f:c540:93a1, 2600:9000:2003:6000:8:f05f:c540:93a1, 2600:9000:2003:6200:8:f05f:c540:93a1, 2600:9000:2003:7600:8:f05f:c540:93a1, 2600:9000:2003:ae00:8:f05f:c540:93a1, 2600:9000:2003:dc00:8:f05f:c540:93a1, 2600:9000:2003:de00:8:f05f:c540:93a1, 2600:9000:2003:e00:8:f05f:c540:93a1, 54.192.150.30, 54.192.150.46, 54.192.150.60, 54.192.150.98
Redirect IPs 2600:9000:2003:2600:8:f05f:c540:93a1, 2600:9000:2003:7400:8:f05f:c540:93a1, 2600:9000:2003:8600:8:f05f:c540:93a1, 2600:9000:2003:9a00:8:f05f:c540:93a1, 2600:9000:2003:bc00:8:f05f:c540:93a1, 2600:9000:2003:d200:8:f05f:c540:93a1, 2600:9000:2003:ec00:8:f05f:c540:93a1, 2600:9000:2003:f200:8:f05f:c540:93a1, 54.192.150.30, 54.192.150.46, 54.192.150.60, 54.192.150.98
Response IP 13.225.34.11
Found Yes
Hash 9304a52a8a8cf79882ebbf09d604cbaed3cd01ea15f46651aa709ac57b166238
SimHash cb04da75dc93

Groups

*

Rule Path
Allow */user%3A*/book/
Disallow /api/
Disallow /ads/
Disallow /flx/show/web/
Disallow /flx/show/pdf/
Disallow /my/
Disallow /editor/
Disallow *.../$
Disallow */user%3A*/
Disallow /user-generated-content/
Disallow /ck12/images
Disallow /external

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ck12.org/sitemapindex.xml
sitemap https://www.ck12.org/sitemap_subjects_index.xml

Comments

  • Allow UGC 1.x FlexBooks
  • Disallow following patterns
  • disallow really old image urls that no longer make sense