www.cde.ca.gov
robots.txt

Robots Exclusion Standard data for www.cde.ca.gov

Resource Scan

Scan Details

Site Domain www.cde.ca.gov
Base Domain ca.gov
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer redirected incorrectly.
Last Scan2024-10-11T15:40:22+00:00
Next Scan 2025-01-09T15:40:22+00:00

Last Successful Scan

Scanned2022-11-28T20:10:16+00:00
URL https://www.cde.ca.gov/robots.txt
Response IP 34.209.169.71, 52.34.133.136, 35.166.30.171
Found Yes
Hash 7f85d8369a0bfc363dafaf9a305820afbc4ffad60bc001a092caf28ef445f825
SimHash a4d19d2212f0

Groups

*

Rule Path
Disallow /ls/fa/sf/documents/schoolsiteanalysis2000.pdf
Disallow /be/ag/ag/documents/*
Disallow /be/ag/ag/yr04/documents/*
Disallow /be/ag/ag/yr05/documents/*
Disallow /be/ag/ag/yr06/documents/*
Disallow /be/ag/ag/yr07/documents/*
Disallow /be/ag/ag/yr08/documents/*
Disallow /be/ag/ag/yr09/documents/*
Disallow /be/ag/ag/yr10/documents/*
Disallow /be/ag/ag/yr11/documents/*
Disallow /be/ag/ag/yr12/documents/*
Disallow /be/ag/ag/yr13/documents/*
Disallow /be/ag/ag/yr14/documents/*
Disallow /be/ag/ag/yr15/documents/*
Disallow /be/ag/ag/yr16/documents/*
Disallow /be/ag/ag/yr17/documents/*
Disallow /be/ag/ag/yr18/documents/*
Disallow /be/ag/ag/yr19/documents/*
Disallow /be/ag/ag/yr20/documents/*
Disallow /ls/pf/c9*
Disallow /ls/pf/c8*
Disallow /ls/pf/c7*
Disallow /ls/pf/c6*
Disallow /ls/pf/c5*
Disallow /ls/pf/c4*
Disallow /ls/pf/c3*
Disallow /ls/pf/c2*
Disallow /ls/pf/c1*
Disallow /re/pn/fb/*yr
Disallow /re/pn/fb/documents/*yr
Disallow /re/pn/fb/documents/*2009
Disallow /re/pn/fb/documents/*2008
Disallow /re/pn/fb/documents/*2007
Disallow /re/pn/fb/documents/*2006
Disallow /re/pn/fb/documents/*2005
Disallow /*azindex/
Disallow /*sitemap/
Disallow /*print%3Dyes
Disallow /ds/sh/sn/documents/coproschool0809.xls
Disallow /ds/sh/sn/documents/coproschool0708.xls
Disallow /ds/sh/sn/documents/coproschool0607.xls
Disallow /ds/sh/sn/documents/coproschool0506.xls
Disallow /ds/sh/sn/documents/coprochild0809.xls
Disallow /ds/sh/sn/documents/coprochild0708.xls
Disallow /ds/sh/sn/documents/coprochild0607.xls
Disallow /ds/sh/sn/documents/coprochild0506.xls
Disallow /re/di/sd/*