sunnyvale.ca.gov
robots.txt

Robots Exclusion Standard data for sunnyvale.ca.gov

Resource Scan

Scan Details

Site Domain sunnyvale.ca.gov
Base Domain ca.gov
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-20T05:58:40+00:00
Next Scan 2024-12-19T05:58:40+00:00

Last Successful Scan

Scanned2024-02-01T05:44:19+00:00
URL https://sunnyvale.ca.gov/robots.txt
Redirect https://www.sunnyvale.ca.gov/robots.txt
Redirect Domain www.sunnyvale.ca.gov
Redirect Base ca.gov
Domain IPs 135.84.124.41
Redirect IPs 2600:1413:b000:6::17d5:2bd0, 2600:1413:b000:6::17d5:2bd7, 96.17.96.16, 96.17.96.5
Response IP 23.44.4.177
Found Yes
Hash 2e2fbf16e2ccdb1b052b016b55917155d8cb650b4f8ab82c63b55d17b1d53dc1
SimHash 0800c8208375

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

googlebot

Rule Path
Allow /scripts
Allow /Scripts
Allow /sCripts
Allow /SCripts
Allow /scRipts
Allow /ScRipts
Allow /sCRipts
Allow /SCRipts
Allow /scrIpts
Allow /ScrIpts
Allow /sCrIpts
Allow /SCrIpts
Allow /scRIpts
Allow /ScRIpts
Allow /sCRIpts
Allow /SCRIpts
Allow /scriPts
Allow /ScriPts
Allow /sCriPts
Allow /SCriPts
Allow /scRiPts
Allow /ScRiPts
Allow /sCRiPts
Allow /SCRiPts
Allow /scrIPts
Allow /ScrIPts
Allow /sCrIPts
Allow /SCrIPts
Allow /scRIPts
Allow /ScRIPts
Allow /sCRIPts
Allow /SCRIPts
Allow /scripTs
Allow /ScripTs
Allow /sCripTs
Allow /SCripTs
Allow /scRipTs
Allow /ScRipTs
Allow /sCRipTs
Allow /SCRipTs
Allow /scrIpTs
Allow /ScrIpTs
Allow /sCrIpTs
Allow /SCrIpTs
Allow /scRIpTs
Allow /ScRIpTs
Allow /sCRIpTs
Allow /SCRIpTs
Allow /scriPTs
Allow /ScriPTs
Allow /sCriPTs
Allow /SCriPTs
Allow /scRiPTs
Allow /ScRiPTs
Allow /sCRiPTs
Allow /SCRiPTs
Allow /scrIPTs
Allow /ScrIPTs
Allow /sCrIPTs
Allow /SCrIPTs
Allow /scRIPTs
Allow /ScRIPTs
Allow /sCRIPTs
Allow /SCRIPTs
Allow /scriptS
Allow /ScriptS
Allow /sCriptS
Allow /SCriptS
Allow /scRiptS
Allow /ScRiptS
Allow /sCRiptS
Allow /SCRiptS
Allow /scrIptS
Allow /ScrIptS
Allow /sCrIptS
Allow /SCrIptS
Allow /scRIptS
Allow /ScRIptS
Allow /sCRIptS
Allow /SCRIptS
Allow /scriPtS
Allow /ScriPtS
Allow /sCriPtS
Allow /SCriPtS
Allow /scRiPtS
Allow /ScRiPtS
Allow /sCRiPtS
Allow /SCRiPtS
Allow /scrIPtS
Allow /ScrIPtS
Allow /sCrIPtS
Allow /SCrIPtS
Allow /scRIPtS
Allow /ScRIPtS
Allow /sCRIPtS
Allow /SCRIPtS
Allow /scripTS
Allow /ScripTS
Allow /sCripTS
Allow /SCripTS
Allow /scRipTS
Allow /ScRipTS
Allow /sCRipTS
Allow /SCRipTS
Allow /scrIpTS
Allow /ScrIpTS
Allow /sCrIpTS
Allow /SCrIpTS
Allow /scRIpTS
Allow /ScRIpTS
Allow /sCRIpTS
Allow /SCRIpTS
Allow /scriPTS
Allow /ScriPTS
Allow /sCriPTS
Allow /SCriPTS
Allow /scRiPTS
Allow /ScRiPTS
Allow /sCRiPTS
Allow /SCRiPTS
Allow /scrIPTS
Allow /ScrIPTS
Allow /sCrIPTS
Allow /SCrIPTS
Allow /scRIPTS
Allow /ScRIPTS
Allow /sCRIPTS
Allow /SCRIPTS
Disallow /admin
Disallow /Admin
Disallow /aDmin
Disallow /ADmin
Disallow /adMin
Disallow /AdMin
Disallow /aDMin
Disallow /ADMin
Disallow /admIn
Disallow /AdmIn
Disallow /aDmIn
Disallow /ADmIn
Disallow /adMIn
Disallow /AdMIn
Disallow /aDMIn
Disallow /ADMIn
Disallow /admiN
Disallow /AdmiN
Disallow /aDmiN
Disallow /ADmiN
Disallow /adMiN
Disallow /AdMiN
Disallow /aDMiN
Disallow /ADMiN
Disallow /admIN
Disallow /AdmIN
Disallow /aDmIN
Disallow /ADmIN
Disallow /adMIN
Disallow /AdMIN
Disallow /aDMIN
Disallow /ADMIN
Disallow /*.asmx*
Disallow /*.Asmx*
Disallow /*.aSmx*
Disallow /*.ASmx*
Disallow /*.asMx*
Disallow /*.AsMx*
Disallow /*.aSMx*
Disallow /*.ASMx*
Disallow /*.asmX*
Disallow /*.AsmX*
Disallow /*.aSmX*
Disallow /*.ASmX*
Disallow /*.asMX*
Disallow /*.AsMX*
Disallow /*.aSMX*
Disallow /*.ASMX*

*

Rule Path
Disallow /scripts
Disallow /Scripts
Disallow /sCripts
Disallow /SCripts
Disallow /scRipts
Disallow /ScRipts
Disallow /sCRipts
Disallow /SCRipts
Disallow /scrIpts
Disallow /ScrIpts
Disallow /sCrIpts
Disallow /SCrIpts
Disallow /scRIpts
Disallow /ScRIpts
Disallow /sCRIpts
Disallow /SCRIpts
Disallow /scriPts
Disallow /ScriPts
Disallow /sCriPts
Disallow /SCriPts
Disallow /scRiPts
Disallow /ScRiPts
Disallow /sCRiPts
Disallow /SCRiPts
Disallow /scrIPts
Disallow /ScrIPts
Disallow /sCrIPts
Disallow /SCrIPts
Disallow /scRIPts
Disallow /ScRIPts
Disallow /sCRIPts
Disallow /SCRIPts
Disallow /scripTs
Disallow /ScripTs
Disallow /sCripTs
Disallow /SCripTs
Disallow /scRipTs
Disallow /ScRipTs
Disallow /sCRipTs
Disallow /SCRipTs
Disallow /scrIpTs
Disallow /ScrIpTs
Disallow /sCrIpTs
Disallow /SCrIpTs
Disallow /scRIpTs
Disallow /ScRIpTs
Disallow /sCRIpTs
Disallow /SCRIpTs
Disallow /scriPTs
Disallow /ScriPTs
Disallow /sCriPTs
Disallow /SCriPTs
Disallow /scRiPTs
Disallow /ScRiPTs
Disallow /sCRiPTs
Disallow /SCRiPTs
Disallow /scrIPTs
Disallow /ScrIPTs
Disallow /sCrIPTs
Disallow /SCrIPTs
Disallow /scRIPTs
Disallow /ScRIPTs
Disallow /sCRIPTs
Disallow /SCRIPTs
Disallow /scriptS
Disallow /ScriptS
Disallow /sCriptS
Disallow /SCriptS
Disallow /scRiptS
Disallow /ScRiptS
Disallow /sCRiptS
Disallow /SCRiptS
Disallow /scrIptS
Disallow /ScrIptS
Disallow /sCrIptS
Disallow /SCrIptS
Disallow /scRIptS
Disallow /ScRIptS
Disallow /sCRIptS
Disallow /SCRIptS
Disallow /scriPtS
Disallow /ScriPtS
Disallow /sCriPtS
Disallow /SCriPtS
Disallow /scRiPtS
Disallow /ScRiPtS
Disallow /sCRiPtS
Disallow /SCRiPtS
Disallow /scrIPtS
Disallow /ScrIPtS
Disallow /sCrIPtS
Disallow /SCrIPtS
Disallow /scRIPtS
Disallow /ScRIPtS
Disallow /sCRIPtS
Disallow /SCRIPtS
Disallow /scripTS
Disallow /ScripTS
Disallow /sCripTS
Disallow /SCripTS
Disallow /scRipTS
Disallow /ScRipTS
Disallow /sCRipTS
Disallow /SCRipTS
Disallow /scrIpTS
Disallow /ScrIpTS
Disallow /sCrIpTS
Disallow /SCrIpTS
Disallow /scRIpTS
Disallow /ScRIpTS
Disallow /sCRIpTS
Disallow /SCRIpTS
Disallow /scriPTS
Disallow /ScriPTS
Disallow /sCriPTS
Disallow /SCriPTS
Disallow /scRiPTS
Disallow /ScRiPTS
Disallow /sCRiPTS
Disallow /SCRiPTS
Disallow /scrIPTS
Disallow /ScrIPTS
Disallow /sCrIPTS
Disallow /SCrIPTS
Disallow /scRIPTS
Disallow /ScRIPTS
Disallow /sCRIPTS
Disallow /SCRIPTS
Disallow /admin
Disallow /Admin
Disallow /aDmin
Disallow /ADmin
Disallow /adMin
Disallow /AdMin
Disallow /aDMin
Disallow /ADMin
Disallow /admIn
Disallow /AdmIn
Disallow /aDmIn
Disallow /ADmIn
Disallow /adMIn
Disallow /AdMIn
Disallow /aDMIn
Disallow /ADMIn
Disallow /admiN
Disallow /AdmiN
Disallow /aDmiN
Disallow /ADmiN
Disallow /adMiN
Disallow /AdMiN
Disallow /aDMiN
Disallow /ADMiN
Disallow /admIN
Disallow /AdmIN
Disallow /aDmIN
Disallow /ADmIN
Disallow /adMIN
Disallow /AdMIN
Disallow /aDMIN
Disallow /ADMIN
Disallow /*.asmx*
Disallow /*.Asmx*
Disallow /*.aSmx*
Disallow /*.ASmx*
Disallow /*.asMx*
Disallow /*.AsMx*
Disallow /*.aSMx*
Disallow /*.ASMx*
Disallow /*.asmX*
Disallow /*.AsmX*
Disallow /*.aSmX*
Disallow /*.ASmX*
Disallow /*.asMX*
Disallow /*.AsMX*
Disallow /*.aSMX*
Disallow /*.ASMX*