aytosalamanca.es
robots.txt

Robots Exclusion Standard data for aytosalamanca.es

Resource Scan

Scan Details

Site Domain aytosalamanca.es
Base Domain aytosalamanca.es
Scan Status Ok
Last Scan2024-10-20T02:13:57+00:00
Next Scan 2024-11-19T02:13:57+00:00

Last Scan

Scanned2024-10-20T02:13:57+00:00
URL http://aytosalamanca.es/robots.txt
Domain IPs 213.4.63.165
Response IP 213.4.63.165
Found Yes
Hash d025e4ea961dc0ce04f30af2d3e816e9ce5ea4dde79dab195e68b6f32a62224b
SimHash a7565c402e61

Groups

baiduspider

Rule Path
Disallow /

findestars

Rule Path
Disallow /

myonid

Rule Path
Disallow /

peekyou

Rule Path
Disallow /

pipl

Rule Path
Disallow /

rapleaf

Rule Path
Disallow /

snitch

Rule Path
Disallow /

spock

Rule Path
Disallow /

tweepz

Rule Path
Disallow /

wink

Rule Path
Disallow /

yasni

Rule Path
Disallow /

yoname

Rule Path
Disallow /

yourtraces

Rule Path
Disallow /

zoominfo

Rule Path
Disallow /

stress-agent

Rule Path
Disallow /

*

Rule Path
Disallow /*.xsd$
Disallow /*.jsp$
Disallow /*calYear*
Disallow /system/
Disallow /login/
Disallow /*?

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap http://www.aytosalamanca.es/sitemap.xml

Comments

  • No permitir la indexación por parte de los siguientes Crawlers
  • Para el resto de robots
  • Disallow: /*.js$
  • Disallow: /*.css$

Warnings

  • 2 invalid lines.