casaasia.es
robots.txt

Robots Exclusion Standard data for casaasia.es

Resource Scan

Scan Details

Site Domain casaasia.es
Base Domain casaasia.es
Scan Status Ok
Last Scan2025-03-25T18:58:24+00:00
Next Scan 2025-04-08T18:58:24+00:00

Last Scan

Scanned2025-03-25T18:58:24+00:00
URL https://casaasia.es/robots.txt
Domain IPs 104.21.88.159, 172.67.185.202, 2606:4700:3031::6815:589f, 2606:4700:3035::ac43:b9ca
Response IP 172.67.185.202
Found Yes
Hash cae1855899d66e857c223fff0b262c22f20ffdc5d20b49807999c053197a8a21
SimHash e8fecc82f3cc

Groups

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

*

Rule Path
Disallow /wp-content/
Disallow /wp-icludes/
Disallow /trackback/
Disallow /wp-admin/
Disallow /archives/
Disallow /category/
Disallow /experto/
Disallow /cultura/ferias/
Disallow /boletines_hist/
Disallow /triangulacion/
Disallow /actividad_infantil/detalle/
Disallow /politica/detalle/
Disallow /noticia/detalle/
Disallow /actividad/detalle/
Disallow /recomendacion/detalle/
Disallow /recurso/detalle/
Disallow /actividades/economia-y-empresa/
Disallow /internet_y_tecnologia/
Disallow /cultura/exposiciones/
Disallow /publicacion/detalle/
Disallow /public_filters/
Disallow /mobile/
Disallow /mediateca/
Disallow /beca/
Disallow /economia/empleos/
Disallow /tag/
Disallow /GestorPeticiones
Disallow /wp-*
Disallow /login/
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.php$

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

Comments

  • User-agent: Googlebot-Image
  • Disallow: /
  • cdmon
  • User-agent: Googlebot
  • Disallow: /
  • User-agent: PetalBot
  • Disallow: /