doctoralia.es
robots.txt

Robots Exclusion Standard data for doctoralia.es

Resource Scan

Scan Details

Site Domain doctoralia.es
Base Domain doctoralia.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-08T08:06:41+00:00
Next Scan 2024-08-06T08:06:41+00:00

Last Successful Scan

Scanned2023-07-14T07:30:54+00:00
URL https://doctoralia.es/robots.txt
Redirect https://www.doctoralia.es/robots.txt
Redirect Domain www.doctoralia.es
Redirect Base doctoralia.es
Domain IPs 13.224.249.112, 13.224.249.116, 13.224.249.17, 13.224.249.67
Redirect IPs 13.224.249.112, 13.224.249.116, 13.224.249.17, 13.224.249.67
Response IP 13.225.214.66
Found Yes
Hash 33ee00ecd0a1440b8fd22e55e1d3f8ce7e1805d3ff9d2614bfa3f2578ad2128f
SimHash 43569500671f

Groups

*

Rule Path
Allow /
Disallow /stats.php
Disallow /ajax.php

*

Rule Path
Disallow /RESOURCE%2BNOT%2BFOUND/
Disallow /*ranking-de-medicos*

spbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

mlbot

Rule Path
Disallow /

*

Rule Path
Disallow /registro-medico
Disallow /tomar-el-control/
Disallow /doctor-add
Disallow /solicita-cambios-de-perfil/*
Disallow /anade-opinion/*
Disallow /edit-opinion/
Disallow /buscar?
Disallow /registro-centro
Disallow /social-connect
Disallow /marketing/
Disallow /*/marketing/
Disallow /ajax/
Disallow /enlace
Disallow /clinicas/enlace

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

piplbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

neticle.hu

Rule Path
Disallow /

*

Rule Path
Disallow /public/doc

Warnings

  • 1 invalid line.