doctoraliar.com
robots.txt

Robots Exclusion Standard data for doctoraliar.com

Resource Scan

Scan Details

Site Domain doctoraliar.com
Base Domain doctoraliar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-09T21:19:08+00:00
Next Scan 2024-08-07T21:19:08+00:00

Last Successful Scan

Scanned2023-07-15T21:16:23+00:00
URL https://doctoraliar.com/robots.txt
Redirect https://www.doctoraliar.com/robots.txt
Redirect Domain www.doctoraliar.com
Redirect Base doctoraliar.com
Domain IPs 13.33.88.15, 13.33.88.50, 13.33.88.6, 13.33.88.7
Redirect IPs 13.33.88.15, 13.33.88.50, 13.33.88.6, 13.33.88.7
Response IP 143.204.215.77
Found Yes
Hash 33ee00ecd0a1440b8fd22e55e1d3f8ce7e1805d3ff9d2614bfa3f2578ad2128f
SimHash 43569500671f

Groups

*

Rule Path
Allow /
Disallow /stats.php
Disallow /ajax.php

*

Rule Path
Disallow /RESOURCE%2BNOT%2BFOUND/
Disallow /*ranking-de-medicos*

spbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

mlbot

Rule Path
Disallow /

*

Rule Path
Disallow /registro-medico
Disallow /tomar-el-control/
Disallow /doctor-add
Disallow /solicita-cambios-de-perfil/*
Disallow /anade-opinion/*
Disallow /edit-opinion/
Disallow /buscar?
Disallow /registro-centro
Disallow /social-connect
Disallow /marketing/
Disallow /*/marketing/
Disallow /ajax/
Disallow /enlace
Disallow /clinicas/enlace

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

piplbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

neticle.hu

Rule Path
Disallow /

*

Rule Path
Disallow /public/doc

Warnings

  • 1 invalid line.