doctoralia.com.mx
robots.txt

Robots Exclusion Standard data for doctoralia.com.mx

Resource Scan

Scan Details

Site Domain doctoralia.com.mx
Base Domain doctoralia.com.mx
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-04T09:12:50+00:00
Next Scan 2025-02-02T09:12:50+00:00

Last Successful Scan

Scanned2023-07-14T07:37:12+00:00
URL https://doctoralia.com.mx/robots.txt
Redirect https://www.doctoralia.com.mx/robots.txt
Redirect Domain www.doctoralia.com.mx
Redirect Base doctoralia.com.mx
Domain IPs 18.161.111.5, 18.161.111.51, 18.161.111.83, 18.161.111.93
Redirect IPs 65.9.112.18, 65.9.112.3, 65.9.112.34, 65.9.112.97
Response IP 13.225.63.29
Found Yes
Hash b6bc5d7e1f9cd48c3ac363c65cf3d15465e712586f5ffa28864fc1abf5f0766a
SimHash 43469580671f

Groups

*

Rule Path
Allow /
Disallow /stats.php
Disallow /ajax.php

sogou web spider

Rule Path
Disallow /

*

Rule Path
Disallow /RESOURCE%2BNOT%2BFOUND/
Disallow /*ranking-de-medicos*

spbot

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /

mlbot

Rule Path
Disallow /

*

Rule Path
Disallow /registro-medico
Disallow /tomar-el-control/
Disallow /doctor-add
Disallow /solicita-cambios-de-perfil/*
Disallow /anade-opinion/*
Disallow /edit-opinion/
Disallow /buscar?
Disallow /registro-centro
Disallow /social-connect
Disallow /marketing/
Disallow /*/marketing/
Disallow /ajax/
Disallow /enlace
Disallow /clinicas/enlace

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

piplbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

neticle.hu

Rule Path
Disallow /

*

Rule Path
Disallow /public/doc

Warnings

  • 1 invalid line.