bethlemitaspereira.edu.co
robots.txt

Robots Exclusion Standard data for bethlemitaspereira.edu.co

Resource Scan

Scan Details

Site Domain bethlemitaspereira.edu.co
Base Domain bethlemitaspereira.edu.co
Scan Status Ok
Last Scan2025-04-09T09:59:52+00:00
Next Scan 2025-04-16T09:59:52+00:00

Last Scan

Scanned2025-04-09T09:59:52+00:00
URL https://bethlemitaspereira.edu.co/robots.txt
Domain IPs 104.21.16.2, 172.67.165.159, 2606:4700:3033::ac43:a59f, 2606:4700:3034::6815:1002
Response IP 172.67.165.159
Found Yes
Hash aa450516b57a1c326bb4fdc5023eeff9b306e7f9476fb76050cfb30e3de3f356
SimHash 6006c840c611

Groups

*

Rule Path
Disallow /*/dominios/
Disallow /*/modulos/
Allow /*/dominios/*/plantillas/
Allow /en/dominios/*/plantillas/
Allow /es/dominios/*/plantillas/
Allow /es/xmailer/
Allow /en/
Allow /es/
Allow /

Other Records

Field Value
crawl-delay 30

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://bethlemitaspereira.edu.co/sitemap.xml