smpereira.org
robots.txt

Robots Exclusion Standard data for smpereira.org

Resource Scan

Scan Details

Site Domain smpereira.org
Base Domain smpereira.org
Scan Status Ok
Last Scan2025-09-14T10:47:34+00:00
Next Scan 2025-09-21T10:47:34+00:00

Last Scan

Scanned2025-09-14T10:47:34+00:00
URL https://smpereira.org/robots.txt
Domain IPs 104.21.74.125, 172.67.158.95, 2606:4700:3033::6815:4a7d, 2606:4700:3034::ac43:9e5f
Response IP 104.21.74.125
Found Yes
Hash 501ed5e036a17020ca3e0606896172db2ded635ee4e0f88072a84c2c9ab7f573
SimHash 624ec8d0c511

Groups

*

Rule Path
Disallow /*/dominios/
Disallow /*/modulos/
Allow /*/dominios/*/plantillas/
Allow /en/dominios/*/plantillas/
Allow /es/dominios/*/plantillas/
Allow /es/xmailer/
Allow /en/
Allow /es/
Allow /

Other Records

Field Value
crawl-delay 30

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap http://smpereira.org/sitemap.xml