lecturasdecielo.com
robots.txt

Robots Exclusion Standard data for lecturasdecielo.com

Resource Scan

Scan Details

Site Domain lecturasdecielo.com
Base Domain lecturasdecielo.com
Scan Status Ok
Last Scan2026-02-10T15:10:38+00:00
Next Scan 2026-03-12T15:10:38+00:00

Last Scan

Scanned2026-02-10T15:10:38+00:00
URL https://lecturasdecielo.com/robots.txt
Domain IPs 104.21.71.21, 172.67.142.71, 2606:4700:3034::6815:4715, 2606:4700:3034::ac43:8e47
Response IP 172.67.142.71
Found Yes
Hash dc5f4c0b29b7af2be041d2abfd48c42ae6a23d51cdfc13227a54ba2ba4ebf510
SimHash 2876da408383

Groups

teoma

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 120

Other Records

Field Value
sitemap https://www.lecturasdecielo.com/sitemap.xml