infocielo.com
robots.txt

Robots Exclusion Standard data for infocielo.com

Resource Scan

Scan Details

Site Domain infocielo.com
Base Domain infocielo.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-11T19:38:11+00:00
Next Scan 2024-11-25T19:38:11+00:00

Last Successful Scan

Scanned2024-10-27T11:37:38+00:00
URL https://infocielo.com/robots.txt
Domain IPs 104.18.12.16, 104.18.13.16
Response IP 104.18.13.16
Found Yes
Hash b4f344ca932593b3c8c2d681b54a4141466828c1cbf79b4f89cc26efd6fbf1b0
SimHash 281c82724bf7

Groups

*

Rule Path
Allow /
Disallow /banner/*
Disallow /deportes/resultados?tag=*

Other Records

Field Value
sitemap https://infocielo.com/sitemap/news-full/sitemap-index.xml
sitemap https://infocielo.com/sitemap/images-full/sitemap1.xml.gz
sitemap https://infocielo.com/sitemap/groupers-full/sitemap-index.xml
sitemap https://infocielo.com/sitemap-news.xml
sitemap https://infocielo.com/sitemap.xml