Log In Sign Up

elpais.com.co
robots.txt

Robots Exclusion Standard data for elpais.com.co

Resource Scan

Scan Details

Site Domain elpais.com.co
Base Domain elpais.com.co
Scan Status Ok
Last Scan2024-09-21T17:31:47+00:00
Next Scan 2024-09-28T17:31:47+00:00

Last Scan

Scanned2024-09-21T17:31:47+00:00
URL https://elpais.com.co/robots.txt
Redirect https://www.elpais.com.co:443/robots.txt
Redirect Domain www.elpais.com.co
Redirect Base elpais.com.co
Domain IPs 13.248.202.234, 76.223.87.56
Redirect IPs 125.56.219.35, 2600:1413:b000:13::b857:c19c, 2600:1413:b000:13::b857:c1a2, 96.17.72.17
Response IP 23.45.207.171
Found Yes
Hash 125c9b2b9898a57b930ed5d46e3629ea82ffb9ec27db42e32a77ee4811c2a26f
SimHash 794bea8e1695

Groups

*
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile

Rule Path
Allow /sitemap/
Allow /sitemap/*
Allow /sitemaps/*
Allow /rss/
Allow /rss/*
Disallow /pf/api/v3/*
Disallow /test/
Disallow /columnist-articles/
Disallow /listing/
Disallow /page/
Disallow /elpais/
Disallow /ArticleAsync/

petalbot

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.elpais.com.co/arc/outboundfeeds/sitemap/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/cali/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/valle/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/colombia/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/mundo/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/economia/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/deportes/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/tecnologia/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/entretenimiento/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/opinion/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/salud/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/vehiculos/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/educacion/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/politica/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/judicial/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/cultura/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/medio-ambiente/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/como-hacer/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/servicios/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/gatos-perros/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/loterias/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/recetas/?outputType=xml
Back to top