m.elpais.com.co
robots.txt

Robots Exclusion Standard data for m.elpais.com.co

Resource Scan

Scan Details

Site Domain m.elpais.com.co
Base Domain elpais.com.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-03-27T05:13:04+00:00
Next Scan 2024-06-25T05:13:04+00:00

Last Successful Scan

Scanned2023-11-06T05:09:13+00:00
URL https://m.elpais.com.co/robots.txt
Redirect https://www.elpais.com.co/robots.txt
Redirect Domain www.elpais.com.co
Redirect Base elpais.com.co
Domain IPs 169.48.223.138, 169.48.223.140, 169.48.223.141
Redirect IPs 184.87.193.156, 184.87.193.162, 2600:1413:b000:13::b857:c19c, 2600:1413:b000:13::b857:c1a2
Response IP 42.99.140.139
Found Yes
Hash d7d205ce22f176d0e8f356e4aba503e6184923510585ee93e753ec4c15146917
SimHash 75696a861695

Groups

*
googlebot
googlebot-news
googlebot-image
googlebot-video
googlebot-mobile

Rule Path
Disallow /pf/api/v3/*
Disallow /test/
Disallow /columnist-articles/
Disallow /listing/
Disallow /page/
Disallow /elpais/
Disallow /ArticleAsync/
Allow /sitemap/
Allow /sitemap/*
Allow /sitemaps/*
Allow /rss/
Allow /rss/*

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.elpais.com.co/arc/outboundfeeds/sitemap/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/cali/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/valle/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/colombia/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/mundo/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/economia/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/deportes/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/tecnologia/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/entretenimiento/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/opinion/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/salud/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/vehiculos/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/educacion/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/politica/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/judicial/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/cultura/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/medio-ambiente/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/como-hacer/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/elecciones/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/servicios/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/gatos-perros/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/loterias/?outputType=xml
sitemap https://www.elpais.com.co/arc/outboundfeeds/rss/category/recetas/?outputType=xml

Comments

  • Info
  • Info publica
  • Sitemaps
  • RSS