Log In Sign Up

univision.com
robots.txt

Robots Exclusion Standard data for univision.com

Resource Scan

Scan Details

Site Domain univision.com
Base Domain univision.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-19T18:40:39+00:00
Next Scan 2024-07-18T18:40:39+00:00

Last Successful Scan

Scanned2023-12-22T04:33:40+00:00
URL https://univision.com/robots.txt
Redirect https://www.univision.com/robots.txt
Redirect Domain www.univision.com
Redirect Base univision.com
Domain IPs 44.213.158.3, 52.21.94.223, 54.88.200.10
Redirect IPs 23.39.11.110
Response IP 23.39.11.110
Found Yes
Hash e34f5655f2b6ce69b51a5deb80f5132a4fec386fb38203f92928fe4f9a9c5ff2
SimHash a35112d08472

Groups

*

Rule Path
Allow /
Disallow /deportes/fantasy/template*
Disallow /noticias/live-fyre-blog-test*
Disallow /verizon-connecta-la-banda*
Disallow /temas/verizon-connecta-la-banda*
Disallow /temas/test*
Disallow /test*
Disallow /amp/test*
Disallow /en/*
Disallow /buscar
Disallow /6881
Disallow /beta
Disallow /*playlist.xml
Disallow /_preview
Disallow /search
Disallow */embed*

netseer

Rule Path
Disallow /

clickagy intelligence bot v2

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.univision.com/sitemap.xml
sitemap https://www.univision.com/video-sitemap.xml
sitemap https://www.univision.com/feed-sitemap/google-news
sitemap https://www.univision.com/feed-sitemap/google-news/famosos
sitemap https://www.univision.com/feed-sitemap/google-news/local-arizona
sitemap https://www.univision.com/feed-sitemap/google-news/local-austin
sitemap https://www.univision.com/feed-sitemap/google-news/local-chicago
sitemap https://www.univision.com/feed-sitemap/google-news/local-bakersfield
sitemap https://www.univision.com/feed-sitemap/google-news/local-dallas
sitemap https://www.univision.com/feed-sitemap/google-news/local-fresno
sitemap https://www.univision.com/feed-sitemap/google-news/local-houston
sitemap https://www.univision.com/feed-sitemap/google-news/local-los-angeles
sitemap https://www.univision.com/feed-sitemap/google-news/local-miami
sitemap https://www.univision.com/feed-sitemap/google-news/local-north-carolina
sitemap https://www.univision.com/feed-sitemap/google-news/local-philadelphia
sitemap https://www.univision.com/feed-sitemap/google-news/local-puerto-rico
sitemap https://www.univision.com/feed-sitemap/google-news/local-sacramento
sitemap https://www.univision.com/feed-sitemap/google-news/local-salt-lake-city
sitemap https://www.univision.com/feed-sitemap/google-news/local-san-antonio
sitemap https://www.univision.com/feed-sitemap/google-news/local-san-francisco
sitemap https://www.univision.com/feed-sitemap/google-news/noticias
sitemap https://www.univision.com/feed-sitemap/google-news/elecciones-2020
Back to top

Comments

  • Sitemaps and Autodiscovers
  • Google News
Back to top