espn.co.cr
robots.txt

Robots Exclusion Standard data for espn.co.cr

Resource Scan

Scan Details

Site Domain espn.co.cr
Base Domain espn.co.cr
Scan Status Ok
Last Scan2024-11-15T18:05:58+00:00
Next Scan 2024-11-22T18:05:58+00:00

Last Scan

Scanned2024-11-15T18:05:58+00:00
URL https://espn.co.cr/robots.txt
Redirect https://www.espn.co.cr/robots.txt
Redirect Domain www.espn.co.cr
Redirect Base espn.co.cr
Domain IPs 13.35.238.28, 13.35.238.6, 13.35.238.94, 13.35.238.99
Redirect IPs 13.35.210.101, 13.35.210.15, 13.35.210.71, 13.35.210.78
Response IP 13.35.210.15
Found Yes
Hash ca016ac41bdd625e1930999c144f7e598427caf2a2dcdd1be7b754720d7b1916
SimHash 039645494596

Groups

claritybot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow *print?id
Disallow /format/
Disallow /nfl/format/player/design09/dropdown
Disallow /nba/format/player/design09/dropdown
Disallow /golf/deportes/format/player/design09/dropdown
Disallow /extra/mma/deportes/format/player/design09/dropdown
Disallow /extra/mma/format/player/design09/dropdown
Disallow /rpm/deportes/format/player/design09/dropdown
Disallow /golf/format/player/design09/dropdown
Disallow /mlb/format/player/design09/dropdown
Disallow /watch/*?*lang=
Disallow /watch/*?*rb=
Disallow /watch/*?*country=
Disallow /watch/*?*search=
Disallow /watch/*?*device=
Disallow /watch/*?*partner=
Disallow /watch/*?*redirected=
Disallow /watch/_/redirected/*
Disallow /watch/*?*om-navmethod=
Disallow */jugador/avanzadas
Disallow */jugador/batvspitch
Disallow */jugador/bio
Disallow */jugador/estadisticas
Disallow */jugador/gamelog
Disallow */jugador/hollinger
Disallow */jugador/juego-a-juego
Disallow */jugador/noticias
Disallow */jugador/partidos
Disallow */jugador/splits
Disallow */jugador/stats
Disallow */peleador/bio
Disallow */peleador/estadisticas
Disallow */peleador/historial
Disallow */peleador/noticias
Disallow /futbol/copamundial2010/
Disallow /members/v3_1/login
Disallow /insider/
Disallow /videohub/video/clip?id
Disallow /futbolint/noticias/
Disallow /futbolargentino/columnas/
Disallow /personalization/v3_1/personalization
Disallow /mundial2006/
Disallow /webslices/
Disallow */conversacion?
Disallow */conversacion/
Disallow */platform/
Disallow */sort/
Disallow */channels/*
Disallow */crossdomain/*
Disallow */makecorsrequest/*
Disallow */utils/*
Disallow */strategies/*
Disallow */child/*
Disallow */message/*
Disallow */units/*
Disallow */om-navmethod/*
Disallow */null
Disallow */null/*
Disallow */undefined
Disallow */undefined/*
Disallow */modifier/*
Disallow *%26ordenar%3D
Disallow */ordenar/
Disallow *%26split%3D
Disallow */split/
Disallow /*%26xhr%3D1
Disallow /*%26wsVar%3D*
Disallow /*%26_slug_%3D*
Disallow /*.com
Disallow /*.net
Disallow /*.org
Disallow /*.co.uk
Disallow */_/*/ano/
Disallow */platform/*
Disallow /*%26platform%3D
Disallow /*?platform=
Disallow /futbol/numeritos
Disallow /futbol/alineacion
Disallow /futbol/comentario
Disallow /futbol/video
Disallow /soccer/*
Disallow /*?*%3A%3A*
Allow */platform/amp*
Allow /*%26platform%3Damp
Allow /*?platform=amp

Other Records

Field Value
sitemap https://www.espn.co.cr/sitemap.xml

Comments

  • robots.txt for www.espn.co.cr

Warnings

  • 1 invalid line.