laliga.com
robots.txt

Robots Exclusion Standard data for laliga.com

Resource Scan

Scan Details

Site Domain laliga.com
Base Domain laliga.com
Scan Status Ok
Last Scan2024-09-21T07:48:44+00:00
Next Scan 2024-09-28T07:48:44+00:00

Last Scan

Scanned2024-09-21T07:48:44+00:00
URL https://laliga.com/robots.txt
Redirect https://www.laliga.com/robots.txt
Redirect Domain www.laliga.com
Redirect Base laliga.com
Domain IPs 104.45.66.65
Redirect IPs 152.199.39.108, 2606:2800:247:1cb7:261b:1f9c:2074:3c
Response IP 152.199.39.108
Found Yes
Hash 90e70aea5d2690e4c3954e9fca79e02b024431b7d210310c97947bb323dab362
SimHash 6321dcd7489b

Groups

*

Rule Path
Allow /es-AR/
Allow /en-AR/
Allow /es-BR/
Allow /en-BR/
Allow /es-CA/
Allow /en-CA/
Allow /es-CO/
Allow /en-CO/
Allow /es-DE/
Allow /en-DE/
Allow /es-EG/
Allow /en-EG/
Allow /en-ES/
Allow /es-FR/
Allow /en-FR/
Allow /es-GB/
Allow /en-GB/
Allow /es-ID/
Allow /en-ID/
Allow /es-IN/
Allow /en-IN/
Allow /es-MA/
Allow /en-MA/
Allow /es-MX/
Allow /en-MX/
Allow /es-NG/
Allow /en-NG/
Allow /es-NL/
Allow /en-NL/
Allow /es-PE/
Allow /en-PE/
Allow /es-US/
Allow /en-US/
Disallow /en-*/*
Disallow /es-*/*
Allow /
Allow /sitemap.xml
Allow /noticias/*
Allow /partido/*
Allow /jugador/*
Allow /clubes/*
Allow /laliga-santander/*
Allow /laliga-smartbank/*
Allow /futbol-femenino/*
Allow /laliga-genuine-santander/*
Allow /laligatv/*
Allow /estadisticas
Allow /estadisticas-avanzadas
Allow /leaderboard
Allow /multimedia/*
Allow /transparencia/*
Allow /laliga/*
Allow /fundacion/*
Allow /embajadores/*
Allow /derechos-audiovisuales/*
Allow /otras-competiciones/*
Allow /operadores/*
Allow /apps/*
Allow /mapa-web
Allow /*.php$
Allow /*.js$
Allow /*.inc$
Allow /*.css$
Allow /*.xhtml$
Allow /*.gif$
Allow /*.png$
Allow /*.jpeg$
Allow /*.jpg$
Allow /*.ico$
Disallow *.pdf$

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.laliga.com/sitemap.xml

Comments

  • Allows Robots all user agents
  • disallow all files with? in url
  • Disallow: /*?*
  • Disallow: /*?
  • Tiempo en segundos entre dos solicitudes
  • disallow pdf