eldestaperadio.com
robots.txt

Robots Exclusion Standard data for eldestaperadio.com

Resource Scan

Scan Details

Site Domain eldestaperadio.com
Base Domain eldestaperadio.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-17T07:51:21+00:00
Next Scan 2024-09-24T07:51:21+00:00

Last Successful Scan

Scanned2024-04-01T01:58:56+00:00
URL https://www.eldestaperadio.com/robots.txt
Domain IPs 104.21.71.253, 172.67.173.30, 2606:4700:3030::6815:47fd, 2606:4700:3031::ac43:ad1e
Response IP 104.21.71.253
Found Yes
Hash 4b5c5699e9c2cd01f5b3c1d0d7112d33c46e1684d59d4cb940efcf01bc57bf93
SimHash 3a4d1d690be3

Groups

*

Rule Path
Allow /
Disallow /buscar/
Disallow /feria/
Disallow /backend/
Disallow /_post/
Disallow /services/
Disallow /adjuntos/
Disallow /suscripcion/login
Disallow /suscripcion/login/*
Disallow /suscripcion/cuenta
Disallow /suscripcion/cerrar-sesion
Disallow /*.pdf$
Disallow /*?utm_*

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.eldestapeweb.com/sitemap-index.xml
sitemap https://www.eldestapeweb.com/sitemap.xml
sitemap https://www.eldestapeweb.com/sitemap-news.xml
sitemap https://www.eldestapeweb.com/sitemap-categories.xml
sitemap https://www.eldestapeweb.com/sitemap-authors.xml
sitemap https://www.eldestapeweb.com/sitemap-tags.xml
sitemap https://www.eldestapeweb.com/sitemap-videos.xml

Comments

  • robots.txt file for eldestapeweb.com
  • Last updated: 10/10/2023