telecinco.es
robots.txt

Robots Exclusion Standard data for telecinco.es

Resource Scan

Scan Details

Site Domain telecinco.es
Base Domain telecinco.es
Scan Status Ok
Last Scan2024-11-01T11:22:57+00:00
Next Scan 2024-11-08T11:22:57+00:00

Last Scan

Scanned2024-11-01T11:22:57+00:00
URL https://telecinco.es/robots.txt
Redirect https://www.telecinco.es/robots.txt
Redirect Domain www.telecinco.es
Redirect Base telecinco.es
Domain IPs 173.222.147.215
Redirect IPs 173.222.147.215
Response IP 104.69.38.81
Found Yes
Hash c2ad8e22bb28fa8f92a297c610d486e38b7af2ea7531a1c7f2993ac18a81ec99
SimHash 0a06d8040177

Groups

*

Rule Path
Disallow /buscador/*?text=*
Disallow /api/cms/
Disallow /mdswebservice/
Disallow /mdsvideo/
Disallow /mdsads/
Disallow /stats.html
Disallow /api/boards
Disallow /tags/*?text=*
Disallow /autores/*?text=*
Disallow /personajes/*?text=*
Disallow /20e/
Disallow /20n/
Disallow /20o/
Disallow /20p/
Disallow /20r/
Disallow /20s/
Disallow /20v/

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow *.shtml

yaanibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.telecinco.es/sitemap_index.xml
sitemap https://www.telecinco.es/sitemap_ampstories.xml
sitemap https://www.telecinco.es/sitemap_google_news.xml