mitele.es
robots.txt

Robots Exclusion Standard data for mitele.es

Resource Scan

Scan Details

Site Domain mitele.es
Base Domain mitele.es
Scan Status Ok
Last Scan2024-05-25T03:56:35+00:00
Next Scan 2024-06-01T03:56:35+00:00

Last Scan

Scanned2024-05-25T03:56:35+00:00
URL https://mitele.es/robots.txt
Redirect https://www.mitele.es/robots.txt
Redirect Domain www.mitele.es
Redirect Base mitele.es
Domain IPs 184.87.134.66
Redirect IPs 23.199.133.69
Response IP 23.41.64.73
Found Yes
Hash 03aecc058b9f887009658ba48b84d5263763372f060677a52511b88f88034acc
SimHash aa0ad8108677

Groups

*

Rule Path
Disallow /api/cms/
Disallow /api/boards/
Disallow /mdswebservice/
Disallow /mdsvideo/
Disallow /mdsads/
Disallow /stats.html
Disallow /api/boards
Disallow /tags/*?text=*
Disallow /autores/*?text=*
Disallow /personajes/*?text=*

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow *.shtml

yaanibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mitele.es/sitemap_index.xml