berria.eus
robots.txt
Robots Exclusion Standard data for berria.eus
Resource Scan
Scan Details
| Site Domain | berria.eus |
| Base Domain | berria.eus |
| Scan Status | Ok |
| Last Scan | 2024-09-16T04:32:16+00:00 |
| Next Scan | 2024-10-16T04:32:16+00:00 |
Last Scan
| Scanned | 2024-09-16T04:32:16+00:00 |
| URL | https://berria.eus/robots.txt |
| Redirect | https://www.berria.eus/robots.txt |
| Redirect Domain | www.berria.eus |
| Redirect Base | berria.eus |
| Domain IPs | 65.109.182.122 |
| Redirect IPs | 104.26.10.9, 104.26.11.9, 172.67.71.103, 2606:4700:20::681a:a09, 2606:4700:20::681a:b09, 2606:4700:20::ac43:4767 |
| Response IP | 104.26.10.9 |
| Found | Yes |
| Hash | 8ed51200b8d9a95dda0ccae50c13977850004a00222bd449d5991b02f5c3e8e0 |
| SimHash | 1540594439b2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /_call* |
| Disallow | /*breaking-news-es.json* |
| Disallow | /bilatzailea.html?* |
| Disallow | /buscador.html?* |
| Disallow | /cercador.html?* |
| Disallow | /liburuak.html?* |
| Disallow | /diskoak.html?* |
| Disallow | /buscador-recetas.html* |
| Disallow | /errezeta-bilaketa.html* |
| Disallow | /hilberriak.html?* |
| Disallow | /buscador-mendia.html?* |
| Disallow | /mendia-bilatzailea.html?* |
| Disallow | /revistas-por-categoria.html?* |
| Disallow | /buscador-agenda.html?* |
| Disallow | /agenda-bilatzea.html?* |