yle.fi
robots.txt
Robots Exclusion Standard data for yle.fi
Resource Scan
Scan Details
| Site Domain | yle.fi |
| Base Domain | yle.fi |
| Scan Status | Ok |
| Last Scan | 2024-05-07T07:59:42+00:00 |
| Next Scan | 2024-05-21T07:59:42+00:00 |
Last Scan
| Scanned | 2024-05-07T07:59:42+00:00 |
| URL | https://yle.fi/robots.txt |
| Domain IPs | 18.172.170.106, 18.172.170.114, 18.172.170.29, 18.172.170.62, 2600:9000:25f0:1800:1c:3b99:c0c0:93a1, 2600:9000:25f0:4000:1c:3b99:c0c0:93a1, 2600:9000:25f0:4200:1c:3b99:c0c0:93a1, 2600:9000:25f0:4a00:1c:3b99:c0c0:93a1, 2600:9000:25f0:6800:1c:3b99:c0c0:93a1, 2600:9000:25f0:9600:1c:3b99:c0c0:93a1, 2600:9000:25f0:a800:1c:3b99:c0c0:93a1, 2600:9000:25f0:c400:1c:3b99:c0c0:93a1 |
| Response IP | 18.165.171.6 |
| Found | Yes |
| Hash | 804f520491441951049fb82187bb44273af4786e4d95a12c00d3ce6cb9430031 |
| SimHash | b8635c54c053 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ylefiroot-errors |
| Disallow | /cgi-bin |
| Disallow | /klaffi |
| Disallow | /java |
| Disallow | /player |
| Disallow | /errorsivut/ |
| Disallow | /global/ |
| Disallow | /haku/ |
| Disallow | /eurovision/ |
| Disallow | /embed/ |
| Allow | /global/api/load.php |
| Allow | /cgi-bin/tekstitv/ttv.cgi/ |
| Disallow | /aihe/flag/ |
| Disallow | /aihe/ajax_comments/ |
| Disallow | /aihe/comment/reply/ |
| Disallow | /karttasovellus/ |
Comments