mtbiker.si
robots.txt
Robots Exclusion Standard data for mtbiker.si
Resource Scan
Scan Details
| Site Domain | mtbiker.si |
| Base Domain | mtbiker.si |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-12-06T09:19:10+00:00 |
| Next Scan | 2026-02-04T09:19:10+00:00 |
Last Successful Scan
| Scanned | 2025-09-16T14:38:35+00:00 |
| URL | https://mtbiker.si/robots.txt |
| Redirect | https://www.mtbiker.si/robots.txt |
| Redirect Domain | www.mtbiker.si |
| Redirect Base | mtbiker.si |
| Domain IPs | 104.21.41.136, 172.67.147.128, 2606:4700:3032::6815:2988, 2606:4700:3033::ac43:9380 |
| Redirect IPs | 104.21.41.136, 172.67.147.128, 2606:4700:3032::6815:2988, 2606:4700:3033::ac43:9380 |
| Response IP | 104.21.41.136 |
| Found | Yes |
| Hash | af99127728863f6e871ade48ed056b77b8798bffa26ab3c24447819f973b76c3 |
| SimHash | 61108e655c91 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /data/sitemap |
| Disallow | /ajax |
| Disallow | /api |
| Disallow | /external-click/ |
| Disallow | /data |
| Disallow | /forum |
| Disallow | /komunita |
| Disallow | /vyjazdy |
| Disallow | /foto |
| Disallow | /kalendar |
| Disallow | /cyklotrasy |
| Disallow | /rebricky |
| Disallow | /clanky |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mtbiker.si/data/sitemap/sitemap-index-si.xml |