mtbiker.si
robots.txt

Robots Exclusion Standard data for mtbiker.si

Resource Scan

Scan Details

Site Domain mtbiker.si
Base Domain mtbiker.si
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-06T09:19:10+00:00
Next Scan 2026-02-04T09:19:10+00:00

Last Successful Scan

Scanned2025-09-16T14:38:35+00:00
URL https://mtbiker.si/robots.txt
Redirect https://www.mtbiker.si/robots.txt
Redirect Domain www.mtbiker.si
Redirect Base mtbiker.si
Domain IPs 104.21.41.136, 172.67.147.128, 2606:4700:3032::6815:2988, 2606:4700:3033::ac43:9380
Redirect IPs 104.21.41.136, 172.67.147.128, 2606:4700:3032::6815:2988, 2606:4700:3033::ac43:9380
Response IP 104.21.41.136
Found Yes
Hash af99127728863f6e871ade48ed056b77b8798bffa26ab3c24447819f973b76c3
SimHash 61108e655c91

Groups

*

Rule Path
Allow /data/sitemap
Disallow /ajax
Disallow /api
Disallow /external-click/
Disallow /data
Disallow /forum
Disallow /komunita
Disallow /vyjazdy
Disallow /foto
Disallow /kalendar
Disallow /cyklotrasy
Disallow /rebricky
Disallow /clanky

Other Records

Field Value
sitemap https://www.mtbiker.si/data/sitemap/sitemap-index-si.xml