Log In Sign Up

finrepo.fi
robots.txt

Robots Exclusion Standard data for finrepo.fi

Resource Scan

Scan Details

Site Domain finrepo.fi
Base Domain finrepo.fi
Scan Status Ok
Last Scan2025-10-06T09:34:43+00:00
Next Scan 2025-10-13T09:34:43+00:00

Last Scan

Scanned2025-10-06T09:34:43+00:00
URL https://finrepo.fi/robots.txt
Domain IPs 104.21.21.171, 172.67.199.165, 2606:4700:3030::ac43:c7a5, 2606:4700:3036::6815:15ab
Response IP 104.21.21.171
Found Yes
Hash e546d94ecc389b90aa1e76a9a67a7eb9f6ed1e66adcb8d25bcd2e2a5e0e1f8bb
SimHash bc1cdd758552

Groups

ccbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /ru/slovar/*
Disallow /en/dictionary/*

*

Rule Path
Disallow /en/*.html
Disallow /ru/*.html
Disallow /out/
Back to top

Other Records

Field Value
sitemap https://finrepo.fi/sitemaps.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top