finder.fi
robots.txt

Robots Exclusion Standard data for finder.fi

Resource Scan

Scan Details

Site Domain finder.fi
Base Domain finder.fi
Scan Status Ok
Last Scan2024-09-20T04:11:00+00:00
Next Scan 2024-09-27T04:11:00+00:00

Last Scan

Scanned2024-09-20T04:11:00+00:00
URL https://finder.fi/robots.txt
Redirect https://www.finder.fi/robots.txt
Redirect Domain www.finder.fi
Redirect Base finder.fi
Domain IPs 108.157.254.102, 108.157.254.124, 108.157.254.25, 108.157.254.28
Redirect IPs 108.157.254.102, 108.157.254.124, 108.157.254.25, 108.157.254.28
Response IP 108.157.254.25
Found Yes
Hash e616e5a27bd0b553bc380990e9fb6221f0a1588931e59bbf7b2e1901ac5f2138
SimHash 58081c73ceb1

Groups

*

Rule Path
Allow /

semrushbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 20

siteauditbot

Rule Path
Allow /

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.finder.fi/sitemap.xml