bergfreunde.fi
robots.txt
Robots Exclusion Standard data for bergfreunde.fi
Resource Scan
Scan Details
| Site Domain | bergfreunde.fi |
| Base Domain | bergfreunde.fi |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-08T04:17:37+00:00 |
| Next Scan | 2024-10-06T04:17:37+00:00 |
Last Successful Scan
| Scanned | 2023-08-16T20:10:03+00:00 |
| URL | https://bergfreunde.fi/robots.txt |
| Redirect | https://www.bergfreunde.fi:443/robots.txt |
| Redirect Domain | www.bergfreunde.fi |
| Redirect Base | bergfreunde.fi |
| Domain IPs | 34.111.216.220 |
| Redirect IPs | 96.17.96.13, 96.17.96.24 |
| Response IP | 23.59.168.107 |
| Found | Yes |
| Hash | b94809d577f64a76d88b3bbdb9aed70b258268a84f26c0a3604eccf13b07a163 |
| SimHash | e9899714f5b1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/arviointi-- |
| Disallow | /*/vaeri-- |
| Disallow | /*/koko-- |
| Disallow | /*?cl= |
| Disallow | /*?bfc- |
| Disallow | /*?streamfilter |
| Disallow | /*?listorderby |
| Disallow | /*?_artperpage |
| Disallow | /*?rev |
| Disallow | /*?plain=true |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bergfreunde.fi/sitemap/sitemap.xml.gz |