artek.fi
robots.txt
Robots Exclusion Standard data for artek.fi
Resource Scan
Scan Details
| Site Domain | artek.fi |
| Base Domain | artek.fi |
| Scan Status | Ok |
| Last Scan | 2024-04-29T08:25:37+00:00 |
| Next Scan | 2024-05-29T08:25:37+00:00 |
Last Scan
| Scanned | 2024-04-29T08:25:37+00:00 |
| URL | https://artek.fi/robots.txt |
| Redirect | https://www.artek.fi/robots.txt |
| Redirect Domain | www.artek.fi |
| Redirect Base | artek.fi |
| Domain IPs | 116.203.84.209 |
| Redirect IPs | 108.156.133.44, 108.156.133.80, 108.156.133.86, 108.156.133.91 |
| Response IP | 108.156.133.86 |
| Found | Yes |
| Hash | c560f9d1800bec23c18d0124e8b2ac4be49a9e158d171cfed7479fa40522dbac |
| SimHash | 63155c51c891 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /en/404 |
| Disallow | /fi/404 |
| Disallow | en/newsletter-signup |
| Disallow | fi/newsletter-signup |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 500 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.artek.fi/sitemap.xml |