mbnet.fi
robots.txt
Robots Exclusion Standard data for mbnet.fi
Resource Scan
Scan Details
| Site Domain | mbnet.fi |
| Base Domain | mbnet.fi |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2025-04-13T18:34:15+00:00 |
| Next Scan | 2025-04-20T18:34:15+00:00 |
Last Successful Scan
| Scanned | 2025-03-28T18:32:58+00:00 |
| URL | http://mbnet.fi/robots.txt |
| Redirect | https://www.mikrobitti.fi/robots.txt |
| Redirect Domain | www.mikrobitti.fi |
| Redirect Base | mikrobitti.fi |
| Domain IPs | 52.218.108.156, 52.218.28.28, 52.218.30.196, 52.218.41.108, 52.218.97.124, 52.92.19.252, 52.92.2.172, 52.92.35.252 |
| Redirect IPs | 3.164.182.125, 3.164.182.70, 3.164.182.78, 3.164.182.96 |
| Response IP | 3.164.206.27 |
| Found | Yes |
| Hash | 60b727feaae44845605292dd7bc06a59d4eb7593272f1f78416fd6ae979a5941 |
| SimHash | 72165b41e0a2 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /haku |
| Disallow | /api/pages/v2/listingpage/search |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 10 | specifies a 10 second delay between crawls |
msnbot-media
| Rule | Path |
|---|---|
| Disallow | /haku |
| Disallow | /api/pages/v2/listingpage/search |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 5 | specifies a 5 second delay between crawls |
bingbot
| Rule | Path |
|---|---|
| Disallow | /haku |
| Disallow | /api/pages/v2/listingpage/search |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 5 | specifies a 5 second delay between crawls |
applebot
| Product | Comment |
|---|---|
| applebot | apple |
| Rule | Path |
|---|---|
| Disallow | /haku |
| Disallow | /api/pages/v2/listingpage/search |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 10 | specifies a 10 second delay between crawls |
*
| Rule | Path |
|---|---|
| Disallow | /haku |
| Disallow | /api/pages/v2/listingpage/search |
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 3 | specifies a 3 second delay between crawls |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mikrobitti.fi/sitemaps/sitemapindex.xml |