Log In Sign Up

merikarvialehti.fi
robots.txt

Robots Exclusion Standard data for merikarvialehti.fi

Resource Scan

Scan Details

Site Domain merikarvialehti.fi
Base Domain merikarvialehti.fi
Scan Status Ok
Last Scan2024-06-19T09:38:22+00:00
Next Scan 2024-06-26T09:38:22+00:00

Last Scan

Scanned2024-06-19T09:38:22+00:00
URL https://merikarvialehti.fi/robots.txt
Redirect https://www.merikarvialehti.fi/robots.txt
Redirect Domain www.merikarvialehti.fi
Redirect Base merikarvialehti.fi
Domain IPs 13.226.2.4, 13.226.2.50, 13.226.2.78, 13.226.2.93, 2600:9000:24ec:4200:18:4a14:12c0:93a1, 2600:9000:24ec:4800:18:4a14:12c0:93a1, 2600:9000:24ec:5c00:18:4a14:12c0:93a1, 2600:9000:24ec:6a00:18:4a14:12c0:93a1, 2600:9000:24ec:6e00:18:4a14:12c0:93a1, 2600:9000:24ec:7400:18:4a14:12c0:93a1, 2600:9000:24ec:b000:18:4a14:12c0:93a1, 2600:9000:24ec:ee00:18:4a14:12c0:93a1
Redirect IPs 13.226.228.10, 13.226.228.116, 13.226.228.123, 13.226.228.30, 2600:9000:2146:1600:17:4f1e:bec0:93a1, 2600:9000:2146:2600:17:4f1e:bec0:93a1, 2600:9000:2146:4000:17:4f1e:bec0:93a1, 2600:9000:2146:9400:17:4f1e:bec0:93a1, 2600:9000:2146:9600:17:4f1e:bec0:93a1, 2600:9000:2146:d200:17:4f1e:bec0:93a1, 2600:9000:2146:e600:17:4f1e:bec0:93a1, 2600:9000:2146:f800:17:4f1e:bec0:93a1
Response IP 18.165.171.93
Found Yes
Hash 7ba9c2c0611f8249dae69df9390036919d92c163ef23a4347269ae82c8acdcc9
SimHash 410cca42c533

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Disallow /public-transit-screen/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.merikarvialehti.fi/sitemap/html/mk/sitemapindex.xml
sitemap https://www.merikarvialehti.fi/rss/custom/news-sitemap.xml
Back to top