Log In Sign Up

aamulehti.fi
robots.txt

Robots Exclusion Standard data for aamulehti.fi

Resource Scan

Scan Details

Site Domain aamulehti.fi
Base Domain aamulehti.fi
Scan Status Ok
Last Scan2024-05-03T22:40:02+00:00
Next Scan 2024-05-10T22:40:02+00:00

Last Scan

Scanned2024-05-03T22:40:02+00:00
URL https://aamulehti.fi/robots.txt
Redirect https://www.aamulehti.fi/robots.txt
Redirect Domain www.aamulehti.fi
Redirect Base aamulehti.fi
Domain IPs 2600:9000:21f8:4000:18:4a14:12c0:93a1, 2600:9000:21f8:5000:18:4a14:12c0:93a1, 2600:9000:21f8:5600:18:4a14:12c0:93a1, 2600:9000:21f8:9200:18:4a14:12c0:93a1, 2600:9000:21f8:9e00:18:4a14:12c0:93a1, 2600:9000:21f8:a000:18:4a14:12c0:93a1, 2600:9000:21f8:c000:18:4a14:12c0:93a1, 2600:9000:21f8:d800:18:4a14:12c0:93a1, 54.230.21.29, 54.230.21.36, 54.230.21.38, 54.230.21.88
Redirect IPs 13.226.210.106, 13.226.210.20, 13.226.210.51, 13.226.210.61, 2600:9000:201d:1200:a:7475:1ec0:93a1, 2600:9000:201d:1c00:a:7475:1ec0:93a1, 2600:9000:201d:2a00:a:7475:1ec0:93a1, 2600:9000:201d:4e00:a:7475:1ec0:93a1, 2600:9000:201d:b400:a:7475:1ec0:93a1, 2600:9000:201d:be00:a:7475:1ec0:93a1, 2600:9000:201d:d400:a:7475:1ec0:93a1, 2600:9000:201d:d800:a:7475:1ec0:93a1
Response IP 18.165.171.106
Found Yes
Hash f7eb106004eb5646cee4ee4c0843b7b9f036e1fdcc27e1fecf4d2402eadd9700
SimHash 5b084a60e937

Groups

*

Rule Path
Disallow /promo/
Disallow /api/
Allow /api/paid-article/

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.aamulehti.fi/sitemap/html/al/sitemapindex.xml
sitemap https://www.aamulehti.fi/rss/custom/news-sitemap.xml
Back to top