15min.lt
robots.txt

Robots Exclusion Standard data for 15min.lt

Resource Scan

Scan Details

Site Domain 15min.lt
Base Domain 15min.lt
Scan Status Ok
Last Scan2024-09-25T16:58:06+00:00
Next Scan 2024-10-02T16:58:06+00:00

Last Scan

Scanned2024-09-25T16:58:06+00:00
URL https://15min.lt/robots.txt
Redirect https://www.15min.lt/robots.txt
Redirect Domain www.15min.lt
Redirect Base 15min.lt
Domain IPs 104.21.24.11, 172.67.215.72, 2606:4700:3033::6815:180b, 2606:4700:3037::ac43:d748
Redirect IPs 104.21.24.11, 172.67.215.72, 2606:4700:3033::6815:180b, 2606:4700:3037::ac43:d748
Response IP 104.21.24.11
Found Yes
Hash 1d1ad0956eeaafa4cce0fdfc2ad65d1ee69fd1bad0637b68b0b757e86614da0c
SimHash 8a1a9f2197b3

Groups

*

Rule Path
Disallow /sir/img.php
Disallow /*profilis
Disallow /*ajax/*

blexbot
meltwater

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.15min.lt/static/sitemaps/articles_live_index.xml
sitemap https://www.15min.lt/static/sitemaps/articles_index.xml