labaspasauli.lt
robots.txt

Robots Exclusion Standard data for labaspasauli.lt

Resource Scan

Scan Details

Site Domain labaspasauli.lt
Base Domain labaspasauli.lt
Scan Status Ok
Last Scan2025-10-11T02:13:52+00:00
Next Scan 2025-11-10T02:13:52+00:00

Last Scan

Scanned2025-10-11T02:13:52+00:00
URL https://labaspasauli.lt/robots.txt
Domain IPs 104.21.87.246, 172.67.171.135, 2606:4700:3035::ac43:ab87, 2606:4700:3036::6815:57f6
Response IP 104.21.87.246
Found Yes
Hash ae8fe1ea6f97889775e9bc255f80d8ffeadc68bcd217ad2b3bbd7dd4fe92be47
SimHash 2a0a8841abc6

Groups

amazonbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

Rule Path
Disallow /*.pdf
Disallow /paieska*
Disallow /login*
Disallow /password*
Disallow /isiminti*
Disallow /api/*
Disallow /prenumerata*

Other Records

Field Value
sitemap https://labaspasauli.lt/sitemaps