Log In Sign Up

topic.lt
robots.txt

Robots Exclusion Standard data for topic.lt

Resource Scan

Scan Details

Site Domain topic.lt
Base Domain topic.lt
Scan Status Ok
Last Scan2025-09-29T17:26:42+00:00
Next Scan 2025-10-06T17:26:42+00:00

Last Scan

Scanned2025-09-29T17:26:42+00:00
URL https://topic.lt/robots.txt
Redirect https://www.topic.lt/robots.txt
Redirect Domain www.topic.lt
Redirect Base topic.lt
Domain IPs 104.21.30.65, 172.67.172.53, 2606:4700:3032::ac43:ac35, 2606:4700:3035::6815:1e41
Redirect IPs 104.21.30.65, 172.67.172.53, 2606:4700:3032::ac43:ac35, 2606:4700:3035::6815:1e41
Response IP 104.21.30.65
Found Yes
Hash 51412ca44245f250cbd5fa89f866e1219794a46e865c2d01a6d0cd43ac05f59d
SimHash 7f4dc1d4a992

Groups

yandex

Rule Path
Disallow /movie
Disallow /soft
Disallow /*add*?*user
Disallow /film_ru/posters*

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /~
Disallow /film_ru/
Disallow /print%3A
Disallow /backup/
Disallow /engine/
Disallow /language/
Disallow /templates/
Disallow /print*
Disallow /*/print*
Disallow /*print
Disallow /user/
Disallow /admin/
Disallow /r/
Disallow /film_ru/posters*
Disallow /cgi
Disallow /gop.php
Disallow /index.php?do=pm
Disallow /index.php?do=stats
Disallow /index.php?do=search
Disallow /index.php?do=addnews
Disallow /index.php?do=register
Disallow /index.php?do=feedback
Disallow /index.php?do=lostpassword
Disallow /index.php?subaction=newposts

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap http://www.topic.lt/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top