Log In Sign Up

forum.ee
robots.txt

Robots Exclusion Standard data for forum.ee

Resource Scan

Scan Details

Site Domain forum.ee
Base Domain forum.ee
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-22T03:31:40+00:00
Next Scan 2024-10-06T03:31:40+00:00

Last Successful Scan

Scanned2024-09-07T03:31:12+00:00
URL https://forum.ee/robots.txt
Domain IPs 104.21.42.137, 172.67.206.28, 2606:4700:3030::6815:2a89, 2606:4700:3035::ac43:ce1c
Response IP 172.67.206.28
Found Yes
Hash ce563d7d71967494eda773b9621b12b92aebda5ea0865d768e50fe48aef8c15b
SimHash 4271b9800019

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

googlebot

Rule Path
Disallow /last-articles/
Disallow /public-articles/
Disallow /new-articles/
Disallow /new-notes/

*

Rule Path
Disallow /468x60bottom.php
Disallow /100x100.php
Disallow /uploads/
Disallow /admin/
Disallow /vadmin/
Disallow /cache/
Disallow /images/
Disallow /converge_local/
Disallow /hooks/
Disallow /ips_kernel/
Disallow /retail/
Disallow /public/js/
Disallow /public/style_captcha/
Disallow /public/style_css/
Disallow /index.php?app=core&module=task
Disallow /index.php?app=forums&module=moderate&section=moderate
Disallow /index.php?app=core&module=usercp&tab=forums&area=forumsubs
Disallow /index.php?app=core&module=usercp&tab=forums&area=watch&watch=topic
Disallow /index.php?app=forums&module=extras&section=forward
Disallow /index.php?app=members&module=messaging
Disallow /index.php?app=members&module=chat
Disallow /index.php?app=members&module=search
Disallow /index.php?app=members&module=search&do=active
Disallow /index.php?app=members&module=search&do=user_activity
Disallow /index.php?app=core&module=global&section=comments
Disallow /index.php?&unlockUserAgent=1
Disallow /index.php?app=core&module=attach
Disallow /*%26module%3Dsearch
Allow /*%26search_tags%3D
Disallow /*app%3Dcore%26module%3Dglobal%26section%3Dreputation
Disallow /*app%3Dcore%26module%3Dusercp
Disallow /*app%3Dcore%26amp%3Bmodule%3Dusercp
Disallow /*app%3Dmembers%26module%3Dmessaging
Disallow /*%26p%3D
Disallow /*%26pid%3D
Disallow /*%26hl%3D
Disallow /*%26start%3D
Disallow /*view__getnewpost$
Disallow /*view__getlastpost$
Disallow /*view__old$
Disallow /*view__new$
Disallow /*view__getfirst$
Disallow /*view__getprevious$
Disallow /*view__getnext$
Disallow /*view__getlast$
Disallow /*%26view%3Dgetnewpost$
Disallow /*%26view%3Dgetlastpost$
Disallow /*%26view%3Dold$
Disallow /*%26view%3Dnew$
Disallow /*%26view%3Dgetfirst$
Disallow /*%26view%3Dgetprevious$
Disallow /*%26view%3Dgetnext$
Disallow /*%26view%3Dgetlast$
Disallow /*?s=
Disallow /*%26s%3D
Disallow /*%26unlockUserAgent%3D1
Disallow /index.php?app=forums&module=extras&section=stats&do=who&t=
Disallow /index.php?app=forums&module=forums&section=attach&tid=
Disallow /index.php?app=core&module=attach&section=attach&attach_id=
Disallow /index.php?app=core&module=global&section=login&do=deleteCookies
Disallow /index.php?app=forums&module=extras&section=rating
Disallow /index.php?app=forums&module=forums&section=markasread
Disallow /*%26do%3Dwho
Disallow /*%26section%3Ddname
Disallow /index.php?app=forums&module=post&section=post&do=reply_post&f=
Disallow /index.php?app=forums&module=ajax&section=topics&do=rateTopic
Disallow /index.php?app=classifieds&module=listing
Disallow /style_images/
Disallow /style_emoticons/
Disallow /style_avatars/
Disallow /chat/
Disallow /index.php?sharelink=download
Back to top

Other Records

Field Value
sitemap https://forum.ee/sitemap.xml
Back to top

Warnings

  • `host` is not a known field.
Back to top