comitet.su
robots.txt

Robots Exclusion Standard data for comitet.su

Resource Scan

Scan Details

Site Domain comitet.su
Base Domain comitet.su
Scan Status Ok
Last Scan2025-05-09T05:43:36+00:00
Next Scan 2025-06-08T05:43:36+00:00

Last Scan

Scanned2025-05-09T05:43:36+00:00
URL https://comitet.su/robots.txt
Domain IPs 82.202.172.231
Response IP 82.202.172.231
Found Yes
Hash 3a3ba4b8a3721752144f546718b07f5df21249296d418f13b4836631eab25cc7
SimHash 9a1e951bcaa0

Groups

amazonbot

Rule Path
Disallow /

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /cache/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Disallow /ie6/
Disallow /xmlrpc/
Disallow /component/content/
Disallow /component/content/article/
Disallow /component/search/
Disallow /component/ondate/
Disallow /component/mailto/
Disallow /component/blog_calendar/
Disallow /attention/2010/
Disallow /attention/2011/
Disallow /home/2010/
Disallow /home/2011/
Disallow /last-news/2010/
Disallow /last-news/2011/
Disallow /new/2010/
Disallow /new/2011/
Disallow /official/2010/
Disallow /official/2011/
Disallow /officially/2010/
Disallow /officially/2011/
Disallow /quote/2010/
Disallow /quote/2011/
Disallow /quote/45--farion/2010/
Disallow /quote/45--farion/2011/
Disallow /quote/53/2010/
Disallow /quote/55/2011/
Disallow /short-news/2010/
Disallow /short-news/2011/
Disallow /time-line/2010/
Disallow /time-line/2011/
Disallow /top/
Disallow /calendar/
Disallow /calendar.html
Disallow /yasite.html
Disallow /*component/content/
Disallow /*start%3D
Disallow /*searchword%3D
Disallow /search-archive.html
Disallow /*?option=
Disallow /*search-archive
Disallow /*searchword%3D
Disallow /*option%3D
Disallow /*?id=
Disallow /*.raw$
Disallow /*limit%3D
Disallow /tag/
Disallow /*com_content
Disallow /*limitstart%3D
Disallow /*print%3D
Disallow /*?app_id=1
Disallow /*%3Dcomponent%26print
Disallow /*%3Dblogcalendar
Disallow /*tmpl%3D
Disallow /*?tmpl=
Disallow /*view%3D
Disallow /*month%3D
Disallow /*year%3D
Disallow /*start%3D
Disallow /*ctranitsa-
Disallow /component/jcomments/feed/com_content/
Disallow /*?start=
Disallow /*?layout=
Disallow /*?func=
Disallow /*?aklazy=
Disallow *task%3Dcallelement
Disallow /component/search/?Itemid
Disallow /category/expert/
Disallow /authors/
Disallow /component/users/
Disallow /calendar/
Disallow /calendar.html
Disallow /yasite.html
Disallow /*component/content/
Disallow /*start%3D
Disallow /*page%3D
Disallow /*category_id%3D
Disallow /*catid%3D
Disallow /*id%3D
Disallow /*jat3action%3D
Disallow /*jatype%3D
Disallow /*jafile%3D
Disallow /*type%3D
Disallow /*from%3D
Disallow /*a%3D
Disallow /*refresh
Disallow /*ym_debug%3D
Disallow /*ref%3D
Disallow /*comitet%3D
Disallow /*utm%3D
Disallow /*stat-id%3D
Disallow /*format-type%3D
Disallow /*feed%3D
Disallow /*utm_compaign%3D
Disallow /*value%3D
Disallow /*searchword%3D
Disallow /search-archive.html
Disallow /*?option=
Disallow /*search-archive
Disallow /*searchword%3D
Disallow /*option%3D
Disallow /*?id=
Disallow /*.raw$
Disallow /*limit%3D
Disallow /*com_content
Disallow /*limitstart%3D
Disallow /*print%3D
Disallow /*%3Dcomponent%26print
Disallow /*%3Dblogcalendar
Disallow /*tmpl%3D
Disallow /*?tmpl=
Disallow /*view%3D
Disallow /*month%3D
Disallow /*year%3D
Disallow /*start%3D
Disallow /*page%3D
Disallow /*category_id%3D
Disallow /*catid%3D
Disallow /*id%3D
Disallow /*jat3action%3D
Disallow /*jatype%3D
Disallow /*jafile%3D
Disallow /*type%3D
Disallow /*from%3D
Disallow /*a%3D
Disallow /*refresh
Disallow /*ym_debug%3D
Disallow /*ref%3D
Disallow /*comitet%3D
Disallow /*utm%3D
Disallow /*stat-id%3D
Disallow /*format-type%3D
Disallow /*feed%3D
Disallow /*utm_compaign%3D
Disallow /*value%3D
Disallow /*ctranitsa-
Disallow /component/jcomments/feed/com_content/
Disallow /*?start=
Disallow /*?layout=
Disallow /*?func=
Disallow /*?aklazy=
Disallow *task%3Dcallelement
Disallow /component/search/?Itemid
Disallow *sort%3D
Disallow *view%3D
Disallow *utm%3D
Disallow /*?nc
Disallow /*%26
Disallow /*_
Disallow /*%3D
Disallow /*%
Disallow /*?=
Disallow /*ex.php
Disallow /home
Disallow /component/zoo/category/

googlebot

Rule Path
Disallow /administrator/
Disallow /cli/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Disallow /ie6/
Disallow /xmlrpc/
Disallow /tag/
Disallow /*?app_id=1
Disallow /authors/
Disallow /category/expert/
Disallow /component/content/
Disallow /component/content/article/
Disallow /component/search/
Disallow /component/ondate/
Disallow /component/mailto/
Disallow /component/blog_calendar/
Disallow /attention/2010/
Disallow /attention/2011/
Disallow /home/2010/
Disallow /home/2011/
Disallow /last-news/2010/
Disallow /last-news/2011/
Disallow /new/2010/
Disallow /new/2011/
Disallow /official/2010/
Disallow /official/2011/
Disallow /officially/2010/
Disallow /officially/2011/
Disallow /component/users/
Disallow /quote/2010/
Disallow /quote/2011/
Disallow /quote/45--farion/2010/
Disallow /quote/45--farion/2011/
Disallow /quote/53/2010/
Disallow /quote/55/2011/
Disallow /short-news/2010/
Disallow /short-news/2011/
Disallow /time-line/2010/
Disallow /time-line/2011/
Disallow /top/
Disallow /calendar/
Disallow /calendar.html
Disallow /yasite.html
Disallow /*component/content/
Disallow /*start%3D
Disallow /*searchword%3D
Disallow /search-archive.html
Disallow /*?option=
Disallow /*search-archive
Disallow /*searchword%3D
Disallow /*option%3D
Disallow /*?id=
Disallow /*.raw$
Disallow /*limit%3D
Disallow /*com_content
Disallow /*limitstart%3D
Disallow /*print%3D
Disallow /*%3Dcomponent%26print
Disallow /*%3Dblogcalendar
Disallow /*tmpl%3D
Disallow /*?tmpl=
Disallow /*view%3D
Disallow /*month%3D
Disallow /*year%3D
Disallow /*start%3D
Disallow /*ctranitsa-
Disallow /component/jcomments/feed/com_content/
Disallow /*?start=
Disallow /*?layout=
Disallow /*?func=
Disallow /*?aklazy=
Disallow *task%3Dcallelement
Disallow /calendar/
Disallow /calendar.html
Disallow /yasite.html
Disallow /*component/content/
Disallow /*start%3D
Disallow /*page%3D
Disallow /*category_id%3D
Disallow /*catid%3D
Disallow /*id%3D
Disallow /*jat3action%3D
Disallow /*jatype%3D
Disallow /*jafile%3D
Disallow /*type%3D
Disallow /*from%3D
Disallow /*a%3D
Disallow /*refresh
Disallow /*ym_debug%3D
Disallow /*ref%3D
Disallow /*comitet%3D
Disallow /*utm%3D
Disallow /*stat-id%3D
Disallow /*format-type%3D
Disallow /*feed%3D
Disallow /*utm_compaign%3D
Disallow /*value%3D
Disallow /*searchword%3D
Disallow /search-archive.html
Disallow /*?option=
Disallow /*search-archive
Disallow /*searchword%3D
Disallow /*option%3D
Disallow /*?id=
Disallow /*.raw$
Disallow /*limit%3D
Disallow /*com_content
Disallow /*limitstart%3D
Disallow /*print%3D
Disallow /*%3Dcomponent%26print
Disallow /*%3Dblogcalendar
Disallow /*tmpl%3D
Disallow /*?tmpl=
Disallow /*view%3D
Disallow /*month%3D
Disallow /*year%3D
Disallow /*start%3D
Disallow /*page%3D
Disallow /*category_id%3D
Disallow /*catid%3D
Disallow /*id%3D
Disallow /*jat3action%3D
Disallow /*jatype%3D
Disallow /*jafile%3D
Disallow /*type%3D
Disallow /*from%3D
Disallow /*a%3D
Disallow /*refresh
Disallow /*ym_debug%3D
Disallow /*ref%3D
Disallow /*comitet%3D
Disallow /*utm%3D
Disallow /*stat-id%3D
Disallow /*format-type%3D
Disallow /*feed%3D
Disallow /*utm_compaign%3D
Disallow /*value%3D
Disallow /*ctranitsa-
Disallow /component/jcomments/feed/com_content/
Disallow /*?start=
Disallow /*?layout=
Disallow /*?func=
Disallow /*?aklazy=
Disallow *task%3Dcallelement
Disallow /component/search/?Itemid
Disallow *sort%3D
Disallow *view%3D
Disallow *utm%3D
Disallow /*?nc
Disallow /*%26
Disallow /*_
Disallow /*%3D
Disallow /*%
Disallow /*?=
Disallow /*ex.php
Disallow /home
Disallow /component/zoo/category/
Disallow /component/search/?Itemid

dataforseobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

Other Records

Field Value
sitemap http://comitet.su/sitemapindex_xml.xml
sitemap http://comitet.su/sitemap.xml
sitemap http://comitet.su/index.php?option=com_jmap&view=sitemap&format=xml

Comments

  • If the Joomla site is installed within a folder such as at
  • e.g. www.example.com/joomla/ the robots.txt file MUST be
  • moved to the site root at e.g. www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to the disallowed
  • path, e.g. the Disallow rule for the /administrator/ folder
  • MUST be changed to read Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://www.sxw.org.uk/computing/robots/check.html
  • JSitemap entries

Warnings

  • 2 invalid lines.