technopolis.kg
robots.txt

Robots Exclusion Standard data for technopolis.kg

Resource Scan

Scan Details

Site Domain technopolis.kg
Base Domain technopolis.kg
Scan Status Ok
Last Scan2024-09-08T11:28:29+00:00
Next Scan 2024-10-08T11:28:29+00:00

Last Scan

Scanned2024-09-08T11:28:29+00:00
URL https://technopolis.kg/robots.txt
Domain IPs 176.126.165.67
Response IP 176.126.165.67
Found Yes
Hash 6843767b10c06ef74d50c61f82b0f2a00970e07d56c24f6944b0949042528631
SimHash 231c1d5a435d

Groups

*

Rule Path Comment
Disallow /administrator/ -
Disallow /bin/ -
Disallow /cache/ -
Disallow /cli/ -
Disallow /components/ -
Disallow /includes/ -
Disallow /installation/ -
Disallow /language/ -
Disallow /layouts/ -
Disallow /libraries/ -
Disallow /logs/ -
Disallow /media/ -
Disallow /modules/ -
Disallow /plugins/ -
Disallow /templates/ -
Disallow /tmp/ -
Disallow /index.php* -
Disallow /index2.php* -
Disallow /*com_mailto -
Disallow /*pop%3D -
Disallow /*format%3D -
Disallow /*print%3D -
Disallow /*user/ -
Disallow /index.php? -
Disallow /index2.php -
Disallow /index.php -
Disallow /*% -
Disallow /*%26 -
Disallow /*tag -
Disallow /*%3Datom RSS
Disallow /*%3Drss RSS
Allow /images/ -
Allow /templates/*.css -
Allow /templates/*.js -
Allow /*.js -
Allow /*.css -
Allow /*.jpg -
Allow /*.gif -
Allow /*.png -
Allow /components/com_jshopping/files/img_categories/ -
Allow /components/com_jshopping/files/img_products/ -
Allow /index.php?option=com_xmap&sitemap=1&view=xml -

Other Records

Field Value
crawl-delay 5

googlebot

Rule Path
Allow /index.php
Allow /index.php?option=com_xmap&view=xml&id=1

Other Records

Field Value
crawl-delay 5

googlebot image

Rule Path
Allow /index.php
Allow /index.php?option=com_xmap&view=xml&id=1

Other Records

Field Value
crawl-delay 5

yandex bot

Rule Path
Allow /index.php
Allow /index.php?option=com_xmap&view=xml&id=1

Other Records

Field Value
crawl-delay 5

yandex images

Rule Path
Allow /index.php
Allow /index.php?option=com_xmap&view=xml&id=1

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&images=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&news=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&images=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&news=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&images=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&news=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&images=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&news=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&images=1&id=1
sitemap https://technopolis.kg/ru/?option=com_xmap&view=xml&tmpl=component&news=1&id=1

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/orig.html
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.