psu.by
robots.txt

Robots Exclusion Standard data for psu.by

Resource Scan

Scan Details

Site Domain psu.by
Base Domain psu.by
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-08-15T17:56:00+00:00
Next Scan 2025-11-13T17:56:00+00:00

Last Successful Scan

Scanned2024-06-29T12:46:47+00:00
URL https://psu.by/robots.txt
Redirect https://www.psu.by:443/robots.txt
Redirect Domain www.psu.by
Redirect Base psu.by
Domain IPs 195.50.11.22, 2a00:c827:6:3:1c00:5aff:fe00:95
Redirect IPs 195.50.11.22, 2a00:c827:6:3:1c00:5aff:fe00:95
Response IP 195.50.11.22
Found Yes
Hash 87fd0f77f0992f3ce3b7f77f5c815496d6fa0f9915bf965091be238eba85cd59
SimHash 4a0f2d53cdc0

Groups

yandex

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /tmp/
Disallow /*?tmpl=component
Disallow /*?start=*
Disallow /*lang%3Dru
Disallow /*format%3D
Disallow /*print%3D
Disallow /xmlrpc/
Allow /images/
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Allow /*.webp*
Allow /media/*.png$
Allow /media/*.gif$
Allow /media/*.jpg$
Allow /media/*.jpeg$
Allow /media/*.ttf$
Allow /media/*.eot$
Allow /media/*.svg$
Allow /media/*.woff$

googlebot

Rule Path
Disallow /administrator/
Disallow /cache/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /tmp/
Disallow /*?tmpl=component
Disallow /*?start=*
Disallow /*lang%3Dru
Disallow /*format%3D
Disallow /*print%3D
Disallow /xmlrpc/
Allow /images/
Allow /*.css
Allow /*.js
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Allow /*.webp*
Allow /media/*.png$
Allow /media/*.gif$
Allow /media/*.jpg$
Allow /media/*.jpeg$
Allow /media/*.ttf$
Allow /media/*.eot$
Allow /media/*.svg$
Allow /media/*.woff$

*

Rule Path
Allow /*.js*
Allow /*.css*
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Disallow /administrator/
Disallow /api/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /component/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /tmp/
Disallow /*?tmpl=component
Disallow /*?start=*
Disallow /*lang%3Dru
Disallow /*format%3D
Disallow /*print%3D
Disallow /xmlrpc/
Allow /images/
Allow /*.png*
Allow /*.jpg*
Allow /*.gif*
Allow /*.webp*
Allow /media/*.png$
Allow /media/*.gif$
Allow /media/*.jpg$
Allow /media/*.jpeg$
Allow /media/*.ttf$
Allow /media/*.eot$
Allow /media/*.svg$
Allow /media/*.woff$

Other Records

Field Value
sitemap https://www.psu.by/ru/component/jmap/sitemap/xml
sitemap https://www.psu.by/en/component/jmap/sitemap/xml
sitemap https://www.psu.by/be/component/jmap/sitemap/xml
sitemap https://www.psu.by/ch/component/jmap/sitemap/xml

Comments

  • If the Joomla site is installed within a folder
  • eg www.example.com/joomla/ then the robots.txt file
  • MUST be moved to the site root
  • eg www.example.com/robots.txt
  • AND the joomla folder name MUST be prefixed to all of the
  • paths.
  • eg the Disallow rule for the /administrator/ folder MUST
  • be changed to read
  • Disallow: /joomla/administrator/
  • For more information about the robots.txt standard, see:
  • https://www.robotstxt.org/orig.html

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.