stars.glavred.info
robots.txt

Robots Exclusion Standard data for stars.glavred.info

Resource Scan

Scan Details

Site Domain stars.glavred.info
Base Domain glavred.info
Scan Status Ok
Last Scan2024-11-04T12:10:28+00:00
Next Scan 2024-12-04T12:10:28+00:00

Last Scan

Scanned2024-11-04T12:10:28+00:00
URL https://stars.glavred.info/robots.txt
Domain IPs 104.22.2.254, 104.22.3.254, 172.67.43.221
Response IP 104.22.3.254
Found Yes
Hash e5c3d65035ad3ca453017d3c5639e3d82018291b0a2bc298599008fe857c60ed
SimHash 5905c442f614

Groups

*

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.css
Allow *.png
Allow *.js
Disallow /cdn-cgi/
Disallow */search/
Disallow */ajax/
Disallow */content/
Disallow */profile/
Disallow */redirect/
Disallow *utm_source%3D*
Disallow *utm_medium%3D*
Disallow *utm_campaign%3D*
Disallow /?url=*
Disallow /*_sm_byp
Disallow /*CFID%3D*
Disallow /div_location%3D
Disallow /*?refresh
Disallow /?quot
Disallow /?_ga
Disallow /?desktop
Disallow /*?device_view
Disallow /*?*items=
Disallow /*?*type=
Disallow /*?*razd=

googlebot

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow */search/
Disallow */profile/

yandex

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Disallow */search/
Disallow */profile/

googlebot-image

Rule Path
Allow *.jpg
Allow *.gif
Allow *.svg
Allow *.png

googlebot-video

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js

yandexvideo

Rule Path
Allow /*.jpg
Allow /*.gif
Allow /*.svg
Allow /*.css
Allow /*.png
Allow /*.js
Allow /*?page=

Other Records

Field Value
sitemap https://stars.glavred.info/sitemap.xml
sitemap https://stars.glavred.info/sitemaps/sitemaps/sitemap.rubrics.all_rubrics.xml
sitemap https://stars.glavred.info/sitemap.last.news.xml
sitemap https://stars.glavred.info/sitemap_google.last.news.xml