sris.edu.kg
robots.txt

Robots Exclusion Standard data for sris.edu.kg

Resource Scan

Scan Details

Site Domain sris.edu.kg
Base Domain sris.edu.kg
Scan Status Ok
Last Scan2025-08-07T19:55:59+00:00
Next Scan 2025-08-14T19:55:59+00:00

Last Scan

Scanned2025-08-07T19:55:59+00:00
URL https://sris.edu.kg/robots.txt
Domain IPs 176.126.165.31
Response IP 176.126.165.31
Found Yes
Hash a65dfd699802bb5dd7442eaceb0b7df42700153fbb42cadff246c9bc95951686
SimHash 7301d4c0b69b

Groups

googlebot
bingbot
msnbot
duckduckbot
qwantify
applebot

Rule Path
Disallow /static/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /search/
Disallow /en/search/
Disallow /ru/search/
Disallow /ky/search/
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/load-scripts.php
Allow /wp-admin/load-styles.php

Other Records

Field Value
crawl-delay 6

yandex

Rule Path
Disallow /static/
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /search/
Disallow /en/search/
Disallow /ru/search/
Disallow /ky/search/
Disallow /2020/
Disallow /2021/
Disallow /category/
Disallow /content/
Disallow /courses/
Disallow /node/
Disallow /our_team/
Allow /wp-admin/admin-ajax.php
Allow /wp-admin/load-scripts.php
Allow /wp-admin/load-styles.php

Other Records

Field Value
crawl-delay 6

petalbot
mail.ru

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /search/ -
Disallow /static/ -
Disallow /wp-admin/ -
Disallow /wp-content/ -
Disallow /wp-includes/ -
Disallow /wp-login.php -
Disallow *?action=lostpassword or Disallow: /*?action=lostpassword or all queries Disallow: /*?
Disallow */feed/ -
Disallow */trackback/ -
Disallow */comments/ -
Allow /feed/ -
Allow /en/feed/ -
Allow /ru/feed/ -
Allow /ky/feed/ -
Allow /de/feed/ -
Allow /wp-admin/admin-ajax.php -
Allow /wp-content/uploads/ -

Other Records

Field Value
crawl-delay 240

ahrefsbot
mj12bot
semrushbot
dotbot
dataforseobot
rogerbot
riddler

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /search/ -
Disallow /static/ -
Disallow /wp-admin/ -
Disallow /wp-content/ -
Disallow /wp-includes/ -
Disallow /wp-login.php -
Disallow /wp-json -
Disallow /en/wp-json -
Disallow /ru/wp-json -
Disallow /ky/wp-json -
Disallow /de/wp-json -
Disallow /*? all queries
Disallow */feed/ -
Disallow */trackback/ -
Disallow */comments/ -

Other Records

Field Value
crawl-delay 1024

surdotlybot

Rule Path
Disallow /

*

Rule Path Comment
Disallow /cgi-bin/ -
Disallow /search/ -
Disallow /static/ -
Disallow /wp-admin/ -
Disallow /wp-content/ -
Disallow /wp-includes/ -
Disallow /wp-login.php -
Disallow /wp-json -
Disallow /en/wp-json -
Disallow /ru/wp-json -
Disallow /ky/wp-json -
Disallow /de/wp-json -
Disallow /*? all queries
Disallow */feed/ -
Disallow */trackback/ -
Disallow */comments/ -

Other Records

Field Value
crawl-delay 1024

Other Records

Field Value
sitemap https://sris.edu.kg/sitemap_index.xml

Comments

  • Revision:
  • ---- Wed, 31. August 2022 15:32 Uhr ----
  • Main Search Engines and preferred Bots
  • Yandex
  • Ok Bots
  • Restricted Bots
  • Blocked Bots
  • Unknown Bots

Warnings

  • `clean-param` is not a known field.