reg.ru
robots.txt

Robots Exclusion Standard data for reg.ru

Resource Scan

Scan Details

Site Domain reg.ru
Base Domain reg.ru
Scan Status Ok
Last Scan2024-10-25T07:58:39+00:00
Next Scan 2024-11-24T07:58:39+00:00

Last Scan

Scanned2024-10-25T07:58:39+00:00
URL https://reg.ru/robots.txt
Redirect https://www.reg.ru/robots.txt
Redirect Domain www.reg.ru
Redirect Base reg.ru
Domain IPs 194.67.72.31
Redirect IPs 194.67.72.31
Response IP 194.67.72.31
Found Yes
Hash 4f475c38bc8d4dabd86cca52724ba7dadc30abcb60479b7e5299b5db80556b3e
SimHash 16009c346131

Groups

yandex

Rule Path
Disallow /*?
Disallow /*prcode
Disallow /api/
Disallow /order
Disallow /settings
Disallow /pay
Disallow /*search
Disallow /user/
Disallow /*leadpage
Disallow /choose/domain
Disallow /leads/RU
Disallow /support/tickets
Disallow /service/seowizard
Disallow /web-tools/*/order
Disallow /*.html$
Disallow /*.htm$
Disallow /*.rtf$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.pdf$
Disallow /*.csv$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /*.swf$
Disallow /company/news/rss
Allow /sitemap?page
Disallow /domain/shop/*search_with
Disallow /domain/shop/search
Disallow /domain/shop/lots-by-seller/
Disallow /*order/
Disallow /hosting/search
Disallow /rt34g5345TYS
Disallow /*?rid=
Disallow /market/*?searchParams=*
Disallow /market/*
Disallow /*-promo
Disallow /newsletters/
Disallow /*?rlink=
Disallow /domain/shop/history
Disallow /domain/shop/my_lots
Disallow /cloudvps/order_promo
Disallow /referral/program
Disallow /domain/service/get_secret_key/
Disallow /reseller/details
Disallow /shopcart/view
Disallow /ssl-certificate/reissue_ssl/
Disallow /folders/
Disallow /wizard/
Disallow /misc/get_region_code_by_ip
Disallow /support/get_alert
Disallow /blog/search/$
Disallow /hc/ru/signin*
Disallow */amp/*
Disallow /dedicated/in/$
Disallow /vps/in/*
Allow /vps/in/piter

googlebot

Rule Path
Allow /*.js$
Allow /*.css$
Allow /*.png$
Allow /*.svg$
Allow /*.jpg$
Allow /*.jpeg$
Allow /*.gif$
Allow /blog/*/*.css
Allow /domain/shop/lot*?
Disallow /*prcode
Disallow /api/
Disallow /order
Disallow /settings
Disallow /pay
Disallow /user/
Disallow /*leadpage
Disallow /choose/domain
Disallow /leads/RU
Disallow /support/tickets
Disallow /service/seowizard
Disallow /web-tools/*/order
Disallow /*.html$
Disallow /*.htm$
Disallow /*.rtf$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.pdf$
Disallow /*.csv$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /*.swf$
Disallow /company/news/rss
Allow /sitemap?page
Disallow /*order/
Disallow /hosting/search
Allow /rt34g5345TYS
Disallow /market/*?searchParams=*
Disallow /market/*
Disallow /*-promo
Allow /*?rid=*
Allow /*?rlink=*
Disallow /domain/shop/history
Disallow /domain/shop/my_lots
Disallow /cloudvps/order_promo
Disallow /referral/program
Disallow /domain/service/get_secret_key/
Disallow /reseller/details
Disallow /shopcart/view
Disallow /ssl-certificate/reissue_ssl/
Disallow /folders/
Disallow /wizard/
Disallow /misc/get_region_code_by_ip
Disallow /support/get_alert
Disallow /blog/search/$
Disallow /hc/ru/signin*
Disallow /*?

*

Rule Path
Disallow /*?
Disallow /*prcode
Disallow /api/
Disallow /order
Disallow /settings
Disallow /pay
Disallow /user/
Disallow /*leadpage
Disallow /choose/domain
Disallow /leads/RU
Disallow /support/tickets
Disallow /service/seowizard
Disallow /web-tools/*/order
Disallow /*.html$
Disallow /*.htm$
Disallow /*.rtf$
Disallow /*.doc$
Disallow /*.docx$
Disallow /*.pdf$
Disallow /*.csv$
Disallow /*.xls$
Disallow /*.xlsx$
Disallow /*.swf$
Disallow /company/news/rss
Allow /sitemap?page
Disallow /*order/
Disallow /hosting/search
Disallow /rt34g5345TYS
Disallow /*?rid=
Disallow /market/*?searchParams=*
Disallow /market/*
Disallow /*-promo
Disallow /newsletters/
Disallow /domain/new/check_queue
Disallow /misc/get_region_code_by_ip
Disallow /support/get_alert
Disallow /promo/
Disallow /web-tools/ddosprotection/
Disallow /email/
Disallow /promo/wizard
Disallow /blog/search/$
Disallow /hc/ru/signin*
Disallow /whois/history/index?
Disallow /domain/new/rereg_details?

Other Records

Field Value
sitemap https://www.reg.ru/sitemap.xml
sitemap https://www.reg.ru/sitemap_whois.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.