reg.ru
robots.txt
Robots Exclusion Standard data for reg.ru
Resource Scan
Scan Details
| Site Domain | reg.ru |
| Base Domain | reg.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-28T07:57:03+00:00 |
| Next Scan | 2024-06-27T07:57:03+00:00 |
Last Scan
| Scanned | 2024-05-28T07:57:03+00:00 |
| URL | https://reg.ru/robots.txt |
| Redirect | https://www.reg.ru/robots.txt |
| Redirect Domain | www.reg.ru |
| Redirect Base | reg.ru |
| Domain IPs | 194.67.72.31 |
| Redirect IPs | 194.67.72.31 |
| Response IP | 194.67.72.31 |
| Found | Yes |
| Hash | 2422b006cff9c42816ccb579024d68004a5ba20d3b985908743cd268e9e43d8e |
| SimHash | 1e009c36e123 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*prcode |
| Disallow | /api/ |
| Disallow | /order |
| Disallow | /settings |
| Disallow | /pay |
| Disallow | /*search |
| Disallow | /user/ |
| Disallow | /*leadpage |
| Disallow | /choose/domain |
| Disallow | /leads/RU |
| Disallow | /support/tickets |
| Disallow | /service/seowizard |
| Disallow | /web-tools/*/order |
| Disallow | /*.html$ |
| Disallow | /*.htm$ |
| Disallow | /*.rtf$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /*.pdf$ |
| Disallow | /*.csv$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.swf$ |
| Disallow | /company/news/rss |
| Allow | /sitemap?page |
| Disallow | /domain/shop/*search_with |
| Disallow | /domain/shop/search |
| Disallow | /domain/shop/lots-by-seller/ |
| Disallow | /*order/ |
| Disallow | /hosting/search |
| Disallow | /rt34g5345TYS |
| Disallow | /*?rid= |
| Disallow | /market/*?searchParams=* |
| Disallow | /market/* |
| Disallow | /*-promo |
| Disallow | /newsletters/ |
| Disallow | /*?rlink= |
| Disallow | /domain/shop/history |
| Disallow | /domain/shop/my_lots |
| Disallow | /cloudvps/order_promo |
| Disallow | /referral/program |
| Disallow | /domain/service/get_secret_key/ |
| Disallow | /reseller/details |
| Disallow | /shopcart/view |
| Disallow | /ssl-certificate/reissue_ssl/ |
| Disallow | /folders/ |
| Disallow | /wizard/ |
| Disallow | /misc/get_region_code_by_ip |
| Disallow | /support/get_alert |
| Disallow | /blog/search/$ |
| Disallow | /hc/ru/signin* |
| Disallow | */amp/* |
| Disallow | /dedicated/in/$ |
| Disallow | /vps/in/* |
| Allow | /vps/in/piter |
googlebot
| Rule | Path |
|---|---|
| Allow | /*.js$ |
| Allow | /*.css$ |
| Allow | /*.png$ |
| Allow | /*.svg$ |
| Allow | /*.jpg$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
| Allow | /blog/*/*.css |
| Allow | /domain/shop/lot*? |
| Disallow | /*prcode |
| Disallow | /api/ |
| Disallow | /order |
| Disallow | /settings |
| Disallow | /pay |
| Disallow | /user/ |
| Disallow | /*leadpage |
| Disallow | /choose/domain |
| Disallow | /leads/RU |
| Disallow | /support/tickets |
| Disallow | /service/seowizard |
| Disallow | /web-tools/*/order |
| Disallow | /*.html$ |
| Disallow | /*.htm$ |
| Disallow | /*.rtf$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /*.pdf$ |
| Disallow | /*.csv$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.swf$ |
| Disallow | /company/news/rss |
| Allow | /sitemap?page |
| Disallow | /*order/ |
| Disallow | /hosting/search |
| Allow | /rt34g5345TYS |
| Disallow | /market/*?searchParams=* |
| Disallow | /market/* |
| Disallow | /*-promo |
| Allow | /*?rid=* |
| Allow | /*?rlink=* |
| Disallow | /domain/shop/history |
| Disallow | /domain/shop/my_lots |
| Disallow | /cloudvps/order_promo |
| Disallow | /referral/program |
| Disallow | /domain/service/get_secret_key/ |
| Disallow | /reseller/details |
| Disallow | /shopcart/view |
| Disallow | /ssl-certificate/reissue_ssl/ |
| Disallow | /folders/ |
| Disallow | /wizard/ |
| Disallow | /misc/get_region_code_by_ip |
| Disallow | /support/get_alert |
| Disallow | /blog/search/$ |
| Disallow | /hc/ru/signin* |
| Disallow | /*? |
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /*prcode |
| Disallow | /api/ |
| Disallow | /order |
| Disallow | /settings |
| Disallow | /pay |
| Disallow | /user/ |
| Disallow | /*leadpage |
| Disallow | /choose/domain |
| Disallow | /leads/RU |
| Disallow | /support/tickets |
| Disallow | /service/seowizard |
| Disallow | /web-tools/*/order |
| Disallow | /*.html$ |
| Disallow | /*.htm$ |
| Disallow | /*.rtf$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /*.pdf$ |
| Disallow | /*.csv$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.swf$ |
| Disallow | /company/news/rss |
| Allow | /sitemap?page |
| Disallow | /*order/ |
| Disallow | /hosting/search |
| Disallow | /rt34g5345TYS |
| Disallow | /*?rid= |
| Disallow | /market/*?searchParams=* |
| Disallow | /market/* |
| Disallow | /*-promo |
| Disallow | /newsletters/ |
| Disallow | /domain/new/check_queue |
| Disallow | /misc/get_region_code_by_ip |
| Disallow | /support/get_alert |
| Disallow | /promo/ |
| Disallow | /web-tools/ddosprotection/ |
| Disallow | /email/ |
| Disallow | /promo/wizard |
| Disallow | /blog/search/$ |
| Disallow | /hc/ru/signin* |
| Disallow | /whois/history/index? |
| Disallow | /domain/new/rereg_details? |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.reg.ru/sitemap.xml |
| sitemap | https://www.reg.ru/sitemap_whois.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.