beginner.com.ua
robots.txt

Robots Exclusion Standard data for beginner.com.ua

Resource Scan

Scan Details

Site Domain beginner.com.ua
Base Domain beginner.com.ua
Scan Status Ok
Last Scan2025-05-10T20:15:27+00:00
Next Scan 2025-05-17T20:15:27+00:00

Last Scan

Scanned2025-05-10T20:15:27+00:00
URL https://beginner.com.ua/robots.txt
Domain IPs 104.21.91.167, 172.67.175.203, 2606:4700:3033::6815:5ba7, 2606:4700:3033::ac43:afcb
Response IP 172.67.175.203
Found Yes
Hash cebb90265dc8d1f5af9933544cb450d6b21f2a748eaf3fc42de5054d2407d128
SimHash ea5cdc48be9b

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Disallow /cgi-bin/
Disallow /tag/
Disallow /category/
Disallow /author/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path Comment
Disallow /*?* Запрещаем индексацию страниц с параметрами

*

Rule Path
Disallow /*utm_source
Disallow /*utm_medium
Disallow /*utm_campaign
Disallow /*utm_term
Disallow /*utm_content
Disallow /*gclid

*

Rule Path Comment
Disallow /search/ Запрещаем индексацию страниц поиска
Disallow /?s= Запрещаем индексацию результатов поиска

Other Records

Field Value
sitemap https://beginner.com.ua/sitemap_index.xml