Log In Sign Up

tgregion.com
robots.txt

Robots Exclusion Standard data for tgregion.com

Resource Scan

Scan Details

Site Domain tgregion.com
Base Domain tgregion.com
Scan Status Ok
Last Scan2025-07-05T13:26:48+00:00
Next Scan 2025-07-12T13:26:48+00:00

Last Scan

Scanned2025-07-05T13:26:48+00:00
URL https://tgregion.com/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:172, 31.31.196.214
Response IP 31.31.196.214
Found Yes
Hash 4a047502a5ae84974189e91c9ec2dc86b9ce414811bd526bfd6c8718f8508de5
SimHash 0d4656400530

Groups

*

Product Comment
* îáùèå ïðàâèëà äëÿ ðîáîòîâ, êðîìå ßíäåêñà è Google,
Rule Path Comment
Disallow /cgi-bin ïàïêà íà õîñòèíãå
Disallow /? âñå ïàðàìåòðû çàïðîñà íà ãëàâíîé
Disallow /wp- âñå ôàéëû WP: /wp-json/, /wp-includes, /wp-content/plugins
Disallow *?s= ïîèñê
Disallow *%26s%3D ïîèñê
Disallow /search/ ïîèñê
Disallow /author/ àðõèâ àâòîðà
Disallow /users/ àðõèâ àâòîðîâ
Disallow */trackback òðåêáåêè, óâåäîìëåíèÿ â êîììåíòàðèÿõ î ïîÿâëåíèè îòêðûòîé
Disallow */feed âñå ôèäû
Disallow */rss rss ôèä
Disallow */embed âñå âñòðàèâàíèÿ
Disallow /xmlrpc.php ôàéë WordPress API
Allow */uploads îòêðûâàåì ïàïêó ñ ôàéëàìè uploads

googlebot

Product Comment
googlebot ïðàâèëà äëÿ Google (êîììåíòàðèè íå äóáëèðóþ)
Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Allow */uploads -
Allow /*/*.js îòêðûâàåì js-ñêðèïòû âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà)
Allow /*/*.css îòêðûâàåì css-ôàéëû âíóòðè /wp- (/*/ - äëÿ ïðèîðèòåòà)
Allow /wp-*.png êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä.
Allow /wp-*.jpg êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä.
Allow /wp-*.jpeg êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä.
Allow /wp-*.gif êàðòèíêè â ïëàãèíàõ, cache ïàïêå è ò.ä.
Allow /wp-admin/admin-ajax.php èñïîëüçóåòñÿ ïëàãèíàìè, ÷òîáû íå áëîêèðîâàòü JS è CSS

yandex

Product Comment
yandex ïðàâèëà äëÿ ßíäåêñà (êîììåíòàðèè íå äóáëèðóþ)
Rule Path
Disallow /cgi-bin
Disallow /?
Disallow /wp-
Disallow *?s=
Disallow *%26s%3D
Disallow /search/
Disallow /author/
Disallow /users/
Disallow */trackback
Disallow */feed
Disallow */rss
Disallow */embed
Disallow /xmlrpc.php
Allow */uploads
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://tgregion.com/sitemap.xml
Back to top

Comments

  • ò.ê. äëÿ íèõ ïðàâèëà íèæå
  • ññûëêè íà ñòàòüþ
  • îò èíäåêñèðîâàíèÿ, à óäàëÿòü ïàðàìåòðû ìåòîê,
  • Google òàêèå ïðàâèëà íå ïîääåðæèâàåò
  • Óêàæèòå îäèí èëè íåñêîëüêî ôàéëîâ Sitemap (äóáëèðîâàòü äëÿ êàæäîãî User-agent
  • íå íóæíî). Google XML Sitemap ñîçäàåò 2 êàðòû ñàéòà, êàê â ïðèìåðå íèæå.
  • Óêàæèòå ãëàâíîå çåðêàëî ñàéòà, êàê â ïðèìåðå íèæå (ñ WWW / áåç WWW, åñëè HTTPS
  • òî ïèøåì ïðîòîêîë, åñëè íóæíî óêàçàòü ïîðò, óêàçûâàåì). Êîìàíäà ñòàëà íåîáÿçàòåëüíîé. Ðàíåå Host ïîíèìàë
  • ßíäåêñ è Mail.RU. Òåïåðü âñå îñíîâíûå ïîèñêîâûå ñèñòåìû êîìàíäó Host íå ó÷èòûâàþò.
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top