progamer.biz
robots.txt

Robots Exclusion Standard data for progamer.biz

Resource Scan

Scan Details

Site Domain progamer.biz
Base Domain progamer.biz
Scan Status Ok
Last Scan2024-10-05T05:25:39+00:00
Next Scan 2024-10-12T05:25:39+00:00

Last Scan

Scanned2024-10-05T05:25:39+00:00
URL https://progamer.biz/robots.txt
Domain IPs 104.21.24.26, 172.67.216.124, 2606:4700:3036::6815:181a, 2606:4700:3037::ac43:d87c
Response IP 104.21.24.26
Found Yes
Hash 05da12b7f4e6a0f8422b676740b173d78257c7be9878060a4512550d4502c3dc
SimHash 2c948972923d

Groups

*

Rule Path
Allow /

*

Product Comment
* Для всеÑ
Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /tag/ Закрываем метки
Disallow /readme.html Закрываем бесполезный мануал по установке WordPress (лежит в корне)
Disallow *?replytocom -
Allow */uploads -

googlebot

Product Comment
googlebot Для Гугла
Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Disallow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow *utm%3D -
Disallow *openstat%3D -
Disallow /tag/ Закрываем метки
Disallow /readme.html -
Disallow *?replytocom -
Allow */uploads -
Allow /*/*.js -
Allow /*/*.css -
Allow /wp-*.png -
Allow /wp-*.jpg -
Allow /wp-*.jpeg -
Allow /wp-*.gif -
Allow /wp-admin/admin-ajax.php -

yandex

Product Comment
yandex Для Яндекса
Rule Path Comment
Disallow /cgi-bin -
Disallow /? -
Disallow /wp- -
Disallow *?s= -
Disallow *%26s%3D -
Disallow /search/ -
Disallow /author/ -
Disallow /users/ -
Disallow */trackback -
Allow */feed -
Disallow */rss -
Disallow */embed -
Disallow /xmlrpc.php -
Disallow /tag/ Закрываем метки
Disallow /readme.html -
Disallow *?replytocom -
Disallow /de/ -
Disallow /pl/ -
Disallow /gr/ -
Disallow /fr/ -
Disallow /tr/ -
Disallow /en/ -
Disallow /es/ -
Disallow /ko/ -
Allow */uploads -
Allow /*/*.js -
Allow /*/*.css -
Allow /wp-*.png -
Allow /wp-*.jpg -
Allow /wp-*.jpeg -
Allow /wp-*.gif -
Allow /wp-admin/admin-ajax.php -

Other Records

Field Value
sitemap https://progamer.biz/sitemap.xml

Warnings

  • 2 invalid lines.
  • `clean-param` is not a known field.