g-news.com.ua
robots.txt

Robots Exclusion Standard data for g-news.com.ua

Resource Scan

Scan Details

Site Domain g-news.com.ua
Base Domain g-news.com.ua
Scan Status Ok
Last Scan2024-11-09T01:01:46+00:00
Next Scan 2024-11-16T01:01:46+00:00

Last Scan

Scanned2024-11-09T01:01:46+00:00
URL https://g-news.com.ua/robots.txt
Domain IPs 185.91.75.16
Response IP 185.91.75.16
Found Yes
Hash 8d8e14085a2332334df2bee7aef4bbd3eaf9d93234d1a43f369b104da6eef6fb
SimHash eb60b6f00911

Groups

*

Rule Path
Allow /components/*.js
Allow /components/*.css
Allow /modules/*.js
Allow /modules/*.css
Allow /plugins/*.js
Allow /plugins/*.css
Allow /templates/*.js
Allow /templates/*.css
Disallow /administrator/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /docs/
Disallow /images.orig/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /libraries/
Disallow /logs/
Disallow /media/
Disallow /modules/
Disallow /plugins/
Disallow /t3-assets/
Disallow /templates/
Disallow /tmp/
Disallow /component/search/
Disallow /component/mailto/
Disallow /component/mtree/
Disallow /using-joomla/extensions/components/users-component/
Disallow /using-joomla/extensions/components/search-component/
Disallow /forum_smf/activate/
Disallow /forum_smf/admin/
Disallow /forum_smf/calendar/
Disallow /forum_smf/help/
Disallow /forum_smf/search/
Disallow /forum_smf/sendtopic/
Disallow /forum_smf/mlist/
Disallow /forum_smf/recent/
Disallow /forum_smf/register/
Disallow /forum_smf/login/
Disallow /forum_smf/groups/
Disallow /forum_smf/stats/
Disallow /forum_smf/showtopic/
Disallow /forum_smf/unread/
Disallow /forum_smf/all/
Disallow /forum_smf/msg/
Disallow /forum_smf/prev_next/
Disallow /forum_smf/sort/
Disallow /forum_smf/topicseen/
Disallow /forum_smf/wap/
Disallow /forum_smf/wap2/
Disallow /forum_smf/imode/
Disallow /forum_smf/*PHPSESSID
Allow /forum_smf/$
Allow /forum_smf/*.xml
Allow /forum_smf/*.rss
Allow /forum_smf/*.rss_bot
Allow /forum_smf/*type%3Drss
Allow /forum_smf/*.css$
Allow /forum_smf/*.js$
Allow /forum_smf/*.png$
Allow /forum_smf/*.jpg$
Allow /forum_smf/*.gif$
Allow /forum_smf/*board%2C*.0.html$
Allow /forum_smf/*sitemap

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 100

msnbot-mm
mj12bot
ahrefsbot
linguee bot
gptbot
bytespider
amazonbot
claudebot

Rule Path
Disallow /

yandeximageresizer

Rule Path
Allow /forum_smf/*wap
Allow /forum_smf/*wap2
Allow /forum_smf/*imode
Disallow /forum_smf/

mediapartners-google
yadirectbot

Rule Path
Allow /*

Other Records

Field Value
sitemap https://g-news.com.ua/forum_smf/sitemap.xml

Warnings

  • `host` is not a known field.