feederist.ru
robots.txt

Robots Exclusion Standard data for feederist.ru

Resource Scan

Scan Details

Site Domain feederist.ru
Base Domain feederist.ru
Scan Status Ok
Last Scan2024-09-30T20:37:15+00:00
Next Scan 2024-10-07T20:37:15+00:00

Last Scan

Scanned2024-09-30T20:37:15+00:00
URL https://feederist.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:202, 31.31.196.85
Response IP 31.31.196.85
Found Yes
Hash 592c67953cd67114aab4d68ec89baced8081759e24a8f50435e2b7721d370bbb
SimHash 2571d40e2337

Groups

*

Rule Path
Allow /*.css
Allow /*.js
Disallow /tag/
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /readme.html
Disallow /*?
Disallow /?s=
Disallow */page/
Disallow /forum/birthdays/
Disallow /forum/find-new/
Disallow /forum/forums/*/?direction
Disallow /forum/forums/*/?order
Disallow /forum/forums/*/mark-read?date
Disallow /forum/forums/*/page-*?order
Disallow /forum/help/
Disallow /forum/lost-password/
Disallow /forum/members/
Disallow /forum/misc/
Disallow /forum/online/
Disallow /forum/pages/privacy/
Disallow /forum/recent-activity/
Disallow /forum/register
Disallow /forum/search
Disallow /forum/search.php
Disallow /forum/threads/*/poll
Disallow /forum/attachments/*/
Disallow /forum/account/
Disallow /forum/goto/
Disallow /forum/posts/
Disallow /forum/login/
Disallow /forum/admin.php

surdotlybot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://feederist.ru/sitemap_index.xml