fl.ru
robots.txt

Robots Exclusion Standard data for fl.ru

Resource Scan

Scan Details

Site Domain fl.ru
Base Domain fl.ru
Scan Status Ok
Last Scan2024-09-22T04:15:37+00:00
Next Scan 2024-09-29T04:15:37+00:00

Last Scan

Scanned2024-09-22T04:15:37+00:00
URL https://fl.ru/robots.txt
Redirect https://www.fl.ru/robots.txt
Redirect Domain www.fl.ru
Redirect Base fl.ru
Domain IPs 185.129.102.109
Redirect IPs 185.129.102.109
Response IP 185.129.102.109
Found Yes
Hash c1ea9ee498b35af680467de3a6989f17757862846a55de6390ef662ae044f048
SimHash cc68ad6fea23

Groups

yandex

Rule Path
Disallow /login/
Disallow /registration/
Disallow /remind/
Disallow /search/
Disallow /webim
Disallow /xajax
Disallow /*?ord=
Disallow /projects/upload/
Disallow /*?from
Disallow /*%26ord
Disallow /*?kind
Disallow /*?open=
Disallow /*?closed=
Disallow /*?user=
Disallow /*?order=
Disallow /*?om=
Disallow /fbd.php
Disallow /public/
Disallow /*?word=
Disallow /*%26sort%3D
Disallow /proonly.php
Disallow /login.php
Disallow /%26b%3D
Disallow /a.php
Disallow /*?tag=
Disallow */rss/*
Disallow /*?keywords
Disallow *?mode*
Disallow *?pid=
Disallow *?sort
Disallow *?action
Disallow /new-personal-order/
Disallow /guest/new/personal-order/
Disallow /catalog*
Disallow /account/registration/
Disallow /account/login/
Disallow /b2b/ydirect/
Disallow /task/*?GA_EVENT
Disallow /task/*?ec=
Disallow /vacancy/create/*?GA_EVENT
Disallow /vacancy/create/*?ec=
Disallow /projects/create/*?GA_EVENT
Disallow /projects/create/*?ec=
Disallow /orders/create-personal/*/*?GA_EVENT
Disallow /orders/create-personal/*/*?ec=
Disallow /orders/create-personal/
Disallow /projects/*/*?*ref=*
Disallow /users/*/*?*prjid=*
Disallow /users/*/portfolio/*/*?view
Disallow /image.php
Disallow *utm*%3D
Allow /catalog/profile/4840832
Allow /catalog/profile/3273357
Allow /catalog/profile/1382177
Allow /catalog/profile/7744773
Allow /catalog/profile/968009
Allow /catalog/profile/1748453
Allow /catalog/profile/7524096
Allow /catalog/profile/3617706
Allow /catalog/profile/1443423
Allow /catalog/profile/6081621
Allow /catalog/profile/3973434
Allow /catalog/profile/6132519
Allow /catalog/profile/7887525
Allow /catalog/profile/2475675
Allow /catalog/profile/4940328
Allow /catalog/profile/4455596
Allow /catalog/profile/320989
Allow /catalog/profile/1472897

googlebot

Rule Path
Disallow /login/
Disallow /registration/
Disallow /remind/
Disallow /search/
Disallow /webim
Disallow /xajax
Disallow /projects/upload/
Disallow /*?ord=
Disallow /*?from
Disallow /*%26ord
Disallow /*?kind
Disallow /*?open=
Disallow /*?closed=
Disallow /*?user=
Disallow /*?order=
Disallow /*?om=
Disallow /fbd.php
Disallow /public/
Disallow /*?word=
Disallow /*%26sort%3D
Disallow /proonly.php
Disallow /login.php
Disallow /%26b%3D
Disallow /a.php
Disallow /*?tag=
Disallow */rss/*
Disallow /*?keywords
Disallow *?mode*
Disallow *?pid=
Disallow *?sort
Disallow *?action
Disallow /new-personal-order/
Disallow /guest/new/personal-order/
Disallow /*filter%3D*
Disallow /*show%3Dall*
Disallow /catalog*
Disallow /account/registration/
Disallow /account/login/
Disallow /b2b/ydirect/
Disallow /task/*?GA_EVENT
Disallow /task/*?ec=
Disallow /vacancy/create/*?GA_EVENT
Disallow /vacancy/create/*?ec=
Disallow /projects/create/*?GA_EVENT
Disallow /projects/create/*?ec=
Disallow /orders/create-personal/*/*?GA_EVENT
Disallow /orders/create-personal/*/*?ec=
Disallow /orders/create-personal/
Disallow /projects/*/*?*ref=*
Disallow /users/*/*?*prjid=*
Disallow /users/*/portfolio/*/*?view
Disallow /image.php
Allow /catalog/profile/4840832
Allow /catalog/profile/3273357
Allow /catalog/profile/1382177
Allow /catalog/profile/7744773
Allow /catalog/profile/968009
Allow /catalog/profile/1748453
Allow /catalog/profile/7524096
Allow /catalog/profile/3617706
Allow /catalog/profile/1443423
Allow /catalog/profile/6081621
Allow /catalog/profile/3973434
Allow /catalog/profile/6132519
Allow /catalog/profile/7887525
Allow /catalog/profile/2475675
Allow /catalog/profile/4940328
Allow /catalog/profile/4455596
Allow /catalog/profile/320989
Allow /catalog/profile/1472897
Allow /sitemap/project-category.xml
Allow /sitemap/catalog_new.xml
Allow /sitemap/projects_new.xml
Allow /sitemap/projects28.xml
Allow /sitemap/projects27.xml
Allow /sitemap/projects26.xml
Allow /sitemap/projects25.xml
Allow /sitemap/users_new.xml
Allow /sitemap/users600.xml
Allow /sitemap/users599.xml
Allow /sitemap/users598.xml
Allow /sitemap/userpages_new.xml
Allow /sitemap/userpages118.xml
Allow /sitemap/userpages117.xml
Allow /sitemap/userpages116.xml
Allow /sitemap/portfolio_new.xml
Allow /sitemap/portfolio1449.xml
Allow /sitemap/portfolio1448.xml
Allow /sitemap/portfolio1447.xml
Allow /sitemap/interview_new.xml

dotbot

Rule Path
Disallow /

aggregator:spinn3r

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /login/
Disallow /registration/
Disallow /remind/
Disallow /search/
Disallow /webim
Disallow /xajax
Disallow /projects/upload/
Disallow /*?ord=
Disallow /users/*/contacts/
Disallow /*?from
Disallow /*%26ord
Disallow /*?kind
Disallow /*?open=
Disallow /*?closed=
Disallow /*?user=
Disallow /*?order=
Disallow /*?om=
Disallow /fbd.php
Disallow /public/
Disallow /*?word=
Disallow /*%26sort%3D
Disallow /proonly.php
Disallow /login.php
Disallow /%26b%3D
Disallow /a.php
Disallow /*?tag=
Disallow */rss/*
Disallow /*?keywords
Disallow *?mode*
Disallow *?pid=
Disallow *?sort
Disallow *?action
Disallow /new-personal-order/
Disallow /guest/new/personal-order/
Disallow /*filter%3D*
Disallow /*show%3Dall*
Disallow /catalog*
Disallow /account/registration/
Disallow /account/login/
Disallow /b2b/ydirect/
Disallow /task/*?GA_EVENT
Disallow /task/*?ec=
Disallow /vacancy/create/*?GA_EVENT
Disallow /vacancy/create/*?ec=
Disallow /projects/create/*?GA_EVENT
Disallow /projects/create/*?ec=
Disallow /orders/create-personal/*/*?GA_EVENT
Disallow /orders/create-personal/*/*?ec=
Disallow /orders/create-personal/
Disallow /projects/*/*?*ref=*
Disallow /users/*/*?*prjid=*
Disallow /users/*/portfolio/*/*?view
Disallow /image.php
Disallow *utm*%3D
Allow /catalog/profile/4840832
Allow /catalog/profile/3273357
Allow /catalog/profile/1382177
Allow /catalog/profile/7744773
Allow /catalog/profile/968009
Allow /catalog/profile/1748453
Allow /catalog/profile/7524096
Allow /catalog/profile/3617706
Allow /catalog/profile/1443423
Allow /catalog/profile/6081621
Allow /catalog/profile/3973434
Allow /catalog/profile/6132519
Allow /catalog/profile/7887525
Allow /catalog/profile/2475675
Allow /catalog/profile/4940328
Allow /catalog/profile/4455596
Allow /catalog/profile/320989
Allow /catalog/profile/1472897

Other Records

Field Value
sitemap https://www.fl.ru/sitemap.xml
sitemap https://www.fl.ru/sitemap.xml
sitemap https://www.fl.ru/sitemap/project-category.xml
sitemap https://www.fl.ru/sitemap/catalog_new.xml
sitemap https://www.fl.ru/sitemap/projects_new.xml
sitemap https://www.fl.ru/sitemap/users_new.xml
sitemap https://www.fl.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.