buro247.ru
robots.txt

Robots Exclusion Standard data for buro247.ru

Resource Scan

Scan Details

Site Domain buro247.ru
Base Domain buro247.ru
Scan Status Ok
Last Scan2024-05-03T11:39:30+00:00
Next Scan 2024-05-10T11:39:30+00:00

Last Scan

Scanned2024-05-03T11:39:30+00:00
URL https://buro247.ru/robots.txt
Redirect https://www.buro247.ru/robots.txt
Redirect Domain www.buro247.ru
Redirect Base buro247.ru
Domain IPs 79.137.221.50
Redirect IPs 79.137.221.50
Response IP 79.137.221.50
Found Yes
Hash a2e66d0965c20207e0186e710bc68b96930475d9e2a6f310507df3fe91646f19
SimHash 4c044251c115

Groups

hypestat

Rule Path
Disallow /

anews/1.0

Rule Path
Allow /xml/anews.xml

*

Rule Path
Disallow /admin
Disallow /newuser
Disallow /enter
Disallow /sendpass
Disallow /user
Disallow /search?*
Disallow /stars/search
Disallow /instagram/search
Disallow /blogs/by-author*
Disallow /all/?page=*

yandex

Rule Path
Disallow /admin
Disallow /newuser
Disallow /enter
Disallow /sendpass
Disallow /user
Disallow /search?*
Disallow /stars/search
Disallow /instagram/search
Disallow /blogs/by-author*
Disallow /all/?page=*
Disallow /*fb_comment_id
Disallow /*noredir
Disallow /*_gl
Disallow /*data-turbo
Disallow /*card
Disallow /*slide
Disallow /*type
Disallow /*switch_to_desktop%3Dtrue

Other Records

Field Value
sitemap https://www.buro247.ru/sitemap1.xml
sitemap https://www.buro247.ru/sitemap2.xml

Warnings

  • `host` is not a known field.