hobbyoutlet.ru
robots.txt

Robots Exclusion Standard data for hobbyoutlet.ru

Resource Scan

Scan Details

Site Domain hobbyoutlet.ru
Base Domain hobbyoutlet.ru
Scan Status Ok
Last Scan2024-10-24T19:52:28+00:00
Next Scan 2024-11-23T19:52:28+00:00

Last Scan

Scanned2024-10-24T19:52:28+00:00
URL https://hobbyoutlet.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:8:7ef, 2a00:15f8:a000:5:1:12:8:7ef, 2a00:15f8:a000:5:1:13:8:7ef, 2a00:15f8:a000:5:1:14:8:7ef, 90.156.201.28, 90.156.201.36, 90.156.201.37, 90.156.201.80
Response IP 90.156.201.28
Found Yes
Hash f44d4c80c2f2ca9c08083b871ce77c92eefad957fca6c2d9751556010f76d967
SimHash 60e97213997b

Groups

*

Rule Path
Allow /hobbyoutlet.ru
Disallow *webasyst/
Disallow /checkout/
Disallow /my/
Disallow /search/
Disallow /tag/
Disallow *sort%3D*
Disallow /signup/
Disallow /login/
Disallow /forgotpassword/
Disallow /webasyst/
Disallow */blog/
Disallow /?link=*
Disallow /compare/
Disallow /cart/
Disallow /hobby-old/
Disallow /photos/
Disallow */reviews/
Disallow */test*
Disallow *cml1c/
Disallow */vk/
Disallow */xml/
Disallow */yml/
Disallow */turbo/
Disallow */logs/
Disallow *multiform/
Disallow *.html
Disallow *.php
Disallow *.pdf
Disallow *vebinar14
Disallow *search
Disallow *mailer/
Disallow *login/
Disallow *signup/
Disallow *forgotpassword/
Disallow *order/
Disallow */cart/
Disallow *onestep/
Disallow *checkout/
Disallow */my/
Disallow *?page=*
Disallow *tel%3A
Disallow *skype%3A
Disallow *mailto%3A
Disallow *tg%3A
Disallow *viber%3A
Disallow *undefined
Disallow *compare/
Disallow *?
Disallow */author/
Disallow */2015/
Disallow */2016/
Disallow */2017/
Disallow */2018/
Disallow */2019/
Disallow */2020/
Disallow */2021/
Disallow */2022/
Disallow */2023/
Disallow */2024/
Disallow */2025/
Disallow */2026/
Disallow */2027/
Disallow */2028/
Disallow */2029/
Disallow */2030/
Disallow */2031/
Disallow */2032/
Disallow */2033/
Disallow */2034/
Disallow */2035/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://hobbyoutlet.ru/sitemap.xml

Comments

  • upd 09.04.2023
  • system hidden pages
  • service links
  • garbage and dublicates
  • blog garbage
  • end