smart-lab.ru
robots.txt

Robots Exclusion Standard data for smart-lab.ru

Resource Scan

Scan Details

Site Domain smart-lab.ru
Base Domain smart-lab.ru
Scan Status Ok
Last Scan2024-06-14T12:15:25+00:00
Next Scan 2024-06-21T12:15:25+00:00

Last Scan

Scanned2024-06-14T12:15:25+00:00
URL https://smart-lab.ru/robots.txt
Domain IPs 104.21.26.223, 172.67.139.119, 2606:4700:3030::ac43:8b77, 2606:4700:3034::6815:1adf
Response IP 104.21.26.223
Found Yes
Hash ddfcfc5cc9d41f4c98d9bf03eb1993b87cd6fcbaf874b159e1e643248c0e3e3e
SimHash 0a08ca4bbd31

Groups

yandex

Rule Path
Disallow

dotbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

flipboardproxy

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /blog/offtop/
Disallow /print/
Disallow /copypaste/
Disallow /personal_blog/
Disallow /votes/
Disallow /templates/skin/smart-lab-x3/images/
Allow /templates/skin/smart-lab-x3/images/smart-logo.png
Disallow /uploads/images/*/avatar_
Disallow /finansoviy-slovar/edit/
Disallow /finansoviy-slovar/delete/
Disallow /forum/edit/
Disallow /forum/delete/
Disallow /crypto/edit/
Disallow /crypto/delete/
Disallow /trading/edit/
Disallow /trading/delete/
Disallow /forex/edit/
Disallow /forex/delete/
Disallow /bonds/edit/
Disallow /bonds/delete/
Disallow /algotrading/edit/
Disallow /algotrading/delete/
Disallow /options/edit/
Disallow /options/delete/
Disallow /banki/edit/
Disallow /banki/delete/
Disallow /trading-software/edit/
Disallow /trading-software/delete/
Disallow /brokers-rating/edit/
Disallow /brokers-rating/delete/
Disallow /people/method/
Disallow /people/good/
Disallow /people/instrument/
Disallow /people/online/
Disallow /settings/

Other Records

Field Value
sitemap http://smart-lab.ru/sitemap/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.