smart-lab.ru
robots.txt
Robots Exclusion Standard data for smart-lab.ru
Resource Scan
Scan Details
Site Domain | smart-lab.ru |
Base Domain | smart-lab.ru |
Scan Status | Ok |
Last Scan | 2024-06-14T12:15:25+00:00 |
Next Scan | 2024-06-21T12:15:25+00:00 |
Last Scan
Scanned | 2024-06-14T12:15:25+00:00 |
URL | https://smart-lab.ru/robots.txt |
Domain IPs | 104.21.26.223, 172.67.139.119, 2606:4700:3030::ac43:8b77, 2606:4700:3034::6815:1adf |
Response IP | 104.21.26.223 |
Found | Yes |
Hash | ddfcfc5cc9d41f4c98d9bf03eb1993b87cd6fcbaf874b159e1e643248c0e3e3e |
SimHash | 0a08ca4bbd31 |
Groups
*
Rule | Path |
---|---|
Disallow | /blog/offtop/ |
Disallow | /print/ |
Disallow | /copypaste/ |
Disallow | /personal_blog/ |
Disallow | /votes/ |
Disallow | /templates/skin/smart-lab-x3/images/ |
Allow | /templates/skin/smart-lab-x3/images/smart-logo.png |
Disallow | /uploads/images/*/avatar_ |
Disallow | /finansoviy-slovar/edit/ |
Disallow | /finansoviy-slovar/delete/ |
Disallow | /forum/edit/ |
Disallow | /forum/delete/ |
Disallow | /crypto/edit/ |
Disallow | /crypto/delete/ |
Disallow | /trading/edit/ |
Disallow | /trading/delete/ |
Disallow | /forex/edit/ |
Disallow | /forex/delete/ |
Disallow | /bonds/edit/ |
Disallow | /bonds/delete/ |
Disallow | /algotrading/edit/ |
Disallow | /algotrading/delete/ |
Disallow | /options/edit/ |
Disallow | /options/delete/ |
Disallow | /banki/edit/ |
Disallow | /banki/delete/ |
Disallow | /trading-software/edit/ |
Disallow | /trading-software/delete/ |
Disallow | /brokers-rating/edit/ |
Disallow | /brokers-rating/delete/ |
Disallow | /people/method/ |
Disallow | /people/good/ |
Disallow | /people/instrument/ |
Disallow | /people/online/ |
Disallow | /settings/ |
Other Records
Field | Value |
---|---|
sitemap | http://smart-lab.ru/sitemap/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.